Jul 02 19:09:34.952119 ip-10-0-143-38 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 02 19:09:34.952133 ip-10-0-143-38 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 02 19:09:34.952143 ip-10-0-143-38 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 02 19:09:34.952613 ip-10-0-143-38 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 02 19:09:45.071862 ip-10-0-143-38 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 02 19:09:45.071878 ip-10-0-143-38 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 5a1a4752149c440f89616e1771f3496e --
Jul 02 19:11:42.253352 ip-10-0-143-38 systemd[1]: Starting Kubernetes Kubelet...
Jul 02 19:11:42.585387 ip-10-0-143-38 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 02 19:11:42.585387 ip-10-0-143-38 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 02 19:11:42.585387 ip-10-0-143-38 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 02 19:11:42.585387 ip-10-0-143-38 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 02 19:11:42.585387 ip-10-0-143-38 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 02 19:11:42.587016 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.586876    2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 02 19:11:42.591995 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.591976    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 19:11:42.591995 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.591995    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 19:11:42.592165 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592002    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 19:11:42.592165 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592009    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 19:11:42.592165 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592014    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 19:11:42.592165 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592018    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 19:11:42.592165 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592023    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 19:11:42.592165 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592026    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 19:11:42.592165 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592030    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 19:11:42.592165 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592035    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 19:11:42.592165 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592039    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 19:11:42.592165 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592043    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 19:11:42.592165 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592047    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 19:11:42.592165 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592058    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 19:11:42.592165 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592063    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 19:11:42.592165 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592084    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 19:11:42.592165 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592089    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 19:11:42.592165 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592093    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 19:11:42.592165 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592097    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 19:11:42.592165 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592101    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 19:11:42.592165 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592106    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 19:11:42.592165 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592110    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 19:11:42.592977 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592114    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 19:11:42.592977 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592118    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 19:11:42.592977 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592122    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 19:11:42.592977 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592126    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 19:11:42.592977 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592130    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 19:11:42.592977 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592134    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 19:11:42.592977 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592139    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 19:11:42.592977 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592143    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 19:11:42.592977 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592147    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 19:11:42.592977 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592151    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 19:11:42.592977 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592156    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 19:11:42.592977 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592160    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 19:11:42.592977 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592164    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 19:11:42.592977 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592168    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 19:11:42.592977 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592172    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 19:11:42.592977 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592176    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 19:11:42.592977 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592184    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 19:11:42.592977 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592190    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 19:11:42.592977 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592195    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 19:11:42.593497 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592201    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 19:11:42.593497 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592207    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 19:11:42.593497 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592211    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 19:11:42.593497 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592215    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 19:11:42.593497 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592228    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 19:11:42.593497 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592232    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 19:11:42.593497 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592236    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 19:11:42.593497 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592240    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 19:11:42.593497 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592244    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 19:11:42.593497 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592249    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 19:11:42.593497 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592253    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 19:11:42.593497 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592257    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 19:11:42.593497 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592261    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 19:11:42.593497 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592266    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 19:11:42.593497 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592270    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 19:11:42.593497 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592274    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 19:11:42.593497 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592278    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 19:11:42.593497 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592282    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 19:11:42.593497 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592286    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 19:11:42.594017 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592291    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 19:11:42.594017 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592295    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 19:11:42.594017 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592299    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 19:11:42.594017 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592304    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 19:11:42.594017 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592308    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 19:11:42.594017 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592312    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 19:11:42.594017 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592316    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 19:11:42.594017 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592321    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 19:11:42.594017 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592325    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 19:11:42.594017 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592329    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 19:11:42.594017 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592334    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 19:11:42.594017 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592338    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 19:11:42.594017 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592343    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 19:11:42.594017 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592347    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 19:11:42.594017 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592351    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 19:11:42.594017 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592355    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 19:11:42.594017 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592359    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 19:11:42.594017 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592364    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 19:11:42.594017 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592379    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 19:11:42.594017 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592383    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 19:11:42.594878 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592389    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 19:11:42.594878 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592394    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 19:11:42.594878 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592399    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 19:11:42.594878 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592404    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 19:11:42.594878 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592409    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 19:11:42.594878 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592413    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 19:11:42.594878 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592417    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 19:11:42.594878 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592421    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 19:11:42.594878 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592425    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 19:11:42.594878 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592429    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 19:11:42.594878 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592433    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 19:11:42.594878 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592437    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 19:11:42.594878 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592442    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 19:11:42.594878 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592446    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 19:11:42.594878 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592450    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 19:11:42.594878 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592454    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 19:11:42.594878 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592459    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 19:11:42.594878 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592463    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 19:11:42.594878 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.592467    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 19:11:42.594878 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.594640    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 19:11:42.595589 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.594651    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 19:11:42.595589 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.594656    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 19:11:42.595589 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.594661    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 19:11:42.595589 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.594665    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 19:11:42.595589 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.594670    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 19:11:42.595589 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.594674    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 19:11:42.595589 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.594679    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 19:11:42.595589 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.594684    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 19:11:42.595589 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.594688    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 19:11:42.595589 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.594692    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 19:11:42.595589 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.594696    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 19:11:42.595589 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.594701    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 19:11:42.595589 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.594705    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 19:11:42.595589 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.594709    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 19:11:42.595589 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.594713    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 19:11:42.595589 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.594717    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 19:11:42.595589 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.594721    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 19:11:42.595589 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.594725    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 19:11:42.595589 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.594729    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 19:11:42.595589 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.594734    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 19:11:42.596372 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.594740    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 19:11:42.596372 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.594745    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 19:11:42.596372 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.594749    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 19:11:42.596372 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.594753    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 19:11:42.596372 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.594758    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 19:11:42.596372 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.594762    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 19:11:42.596372 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.594766    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 19:11:42.596372 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.594771    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 19:11:42.596372 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.594775    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 19:11:42.596372 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.594778    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 19:11:42.596372 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.594783    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 19:11:42.596372 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.594787    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 19:11:42.596372 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.594791    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 19:11:42.596372 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.594796    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 19:11:42.596372 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.594799    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 19:11:42.596372 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.594804    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 19:11:42.596372 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.594808    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 19:11:42.596372 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.594812    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 19:11:42.596372 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.594816    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 19:11:42.596372 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.594820    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 19:11:42.596961 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.594825    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 19:11:42.596961 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.594831    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 19:11:42.596961 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.594837    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 19:11:42.596961 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.594841    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 19:11:42.596961 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.594847    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 19:11:42.596961 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.594852    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 19:11:42.596961 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.594856    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 19:11:42.596961 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.594860    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 19:11:42.596961 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.594865    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 19:11:42.596961 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.594869    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 19:11:42.596961 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.594873    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 19:11:42.596961 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.594878    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 19:11:42.596961 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.594882    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 19:11:42.596961 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.594886    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 19:11:42.596961 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.594890    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 19:11:42.596961 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.594895    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 19:11:42.596961 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.594899    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 19:11:42.596961 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.594903    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 19:11:42.596961 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.594908    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 19:11:42.597452 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.594912    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 19:11:42.597452 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.594916    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 19:11:42.597452 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.594922    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 19:11:42.597452 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.594926    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 19:11:42.597452 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.594930    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 19:11:42.597452 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.594934    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 19:11:42.597452 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.594938    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 19:11:42.597452 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.594943    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 19:11:42.597452 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.594947    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 19:11:42.597452 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.594951    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 19:11:42.597452 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.594955    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 19:11:42.597452 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.594959    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 19:11:42.597452 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.594962    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 19:11:42.597452 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.594966    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 19:11:42.597452 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.594969    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 19:11:42.597452 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.594974    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 19:11:42.597452 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.594979    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 19:11:42.597452 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.594983    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 19:11:42.597452 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.594988    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 19:11:42.597913 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.594992    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 19:11:42.597913 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.594996    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 19:11:42.597913 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.594999    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 19:11:42.597913 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.595004    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 19:11:42.597913 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.595007    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 19:11:42.597913 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.595011    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 19:11:42.597913 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.595016    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 19:11:42.597913 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.595020    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 19:11:42.597913 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.595024    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 19:11:42.597913 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.595028    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 19:11:42.597913 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.595036    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 19:11:42.597913 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.595040    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 19:11:42.597913 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.595044    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 19:11:42.597913 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.595048    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 19:11:42.597913 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.595052    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 19:11:42.597913 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.595056    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 19:11:42.597913 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.595060    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 19:11:42.597913 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.595082    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 19:11:42.597913 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.595088    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 19:11:42.597913 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.595092    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 19:11:42.598435 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.595711    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 19:11:42.598435 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.595820    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 19:11:42.598435 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.595826    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 19:11:42.598435 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.595830    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 19:11:42.598435 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.595835    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 19:11:42.598435 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.595840    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 19:11:42.598435 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.595851    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 19:11:42.598435 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.595856    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 19:11:42.598435 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.595860    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 19:11:42.598435 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.595865    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 19:11:42.598435 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.595869    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 19:11:42.598435 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.595874    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 19:11:42.598435 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.595879    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 19:11:42.598435 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.595883    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 19:11:42.598435 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.595887    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 19:11:42.598435 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.595892    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 19:11:42.598435 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.595897    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 19:11:42.598435 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.595901    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 19:11:42.598435 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.595910    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 19:11:42.598435 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.595914    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 19:11:42.598911 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.595918    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 19:11:42.598911 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.595922    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 19:11:42.598911 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.595927    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 19:11:42.598911 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.595931    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 19:11:42.598911 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.595935    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 19:11:42.598911 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.595939    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 19:11:42.598911 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.595943    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 19:11:42.598911 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.595947    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 19:11:42.598911 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.595951    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 19:11:42.598911 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.595955    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 19:11:42.598911 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.595959    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 19:11:42.598911 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.595968    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 19:11:42.598911 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.595983    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 19:11:42.598911 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.595988    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 19:11:42.598911 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.595992    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 19:11:42.598911 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.595997    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 19:11:42.598911 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.596003    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 19:11:42.598911 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.596010    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 19:11:42.598911 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.596014    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 19:11:42.599412 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.596019    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 19:11:42.599412 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.596023    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 19:11:42.599412 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.596027    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 19:11:42.599412 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.596033    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 19:11:42.599412 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.596046    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 19:11:42.599412 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.596051    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 19:11:42.599412 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.596056    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 19:11:42.599412 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.596061    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 19:11:42.599412 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.596083    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 19:11:42.599412 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.596089    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 19:11:42.599412 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.596093    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 19:11:42.599412 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.596100    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 19:11:42.599412 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.596104    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 19:11:42.599412 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.596108    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 19:11:42.599412 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.596113    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 19:11:42.599412 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.596117    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 19:11:42.599412 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.596128    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 19:11:42.599412 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.596132    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 19:11:42.599412 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.596137    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 19:11:42.599412 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.596141    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 19:11:42.599887 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.596146    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 19:11:42.599887 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.596150    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 19:11:42.599887 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.596155    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 19:11:42.599887 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.596159    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 19:11:42.599887 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.596167    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 19:11:42.599887 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.596171    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 19:11:42.599887 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.596176    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 19:11:42.599887 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.596180    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 19:11:42.599887 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.596185    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 19:11:42.599887 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.596195    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 19:11:42.599887 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.596199    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 19:11:42.599887 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.596205    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 19:11:42.599887 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.596210    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 19:11:42.599887 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.596215    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 19:11:42.599887 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.596219    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 19:11:42.599887 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.596223    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 19:11:42.599887 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.596227    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 19:11:42.599887 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.596231    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 19:11:42.599887 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.596235    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 19:11:42.600363 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.596240    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 19:11:42.600363 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.596244    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 19:11:42.600363 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.596253    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 19:11:42.600363 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.596257    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 19:11:42.600363 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.596261    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 19:11:42.600363 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.596266    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 19:11:42.600363 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.596270    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 19:11:42.600363 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.596274    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 19:11:42.600363 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.596278    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 19:11:42.600363 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.596283    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 19:11:42.600363 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.596287    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 19:11:42.600363 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.596292    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 19:11:42.600363 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.596296    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 19:11:42.600363 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.596300    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 19:11:42.600363 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.596305    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 19:11:42.600363 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.596314    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 19:11:42.600363 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.596318    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 19:11:42.600363 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.596326    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 19:11:42.600363 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.596332    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 19:11:42.600363 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.596336    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 19:11:42.600879 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.596341    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 19:11:42.600879 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.596486    2562 flags.go:64] FLAG: --address="0.0.0.0"
Jul 02 19:11:42.600879 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.596496    2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 02 19:11:42.600879 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.596507    2562 flags.go:64] FLAG: --anonymous-auth="true"
Jul 02 19:11:42.600879 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.596514    2562 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 02 19:11:42.600879 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.596521    2562 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 02 19:11:42.600879 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.596525    2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 02 19:11:42.600879 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.596533    2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 02 19:11:42.600879 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.596538    2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 02 19:11:42.600879 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.596541    2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 02 19:11:42.600879 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.596544    2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 02 19:11:42.600879 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.596548    2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 02 19:11:42.600879 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.596552    2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 02 19:11:42.600879 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.596555    2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 02 19:11:42.600879 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.596559    2562 flags.go:64] FLAG: --cgroup-root=""
Jul 02 19:11:42.600879 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.596568    2562 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 02 19:11:42.600879 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.596575    2562 flags.go:64] FLAG: --client-ca-file=""
Jul 02 19:11:42.600879 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.596580    2562 flags.go:64] FLAG: --cloud-provider="external"
Jul 02 19:11:42.600879 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.596585    2562 flags.go:64] FLAG: --cluster-dns="[]"
Jul 02 19:11:42.600879 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.596593    2562 flags.go:64] FLAG: --cluster-domain=""
Jul 02 19:11:42.600879 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.596598    2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 02 19:11:42.600879 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.596604    2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 02 19:11:42.600879 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.596609    2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 02 19:11:42.600879 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.596620    2562 flags.go:64] FLAG: --container-log-max-files="5"
Jul 02 19:11:42.601447 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.596625    2562 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 02 19:11:42.601447 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.596630    2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 02 19:11:42.601447 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.596636    2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 02 19:11:42.601447 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.596641    2562 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 02 19:11:42.601447 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.596647    2562 flags.go:64] FLAG: --contention-profiling="false"
Jul 02 19:11:42.601447 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.596650    2562 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 02 19:11:42.601447 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.596654    2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 02 19:11:42.601447 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.596657    2562 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 02 19:11:42.601447 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.596666    2562 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 02 19:11:42.601447 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.596674    2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 02 19:11:42.601447 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.596679    2562 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 02 19:11:42.601447 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.596684    2562 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 02 19:11:42.601447 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.596689    2562 flags.go:64] FLAG: --enable-load-reader="false"
Jul 02 19:11:42.601447 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.596694    2562 flags.go:64] FLAG: --enable-server="true"
Jul 02 19:11:42.601447 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.596698    2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 02 19:11:42.601447 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.596707    2562 flags.go:64] FLAG: --event-burst="100"
Jul 02 19:11:42.601447 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.596718    2562 flags.go:64] FLAG: --event-qps="50"
Jul 02 19:11:42.601447 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.596723    2562 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 02 19:11:42.601447 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597290    2562 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 02 19:11:42.601447 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597410    2562 flags.go:64] FLAG: --eviction-hard=""
Jul 02 19:11:42.601447 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597427    2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 02 19:11:42.601447 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597431    2562 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 02 19:11:42.601447 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597435    2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 02 19:11:42.601447 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597438    2562 flags.go:64] FLAG: --eviction-soft=""
Jul 02 19:11:42.601447 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597441    2562 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 02 19:11:42.602034 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597444    2562 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 02 19:11:42.602034 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597447    2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 02 19:11:42.602034 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597450    2562 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 02 19:11:42.602034 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597453    2562 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 02 19:11:42.602034 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597456    2562 flags.go:64] FLAG: --fail-swap-on="true"
Jul 02 19:11:42.602034 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597459    2562 flags.go:64] FLAG: --feature-gates=""
Jul 02 19:11:42.602034 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597462    2562 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 02 19:11:42.602034 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597465    2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 02 19:11:42.602034 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597468    2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 02 19:11:42.602034 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597471    2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 02 19:11:42.602034 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597474    2562 flags.go:64] FLAG: --healthz-port="10248"
Jul 02 19:11:42.602034 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597477    2562 flags.go:64] FLAG: --help="false"
Jul 02 19:11:42.602034 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597480    2562 flags.go:64] FLAG: --hostname-override="ip-10-0-143-38.ec2.internal"
Jul 02 19:11:42.602034 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597483    2562 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 02 19:11:42.602034 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597486    2562 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 02 19:11:42.602034 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597489    2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 02 19:11:42.602034 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597492    2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 02 19:11:42.602034 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597496    2562 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 02 19:11:42.602034 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597499    2562 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 02 19:11:42.602034 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597502    2562 flags.go:64] FLAG: --image-service-endpoint=""
Jul 02 19:11:42.602034 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597504    2562 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 02 19:11:42.602034 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597507    2562 flags.go:64] FLAG: --kube-api-burst="100"
Jul 02 19:11:42.602034 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597510    2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 02 19:11:42.602684 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597512    2562 flags.go:64] FLAG: --kube-api-qps="50"
Jul 02 19:11:42.602684 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597515    2562 flags.go:64] FLAG: --kube-reserved=""
Jul 02 19:11:42.602684 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597518    2562 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 02 19:11:42.602684 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597521    2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 02 19:11:42.602684 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597523    2562 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 02 19:11:42.602684 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597526    2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 02 19:11:42.602684 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597529    2562 flags.go:64] FLAG: --lock-file=""
Jul 02 19:11:42.602684 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597531    2562 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 02 19:11:42.602684 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597535    2562 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 02 19:11:42.602684 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597537    2562 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 02 19:11:42.602684 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597543    2562 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 02 19:11:42.602684 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597546    2562 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 02 19:11:42.602684 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597548    2562 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 02 19:11:42.602684 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597551    2562 flags.go:64] FLAG: --logging-format="text"
Jul 02 19:11:42.602684 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597554    2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 02 19:11:42.602684 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597557    2562 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 02 19:11:42.602684 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597560    2562 flags.go:64] FLAG: --manifest-url=""
Jul 02 19:11:42.602684 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597563    2562 flags.go:64] FLAG: --manifest-url-header=""
Jul 02 19:11:42.602684 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597567    2562 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 02 19:11:42.602684 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597570    2562 flags.go:64] FLAG: --max-open-files="1000000"
Jul 02 19:11:42.602684 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597574    2562 flags.go:64] FLAG: --max-pods="110"
Jul 02 19:11:42.602684 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597577    2562 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 02 19:11:42.602684 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597580    2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 02 19:11:42.602684 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597583    2562 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 02 19:11:42.602684 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597585    2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 02 19:11:42.603314 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597588    2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 02 19:11:42.603314 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597591    2562 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 02 19:11:42.603314 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597593    2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 02 19:11:42.603314 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597603    2562 flags.go:64] FLAG: --node-status-max-images="50"
Jul 02 19:11:42.603314 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597606    2562 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 02 19:11:42.603314 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597608    2562 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 02 19:11:42.603314 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597611    2562 flags.go:64] FLAG: --pod-cidr=""
Jul 02 19:11:42.603314 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597613    2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 02 19:11:42.603314 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597619    2562 flags.go:64] FLAG: --pod-manifest-path=""
Jul 02 19:11:42.603314 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597622    2562 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 02 19:11:42.603314 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597624    2562 flags.go:64] FLAG: --pods-per-core="0"
Jul 02 19:11:42.603314 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597627    2562 flags.go:64] FLAG: --port="10250"
Jul 02 19:11:42.603314 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597630    2562 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 02 19:11:42.603314 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597632    2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07ea0fa4f9481a9d8"
Jul 02 19:11:42.603314 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597635    2562 flags.go:64] FLAG: --qos-reserved=""
Jul 02 19:11:42.603314 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597638    2562 flags.go:64] FLAG: --read-only-port="10255"
Jul 02 19:11:42.603314 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597641    2562 flags.go:64] FLAG: --register-node="true"
Jul 02 19:11:42.603314 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597643    2562 flags.go:64] FLAG: --register-with-taints=""
Jul 02 19:11:42.603314 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597648    2562 flags.go:64] FLAG: --registry-burst="10"
Jul 02 19:11:42.603314 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597650    2562 flags.go:64] FLAG: --registry-qps="5"
Jul 02 19:11:42.603314 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597654    2562 flags.go:64] FLAG: --reserved-cpus=""
Jul 02 19:11:42.603314 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597656    2562 flags.go:64] FLAG: --reserved-memory=""
Jul 02 19:11:42.603314 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597660    2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 02 19:11:42.603314 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597663    2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 02 19:11:42.603314 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597666    2562 flags.go:64] FLAG: --rotate-certificates="false"
Jul 02 19:11:42.603916 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597669    2562 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 02 19:11:42.603916 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597672    2562 flags.go:64] FLAG: --runonce="false"
Jul 02 19:11:42.603916 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597674    2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 02 19:11:42.603916 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597677    2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 02 19:11:42.603916 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597680    2562 flags.go:64] FLAG: --seccomp-default="false"
Jul 02 19:11:42.603916 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597683    2562 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 02 19:11:42.603916 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597685    2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 02 19:11:42.603916 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597688    2562 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 02 19:11:42.603916 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597690    2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 02 19:11:42.603916 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597693    2562 flags.go:64] FLAG: --storage-driver-password="root"
Jul 02 19:11:42.603916 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597696    2562 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 02 19:11:42.603916 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597698    2562 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 02 19:11:42.603916 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597701    2562 flags.go:64] FLAG: --storage-driver-user="root"
Jul 02 19:11:42.603916 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597704    2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 02 19:11:42.603916 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597707    2562 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 02 19:11:42.603916 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597709    2562 flags.go:64] FLAG: --system-cgroups=""
Jul 02 19:11:42.603916 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597712    2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 02 19:11:42.603916 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597718    2562 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 02 19:11:42.603916 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597720    2562 flags.go:64] FLAG: --tls-cert-file=""
Jul 02 19:11:42.603916 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597723    2562 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 02 19:11:42.603916 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597727    2562 flags.go:64] FLAG: --tls-min-version=""
Jul 02 19:11:42.603916 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597730    2562 flags.go:64] FLAG: --tls-private-key-file=""
Jul 02 19:11:42.603916 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597735    2562 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 02 19:11:42.603916 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597737    2562 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 02 19:11:42.603916 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597740    2562 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 02 19:11:42.604546 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597743    2562 flags.go:64] FLAG: --v="2"
Jul 02 19:11:42.604546 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597747    2562 flags.go:64] FLAG: --version="false"
Jul 02 19:11:42.604546 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597751    2562 flags.go:64] FLAG: --vmodule=""
Jul 02 19:11:42.604546 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597755    2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 02 19:11:42.604546 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.597760    2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 02 19:11:42.604546 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.597875    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 19:11:42.604546 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.597879    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 19:11:42.604546 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.597882    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 19:11:42.604546 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.597886    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 19:11:42.604546 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.597888    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 19:11:42.604546 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.597891    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 19:11:42.604546 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.597894    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 19:11:42.604546 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.597898    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 19:11:42.604546 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.597900    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 19:11:42.604546 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.597903    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 19:11:42.604546 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.597906    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 19:11:42.604546 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.597908    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 19:11:42.604546 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.597911    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 19:11:42.604546 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.597913    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 19:11:42.604546 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.597916    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 19:11:42.604546 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.597919    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 19:11:42.605054 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.597921    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 19:11:42.605054 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.597924    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 19:11:42.605054 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.597926    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 19:11:42.605054 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.597929    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 19:11:42.605054 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.597931    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 19:11:42.605054 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.597934    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 19:11:42.605054 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.597936    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 19:11:42.605054 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.597938    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 19:11:42.605054 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.597942    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 19:11:42.605054 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.597945    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 19:11:42.605054 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.597947    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 19:11:42.605054 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.597950    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 19:11:42.605054 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.597952    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 19:11:42.605054 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.597955    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 19:11:42.605054 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.597957    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 19:11:42.605054 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.597961    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 19:11:42.605054 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.597963    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 19:11:42.605054 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.597966    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 19:11:42.605054 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.597968    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 19:11:42.605054 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.597970    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 19:11:42.605668 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.597973    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 19:11:42.605668 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.597975    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 19:11:42.605668 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.597978    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 19:11:42.605668 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.597980    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 19:11:42.605668 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.597983    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 19:11:42.605668 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.597985    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 19:11:42.605668 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.597988    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 19:11:42.605668 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.597990    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 19:11:42.605668 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.597992    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 19:11:42.605668 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.597995    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 19:11:42.605668 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.597997    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 19:11:42.605668 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.598000    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 19:11:42.605668 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.598002    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 19:11:42.605668 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.598004    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 19:11:42.605668 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.598007    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 19:11:42.605668 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.598009    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 19:11:42.605668 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.598011    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 19:11:42.605668 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.598014    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 19:11:42.605668 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.598016    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 19:11:42.605668 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.598019    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 19:11:42.606213 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.598024    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 19:11:42.606213 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.598027    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 19:11:42.606213 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.598030    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 19:11:42.606213 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.598032    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 19:11:42.606213 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.598035    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 19:11:42.606213 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.598038    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 19:11:42.606213 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.598040    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 19:11:42.606213 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.598044    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 19:11:42.606213 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.598047    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 19:11:42.606213 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.598051    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 19:11:42.606213 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.598055    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 19:11:42.606213 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.598058    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 19:11:42.606213 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.598060    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 19:11:42.606213 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.598062    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 19:11:42.606213 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.598081    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 19:11:42.606213 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.598086    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 19:11:42.606213 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.598090    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 19:11:42.606213 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.598094    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 19:11:42.606213 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.598097    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 19:11:42.606692 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.598099    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 19:11:42.606692 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.598101    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 19:11:42.606692 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.598104    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 19:11:42.606692 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.598106    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 19:11:42.606692 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.598109    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 19:11:42.606692 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.598111    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 19:11:42.606692 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.598114    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 19:11:42.606692 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.598116    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 19:11:42.606692 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.598119    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 19:11:42.606692 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.598121    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 19:11:42.606692 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.598124    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 19:11:42.606692 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.598127    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 19:11:42.606692 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.598129    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 19:11:42.606692 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.598134    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 19:11:42.606692 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.598138    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 19:11:42.606692 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.598140    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 19:11:42.606692 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.598143    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 19:11:42.606692 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.598145    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 19:11:42.606692 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.598148    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 19:11:42.607176 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.598151    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 19:11:42.607176 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.598154    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 19:11:42.607176 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.598157    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 19:11:42.607176 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.598160    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 19:11:42.607176 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.598162    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 19:11:42.607176 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.598798    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 02 19:11:42.607176 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.605329    2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 02 19:11:42.607176 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.605346    2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 02 19:11:42.607176 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.606094    2562 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 02 19:11:42.607176 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.606102    2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 02 19:11:42.607176 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606160    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 19:11:42.607176 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606166    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 19:11:42.607176 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606170    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 19:11:42.607176 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606173    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 19:11:42.607176 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606176    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 19:11:42.607551 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606179    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 19:11:42.607551 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606182    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 19:11:42.607551 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606185    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 19:11:42.607551 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606187    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 19:11:42.607551 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606190    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 19:11:42.607551 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606193    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 19:11:42.607551 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606195    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 19:11:42.607551 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606198    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 19:11:42.607551 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606200    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 19:11:42.607551 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606203    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 19:11:42.607551 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606205    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 19:11:42.607551 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606208    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 19:11:42.607551 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606210    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 19:11:42.607551 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606213    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 19:11:42.607551 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606216    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 19:11:42.607551 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606218    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 19:11:42.607551 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606221    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 19:11:42.607551 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606223    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 19:11:42.607551 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606226    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 19:11:42.607551 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606229    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 19:11:42.608032 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606232    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 19:11:42.608032 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606236    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 19:11:42.608032 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606239    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 19:11:42.608032 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606242    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 19:11:42.608032 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606246    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 19:11:42.608032 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606249    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 19:11:42.608032 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606252    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 19:11:42.608032 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606254    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 19:11:42.608032 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606256    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 19:11:42.608032 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606259    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 19:11:42.608032 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606261    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 19:11:42.608032 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606265    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 19:11:42.608032 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606268    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 19:11:42.608032 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606271    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 19:11:42.608032 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606282    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 19:11:42.608032 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606286    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 19:11:42.608032 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606289    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 19:11:42.608032 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606293    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 19:11:42.608483 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606296    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 19:11:42.608483 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606299    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 19:11:42.608483 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606302    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 19:11:42.608483 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606305    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 19:11:42.608483 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606308    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 19:11:42.608483 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606310    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 19:11:42.608483 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606313    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 19:11:42.608483 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606316    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 19:11:42.608483 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606318    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 19:11:42.608483 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606321    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 19:11:42.608483 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606323    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 19:11:42.608483 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606325    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 19:11:42.608483 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606328    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 19:11:42.608483 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606330    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 19:11:42.608483 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606333    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 19:11:42.608483 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606335    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 19:11:42.608483 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606339    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 19:11:42.608483 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606341    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 19:11:42.608483 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606345    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 19:11:42.608483 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606349    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 19:11:42.608964 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606351    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 19:11:42.608964 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606353    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 19:11:42.608964 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606356    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 19:11:42.608964 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606358    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 19:11:42.608964 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606361    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 19:11:42.608964 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606363    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 19:11:42.608964 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606365    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 19:11:42.608964 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606368    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 19:11:42.608964 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606370    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 19:11:42.608964 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606373    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 19:11:42.608964 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606375    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 19:11:42.608964 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606377    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 19:11:42.608964 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606380    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 19:11:42.608964 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606383    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 19:11:42.608964 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606385    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 19:11:42.608964 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606387    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 19:11:42.608964 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606389    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 19:11:42.608964 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606392    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 19:11:42.608964 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606394    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 19:11:42.608964 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606397    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 19:11:42.609439 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606399    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 19:11:42.609439 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606401    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 19:11:42.609439 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606405    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 19:11:42.609439 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606408    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 19:11:42.609439 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606410    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 19:11:42.609439 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606413    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 19:11:42.609439 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606415    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 19:11:42.609439 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606417    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 19:11:42.609439 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606420    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 19:11:42.609439 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606422    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 19:11:42.609439 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606426    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 19:11:42.609439 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606428    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 19:11:42.609439 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606432    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 19:11:42.609439 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606434    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 19:11:42.609439 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606437    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 19:11:42.609439 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606439    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 19:11:42.609824 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.606444    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 02 19:11:42.609824 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606555    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 19:11:42.609824 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606561    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 19:11:42.609824 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606564    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 19:11:42.609824 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606567    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 19:11:42.609824 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606569    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 19:11:42.609824 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606572    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 19:11:42.609824 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606575    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 19:11:42.609824 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606578    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 19:11:42.609824 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606580    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 19:11:42.609824 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606583    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 19:11:42.609824 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606586    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 19:11:42.609824 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606588    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 19:11:42.609824 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606591    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 19:11:42.610192 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606594    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 19:11:42.610192 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606598    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 19:11:42.610192 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606600    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 19:11:42.610192 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606603    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 19:11:42.610192 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606605    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 19:11:42.610192 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606608    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 19:11:42.610192 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606610    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 19:11:42.610192 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606613    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 19:11:42.610192 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606615    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 19:11:42.610192 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606617    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 19:11:42.610192 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606620    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 19:11:42.610192 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606622    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 19:11:42.610192 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606625    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 19:11:42.610192 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606627    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 19:11:42.610192 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606630    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 19:11:42.610192 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606633    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 19:11:42.610192 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606636    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 19:11:42.610192 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606638    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 19:11:42.610192 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606640    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 19:11:42.610652 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606643    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 19:11:42.610652 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606645    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 19:11:42.610652 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606647    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 19:11:42.610652 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606650    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 19:11:42.610652 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606652    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 19:11:42.610652 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606655    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 19:11:42.610652 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606657    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 19:11:42.610652 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606660    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 19:11:42.610652 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606662    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 19:11:42.610652 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606664    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 19:11:42.610652 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606667    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 19:11:42.610652 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606670    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 19:11:42.610652 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606672    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 19:11:42.610652 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606674    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 19:11:42.610652 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606677    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 19:11:42.610652 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606679    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 19:11:42.610652 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606681    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 19:11:42.610652 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606684    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 19:11:42.610652 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606686    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 19:11:42.610652 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606689    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 19:11:42.611168 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606691    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 19:11:42.611168 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606694    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 19:11:42.611168 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606696    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 19:11:42.611168 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606699    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 19:11:42.611168 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606701    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 19:11:42.611168 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606704    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 19:11:42.611168 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606707    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 19:11:42.611168 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606709    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 19:11:42.611168 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606712    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 19:11:42.611168 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606715    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 19:11:42.611168 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606717    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 19:11:42.611168 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606719    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 19:11:42.611168 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606722    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 19:11:42.611168 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606724    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 19:11:42.611168 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606726    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 19:11:42.611168 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606729    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 19:11:42.611168 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606731    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 19:11:42.611168 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606734    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 19:11:42.611168 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606736    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 19:11:42.611168 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606738    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 19:11:42.611650 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606741    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 19:11:42.611650 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606743    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 19:11:42.611650 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606745    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 19:11:42.611650 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606748    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 19:11:42.611650 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606750    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 19:11:42.611650 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606752    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 19:11:42.611650 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606755    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 19:11:42.611650 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606757    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 19:11:42.611650 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606760    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 19:11:42.611650 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606762    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 19:11:42.611650 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606764    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 19:11:42.611650 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606766    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 19:11:42.611650 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606769    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 19:11:42.611650 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606772    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 19:11:42.611650 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606774    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 19:11:42.611650 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606776    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 19:11:42.611650 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606779    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 19:11:42.611650 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606781    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 19:11:42.611650 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606784    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 19:11:42.611650 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606786    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 19:11:42.612191 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606789    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 19:11:42.612191 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606791    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 19:11:42.612191 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606795    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 19:11:42.612191 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606799    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 19:11:42.612191 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606801    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 19:11:42.612191 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606804    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 19:11:42.612191 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:42.606807    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 19:11:42.612191 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.606811    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 02 19:11:42.612191 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.606925    2562 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 02 19:11:42.612191 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.608880    2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 02 19:11:42.612191 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.610046    2562 server.go:1019] "Starting client certificate rotation"
Jul 02 19:11:42.612191 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.610167    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 02 19:11:42.612191 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.610208    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 02 19:11:42.612523 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.612483    2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 02 19:11:42.616266 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.616251    2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 02 19:11:42.627982 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.627933    2562 log.go:25] "Validated CRI v1 runtime API"
Jul 02 19:11:42.630295 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.630271    2562 log.go:25] "Validated CRI v1 image API"
Jul 02 19:11:42.630955 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.630937    2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 02 19:11:42.633030 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.633005    2562 fs.go:135] Filesystem UUIDs: map[073850d1-99c7-483b-ade0-682265c08b44:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 e3d79b93-a447-44ce-a9b8-3008af1c4e43:/dev/nvme0n1p3]
Jul 02 19:11:42.633118 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.633029    2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 02 19:11:42.637615 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.637511    2562 manager.go:216] Machine: {Timestamp:2026-07-02 19:11:42.637025405 +0000 UTC m=+0.281939865 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3109244 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26eb87dad8776d866a594edac3afbe SystemUUID:ec26eb87-dad8-776d-866a-594edac3afbe BootID:5a1a4752-149c-440f-8961-6e1771f3496e Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:2f:80:bc:a3:23 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:2f:80:bc:a3:23 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ea:4c:e7:3c:db:88 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 02 19:11:42.637615 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.637613    2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 02 19:11:42.637726 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.637685    2562 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 02 19:11:42.640344 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.640319    2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 02 19:11:42.640476 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.640345    2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-38.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 02 19:11:42.640958 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.640949    2562 topology_manager.go:138] "Creating topology manager with none policy"
Jul 02 19:11:42.640987 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.640961    2562 container_manager_linux.go:309] "Creating device plugin manager"
Jul 02 19:11:42.640987 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.640968    2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 02 19:11:42.641593 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.641582    2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 02 19:11:42.642666 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.642649    2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 02 19:11:42.642813 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.642802    2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 02 19:11:42.646524 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.646513    2562 state_mem.go:36] "Initialized new in-memory state store"
Jul 02 19:11:42.646642 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.646633    2562 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 02 19:11:42.646672 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.646663    2562 kubelet.go:486] "Attempting to sync node with API server"
Jul 02 19:11:42.646698 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.646673    2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 02 19:11:42.646698 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.646690    2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 02 19:11:42.646698 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.646699    2562 kubelet.go:398] "Adding apiserver pod source"
Jul 02 19:11:42.646776 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.646708    2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 02 19:11:42.647137 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.647125    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 02 19:11:42.647177 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.647150    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 02 19:11:42.649082 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.649053    2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 02 19:11:42.650791 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.650777    2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 02 19:11:42.650850 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.650807    2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 02 19:11:42.651927 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.651914    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 02 19:11:42.651965 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.651935    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 02 19:11:42.651965 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.651942    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 02 19:11:42.651965 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.651947    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 02 19:11:42.651965 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.651961    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 02 19:11:42.652091 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.651966    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 02 19:11:42.652091 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.651978    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 02 19:11:42.652091 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.651987    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 02 19:11:42.652091 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.651995    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 02 19:11:42.652091 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.652001    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 02 19:11:42.652091 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.652013    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 02 19:11:42.652091 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.652018    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 02 19:11:42.652091 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.652044    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 02 19:11:42.652091 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.652053    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 02 19:11:42.655833 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.655818    2562 server.go:1268] "Started kubelet"
Jul 02 19:11:42.655921 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.655883    2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 02 19:11:42.656474 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.656200    2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-38.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 02 19:11:42.656474 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.656180    2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 02 19:11:42.656474 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.656325    2562 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 02 19:11:42.656877 ip-10-0-143-38 systemd[1]: Started Kubernetes Kubelet.
Jul 02 19:11:42.657684 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:42.657658    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 02 19:11:42.657763 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:42.657694    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-38.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 02 19:11:42.657916 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.657842    2562 server.go:310] "Adding debug handlers to kubelet server"
Jul 02 19:11:42.657916 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.657906    2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 02 19:11:42.661300 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:42.661279    2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 02 19:11:42.663531 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.663517    2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 02 19:11:42.663531 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.663528    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 02 19:11:42.663770 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:42.663738    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-38.ec2.internal\" not found"
Jul 02 19:11:42.664422 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.664265    2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 02 19:11:42.664510 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.664271    2562 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 02 19:11:42.664561 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.664519    2562 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 02 19:11:42.665997 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.665978    2562 factory.go:55] Registering systemd factory
Jul 02 19:11:42.665997 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.665999    2562 factory.go:223] Registration of the systemd container factory successfully
Jul 02 19:11:42.667306 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.667289    2562 reconstruct.go:97] "Volume reconstruction finished"
Jul 02 19:11:42.667306 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.667306    2562 reconciler.go:29] "Reconciler: start to sync state"
Jul 02 19:11:42.667436 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.667396    2562 factory.go:153] Registering CRI-O factory
Jul 02 19:11:42.667436 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.667414    2562 factory.go:223] Registration of the crio container factory successfully
Jul 02 19:11:42.667516 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.667468    2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 02 19:11:42.667559 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.667523    2562 factory.go:103] Registering Raw factory
Jul 02 19:11:42.667643 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.667566    2562 manager.go:1196] Started watching for new ooms in manager
Jul 02 19:11:42.668423 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.668408    2562 manager.go:349] Starting recovery of all containers
Jul 02 19:11:42.668527 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:42.668482    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 02 19:11:42.668527 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:42.668454    2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-38.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 02 19:11:42.669153 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:42.667288    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-38.ec2.internal.18be8eca736455ca  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-38.ec2.internal,UID:ip-10-0-143-38.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-38.ec2.internal,},FirstTimestamp:2026-07-02 19:11:42.65578849 +0000 UTC m=+0.300702858,LastTimestamp:2026-07-02 19:11:42.65578849 +0000 UTC m=+0.300702858,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-38.ec2.internal,}"
Jul 02 19:11:42.679664 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.679556    2562 manager.go:354] Recovery completed
Jul 02 19:11:42.681966 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.681949    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6mmdh"
Jul 02 19:11:42.684000 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.683989    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 19:11:42.687412 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.687394    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-38.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 19:11:42.687508 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.687428    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-38.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 19:11:42.687508 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.687443    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-38.ec2.internal" event="NodeHasSufficientPID"
Jul 02 19:11:42.688001 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.687980    2562 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 02 19:11:42.688001 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.687998    2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 02 19:11:42.688001 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.688001    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 19:11:42.688159 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.688014    2562 state_mem.go:36] "Initialized new in-memory state store"
Jul 02 19:11:42.688730 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.688716    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-38.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 19:11:42.688786 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.688741    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-38.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 19:11:42.688786 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.688751    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-38.ec2.internal" event="NodeHasSufficientPID"
Jul 02 19:11:42.690005 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:42.689936    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-38.ec2.internal.18be8eca7546db33  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-38.ec2.internal,UID:ip-10-0-143-38.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-38.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-38.ec2.internal,},FirstTimestamp:2026-07-02 19:11:42.687410995 +0000 UTC m=+0.332325349,LastTimestamp:2026-07-02 19:11:42.687410995 +0000 UTC m=+0.332325349,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-38.ec2.internal,}"
Jul 02 19:11:42.690204 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.690193    2562 policy_none.go:49] "None policy: Start"
Jul 02 19:11:42.690240 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.690209    2562 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 02 19:11:42.690240 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.690219    2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 02 19:11:42.692255 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.692244    2562 policy_none.go:47] "Start"
Jul 02 19:11:42.695545 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.695529    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6mmdh"
Jul 02 19:11:42.699849 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:42.699755    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-38.ec2.internal.18be8eca75473835  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-38.ec2.internal,UID:ip-10-0-143-38.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-143-38.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-143-38.ec2.internal,},FirstTimestamp:2026-07-02 19:11:42.687434805 +0000 UTC m=+0.332349148,LastTimestamp:2026-07-02 19:11:42.687434805 +0000 UTC m=+0.332349148,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-38.ec2.internal,}"
Jul 02 19:11:42.726743 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.726723    2562 manager.go:337] "Starting Device Plugin manager"
Jul 02 19:11:42.726866 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:42.726760    2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 02 19:11:42.726866 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.726774    2562 server.go:87] "Starting device plugin registration server"
Jul 02 19:11:42.727134 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.727118    2562 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 02 19:11:42.727202 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.727140    2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 02 19:11:42.727247 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.727229    2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 02 19:11:42.727328 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.727310    2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 02 19:11:42.727328 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.727325    2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 02 19:11:42.727911 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:42.727891    2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 02 19:11:42.727979 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:42.727947    2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-38.ec2.internal\" not found"
Jul 02 19:11:42.827428 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.827395    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 19:11:42.829527 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.828510    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-38.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 19:11:42.829527 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.828538    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-38.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 19:11:42.829527 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.828548    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-38.ec2.internal" event="NodeHasSufficientPID"
Jul 02 19:11:42.829527 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.828573    2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-38.ec2.internal"
Jul 02 19:11:42.829527 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.829376    2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 02 19:11:42.830677 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.830663    2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 02 19:11:42.830736 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.830697    2562 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 02 19:11:42.830736 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.830718    2562 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 02 19:11:42.830803 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:42.830746    2562 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 02 19:11:42.832914 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.832894    2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 19:11:42.841677 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.841621    2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-38.ec2.internal"
Jul 02 19:11:42.841677 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:42.841648    2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-38.ec2.internal\": node \"ip-10-0-143-38.ec2.internal\" not found"
Jul 02 19:11:42.877519 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:42.877491    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-38.ec2.internal\" not found"
Jul 02 19:11:42.932262 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.931683    2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-38.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-38.ec2.internal"]
Jul 02 19:11:42.932390 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.932311    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 19:11:42.933253 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.933237    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-38.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 19:11:42.933355 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.933267    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-38.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 19:11:42.933355 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.933277    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-38.ec2.internal" event="NodeHasSufficientPID"
Jul 02 19:11:42.935338 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.935326    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 19:11:42.935465 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.935451    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-38.ec2.internal"
Jul 02 19:11:42.935524 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.935487    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 19:11:42.936022 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.936005    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-38.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 19:11:42.936112 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.936036    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-38.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 19:11:42.936112 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.936046    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-38.ec2.internal" event="NodeHasSufficientPID"
Jul 02 19:11:42.936112 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.936010    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-38.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 19:11:42.936112 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.936108    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-38.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 19:11:42.936308 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.936122    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-38.ec2.internal" event="NodeHasSufficientPID"
Jul 02 19:11:42.938196 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.938181    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-38.ec2.internal"
Jul 02 19:11:42.938293 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.938212    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 19:11:42.938953 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.938930    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-38.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 19:11:42.939014 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.938961    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-38.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 19:11:42.939014 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.938972    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-38.ec2.internal" event="NodeHasSufficientPID"
Jul 02 19:11:42.952603 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:42.952587    2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-38.ec2.internal\" not found" node="ip-10-0-143-38.ec2.internal"
Jul 02 19:11:42.956978 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:42.956964    2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-38.ec2.internal\" not found" node="ip-10-0-143-38.ec2.internal"
Jul 02 19:11:42.968293 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.968263    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fccf9d5a8864f519f8e3c7a4a069b572-config\") pod \"kube-apiserver-proxy-ip-10-0-143-38.ec2.internal\" (UID: \"fccf9d5a8864f519f8e3c7a4a069b572\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-38.ec2.internal"
Jul 02 19:11:42.968367 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.968297    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6052bdddce80b6bdc62311715e9a4818-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-38.ec2.internal\" (UID: \"6052bdddce80b6bdc62311715e9a4818\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-38.ec2.internal"
Jul 02 19:11:42.968367 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:42.968315    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6052bdddce80b6bdc62311715e9a4818-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-38.ec2.internal\" (UID: \"6052bdddce80b6bdc62311715e9a4818\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-38.ec2.internal"
Jul 02 19:11:42.977838 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:42.977816    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-38.ec2.internal\" not found"
Jul 02 19:11:43.068611 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:43.068580    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fccf9d5a8864f519f8e3c7a4a069b572-config\") pod \"kube-apiserver-proxy-ip-10-0-143-38.ec2.internal\" (UID: \"fccf9d5a8864f519f8e3c7a4a069b572\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-38.ec2.internal"
Jul 02 19:11:43.068611 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:43.068615    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6052bdddce80b6bdc62311715e9a4818-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-38.ec2.internal\" (UID: \"6052bdddce80b6bdc62311715e9a4818\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-38.ec2.internal"
Jul 02 19:11:43.068817 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:43.068637    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6052bdddce80b6bdc62311715e9a4818-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-38.ec2.internal\" (UID: \"6052bdddce80b6bdc62311715e9a4818\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-38.ec2.internal"
Jul 02 19:11:43.068817 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:43.068688    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6052bdddce80b6bdc62311715e9a4818-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-38.ec2.internal\" (UID: \"6052bdddce80b6bdc62311715e9a4818\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-38.ec2.internal"
Jul 02 19:11:43.068817 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:43.068691    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6052bdddce80b6bdc62311715e9a4818-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-38.ec2.internal\" (UID: \"6052bdddce80b6bdc62311715e9a4818\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-38.ec2.internal"
Jul 02 19:11:43.068817 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:43.068748    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fccf9d5a8864f519f8e3c7a4a069b572-config\") pod \"kube-apiserver-proxy-ip-10-0-143-38.ec2.internal\" (UID: \"fccf9d5a8864f519f8e3c7a4a069b572\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-38.ec2.internal"
Jul 02 19:11:43.078587 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:43.078567    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-38.ec2.internal\" not found"
Jul 02 19:11:43.179488 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:43.179415    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-38.ec2.internal\" not found"
Jul 02 19:11:43.255628 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:43.255601    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-38.ec2.internal"
Jul 02 19:11:43.260299 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:43.260155    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-38.ec2.internal"
Jul 02 19:11:43.279944 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:43.279913    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-38.ec2.internal\" not found"
Jul 02 19:11:43.380541 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:43.380504    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-38.ec2.internal\" not found"
Jul 02 19:11:43.481186 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:43.481111    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-38.ec2.internal\" not found"
Jul 02 19:11:43.581750 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:43.581723    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-38.ec2.internal\" not found"
Jul 02 19:11:43.609912 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:43.609884    2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 02 19:11:43.610451 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:43.610089    2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 02 19:11:43.682214 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:43.682171    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-38.ec2.internal\" not found"
Jul 02 19:11:43.699023 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:43.698986    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-01 19:06:43 +0000 UTC" deadline="2027-12-08 15:06:13.090872964 +0000 UTC"
Jul 02 19:11:43.699023 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:43.699016    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12571h54m29.391860658s"
Jul 02 19:11:43.714122 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:43.714105    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 19:11:43.715447 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:43.715431    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-38.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 19:11:43.715547 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:43.715461    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-38.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 19:11:43.715547 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:43.715473    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-38.ec2.internal" event="NodeHasSufficientPID"
Jul 02 19:11:43.782922 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:43.782855    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-38.ec2.internal\" not found"
Jul 02 19:11:43.790677 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:43.790655    2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 19:11:45.120444 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:45.120416    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfccf9d5a8864f519f8e3c7a4a069b572.slice/crio-3e85cf1454078d87de3b2405f3075de9baaeb647a1da2b4fcaf1bbcbdb68b655 WatchSource:0}: Error finding container 3e85cf1454078d87de3b2405f3075de9baaeb647a1da2b4fcaf1bbcbdb68b655: Status 404 returned error can't find the container with id 3e85cf1454078d87de3b2405f3075de9baaeb647a1da2b4fcaf1bbcbdb68b655
Jul 02 19:11:45.121448 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:45.121420    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6052bdddce80b6bdc62311715e9a4818.slice/crio-1886fe40da9ec496a3a92cf05f349ce7db98bfd51974fb2b601fc79702420215 WatchSource:0}: Error finding container 1886fe40da9ec496a3a92cf05f349ce7db98bfd51974fb2b601fc79702420215: Status 404 returned error can't find the container with id 1886fe40da9ec496a3a92cf05f349ce7db98bfd51974fb2b601fc79702420215
Jul 02 19:11:45.126486 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.126470    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 19:11:45.146511 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.146492    2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-38.ec2.internal"
Jul 02 19:11:45.159881 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.159859    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 02 19:11:45.161292 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.161279    2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-38.ec2.internal"
Jul 02 19:11:45.174698 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.174680    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 02 19:11:45.184367 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.184350    2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 19:11:45.238144 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.238123    2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 19:11:45.727614 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.727584    2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 19:11:45.928470 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.928441    2562 apiserver.go:52] "Watching apiserver"
Jul 02 19:11:45.936958 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.936933    2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 02 19:11:45.938035 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.938013    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-4pjcm","kube-system/kube-apiserver-proxy-ip-10-0-143-38.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqwll","openshift-cluster-node-tuning-operator/tuned-82xkb","openshift-image-registry/node-ca-6rmk4","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-38.ec2.internal","openshift-network-diagnostics/network-check-target-blvcs","openshift-network-operator/iptables-alerter-rg9f6","kube-system/global-pull-secret-syncer-58jxn","openshift-dns/node-resolver-9mhh9","openshift-multus/multus-additional-cni-plugins-qw5fs","openshift-multus/multus-pxrmb","openshift-multus/network-metrics-daemon-2b9th","openshift-ovn-kubernetes/ovnkube-node-lgt7t"]
Jul 02 19:11:45.940482 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.940462    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-blvcs"
Jul 02 19:11:45.940591 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:45.940553    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-blvcs" podUID="ef227ade-6225-4022-8c2a-133c62174fa0"
Jul 02 19:11:45.942688 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.942665    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2b9th"
Jul 02 19:11:45.942764 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:45.942746    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2b9th" podUID="d0e53e82-59ae-4430-9470-2648eb4eafb4"
Jul 02 19:11:45.944987 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.944778    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 02 19:11:45.944987 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.944817    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqwll"
Jul 02 19:11:45.949292 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.948240    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-82xkb"
Jul 02 19:11:45.949292 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.948672    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4cmmz\""
Jul 02 19:11:45.949292 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.948699    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 02 19:11:45.949292 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.949020    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 02 19:11:45.949292 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.949167    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 02 19:11:45.950186 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.950166    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6rmk4"
Jul 02 19:11:45.950874 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.950851    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 02 19:11:45.951425 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.951409    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 02 19:11:45.951681 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.951666    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-6kpqz\""
Jul 02 19:11:45.952615 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.952593    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 02 19:11:45.952763 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.952728    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 02 19:11:45.952831 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.952811    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-rj4z5\""
Jul 02 19:11:45.952889 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.952858    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 02 19:11:45.953569 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.953550    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lgt7t"
Jul 02 19:11:45.956006 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.955676    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58jxn"
Jul 02 19:11:45.956006 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:45.955738    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58jxn" podUID="b4bcbbc3-c3ea-4e9d-ba69-9312e20b21cd"
Jul 02 19:11:45.956818 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.956533    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 02 19:11:45.956818 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.956546    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 02 19:11:45.956818 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.956552    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 02 19:11:45.956818 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.956618    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 02 19:11:45.956818 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.956626    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 02 19:11:45.956818 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.956538    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 02 19:11:45.957306 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.956864    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-pk76s\""
Jul 02 19:11:45.958042 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.958023    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtxcv\" (UniqueName: \"kubernetes.io/projected/9ff33bed-9142-4ce3-8eb8-47ad0e344070-kube-api-access-mtxcv\") pod \"aws-ebs-csi-driver-node-qqwll\" (UID: \"9ff33bed-9142-4ce3-8eb8-47ad0e344070\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqwll"
Jul 02 19:11:45.958133 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.958058    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ce0f2b6b-90ee-4038-9ed6-6777dd9365eb-etc-modprobe-d\") pod \"tuned-82xkb\" (UID: \"ce0f2b6b-90ee-4038-9ed6-6777dd9365eb\") " pod="openshift-cluster-node-tuning-operator/tuned-82xkb"
Jul 02 19:11:45.958133 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.958082    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ce0f2b6b-90ee-4038-9ed6-6777dd9365eb-etc-kubernetes\") pod \"tuned-82xkb\" (UID: \"ce0f2b6b-90ee-4038-9ed6-6777dd9365eb\") " pod="openshift-cluster-node-tuning-operator/tuned-82xkb"
Jul 02 19:11:45.958133 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.958107    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0e53e82-59ae-4430-9470-2648eb4eafb4-metrics-certs\") pod \"network-metrics-daemon-2b9th\" (UID: \"d0e53e82-59ae-4430-9470-2648eb4eafb4\") " pod="openshift-multus/network-metrics-daemon-2b9th"
Jul 02 19:11:45.958133 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.958130    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9ff33bed-9142-4ce3-8eb8-47ad0e344070-etc-selinux\") pod \"aws-ebs-csi-driver-node-qqwll\" (UID: \"9ff33bed-9142-4ce3-8eb8-47ad0e344070\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqwll"
Jul 02 19:11:45.958327 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.958152    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ce0f2b6b-90ee-4038-9ed6-6777dd9365eb-etc-sysconfig\") pod \"tuned-82xkb\" (UID: \"ce0f2b6b-90ee-4038-9ed6-6777dd9365eb\") " pod="openshift-cluster-node-tuning-operator/tuned-82xkb"
Jul 02 19:11:45.958327 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.958176    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ce0f2b6b-90ee-4038-9ed6-6777dd9365eb-sys\") pod \"tuned-82xkb\" (UID: \"ce0f2b6b-90ee-4038-9ed6-6777dd9365eb\") " pod="openshift-cluster-node-tuning-operator/tuned-82xkb"
Jul 02 19:11:45.958327 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.958199    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ce0f2b6b-90ee-4038-9ed6-6777dd9365eb-var-lib-kubelet\") pod \"tuned-82xkb\" (UID: \"ce0f2b6b-90ee-4038-9ed6-6777dd9365eb\") " pod="openshift-cluster-node-tuning-operator/tuned-82xkb"
Jul 02 19:11:45.958327 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.958237    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ce0f2b6b-90ee-4038-9ed6-6777dd9365eb-etc-tuned\") pod \"tuned-82xkb\" (UID: \"ce0f2b6b-90ee-4038-9ed6-6777dd9365eb\") " pod="openshift-cluster-node-tuning-operator/tuned-82xkb"
Jul 02 19:11:45.958327 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.958260    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtqzs\" (UniqueName: \"kubernetes.io/projected/d0e53e82-59ae-4430-9470-2648eb4eafb4-kube-api-access-wtqzs\") pod \"network-metrics-daemon-2b9th\" (UID: \"d0e53e82-59ae-4430-9470-2648eb4eafb4\") " pod="openshift-multus/network-metrics-daemon-2b9th"
Jul 02 19:11:45.958327 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.958283    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9ff33bed-9142-4ce3-8eb8-47ad0e344070-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qqwll\" (UID: \"9ff33bed-9142-4ce3-8eb8-47ad0e344070\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqwll"
Jul 02 19:11:45.958588 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.958363    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4pjcm"
Jul 02 19:11:45.959249 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.959191    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9ff33bed-9142-4ce3-8eb8-47ad0e344070-registration-dir\") pod \"aws-ebs-csi-driver-node-qqwll\" (UID: \"9ff33bed-9142-4ce3-8eb8-47ad0e344070\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqwll"
Jul 02 19:11:45.959249 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.959229    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9ff33bed-9142-4ce3-8eb8-47ad0e344070-device-dir\") pod \"aws-ebs-csi-driver-node-qqwll\" (UID: \"9ff33bed-9142-4ce3-8eb8-47ad0e344070\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqwll"
Jul 02 19:11:45.959398 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.959252    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ce0f2b6b-90ee-4038-9ed6-6777dd9365eb-host\") pod \"tuned-82xkb\" (UID: \"ce0f2b6b-90ee-4038-9ed6-6777dd9365eb\") " pod="openshift-cluster-node-tuning-operator/tuned-82xkb"
Jul 02 19:11:45.959398 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.959275    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ce0f2b6b-90ee-4038-9ed6-6777dd9365eb-etc-sysctl-d\") pod \"tuned-82xkb\" (UID: \"ce0f2b6b-90ee-4038-9ed6-6777dd9365eb\") " pod="openshift-cluster-node-tuning-operator/tuned-82xkb"
Jul 02 19:11:45.959398 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.959298    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ce0f2b6b-90ee-4038-9ed6-6777dd9365eb-etc-sysctl-conf\") pod \"tuned-82xkb\" (UID: \"ce0f2b6b-90ee-4038-9ed6-6777dd9365eb\") " pod="openshift-cluster-node-tuning-operator/tuned-82xkb"
Jul 02 19:11:45.959398 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.959319    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ce0f2b6b-90ee-4038-9ed6-6777dd9365eb-run\") pod \"tuned-82xkb\" (UID: \"ce0f2b6b-90ee-4038-9ed6-6777dd9365eb\") " pod="openshift-cluster-node-tuning-operator/tuned-82xkb"
Jul 02 19:11:45.959398 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.959340    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rxnp\" (UniqueName: \"kubernetes.io/projected/ce0f2b6b-90ee-4038-9ed6-6777dd9365eb-kube-api-access-5rxnp\") pod \"tuned-82xkb\" (UID: \"ce0f2b6b-90ee-4038-9ed6-6777dd9365eb\") " pod="openshift-cluster-node-tuning-operator/tuned-82xkb"
Jul 02 19:11:45.959398 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.959363    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnh4p\" (UniqueName: \"kubernetes.io/projected/ef227ade-6225-4022-8c2a-133c62174fa0-kube-api-access-hnh4p\") pod \"network-check-target-blvcs\" (UID: \"ef227ade-6225-4022-8c2a-133c62174fa0\") " pod="openshift-network-diagnostics/network-check-target-blvcs"
Jul 02 19:11:45.959398 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.959386    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ce0f2b6b-90ee-4038-9ed6-6777dd9365eb-etc-systemd\") pod \"tuned-82xkb\" (UID: \"ce0f2b6b-90ee-4038-9ed6-6777dd9365eb\") " pod="openshift-cluster-node-tuning-operator/tuned-82xkb"
Jul 02 19:11:45.959720 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.959417    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ce0f2b6b-90ee-4038-9ed6-6777dd9365eb-lib-modules\") pod \"tuned-82xkb\" (UID: \"ce0f2b6b-90ee-4038-9ed6-6777dd9365eb\") " pod="openshift-cluster-node-tuning-operator/tuned-82xkb"
Jul 02 19:11:45.959720 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.959442    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ce0f2b6b-90ee-4038-9ed6-6777dd9365eb-tmp\") pod \"tuned-82xkb\" (UID: \"ce0f2b6b-90ee-4038-9ed6-6777dd9365eb\") " pod="openshift-cluster-node-tuning-operator/tuned-82xkb"
Jul 02 19:11:45.959720 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.959464    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9ff33bed-9142-4ce3-8eb8-47ad0e344070-socket-dir\") pod \"aws-ebs-csi-driver-node-qqwll\" (UID: \"9ff33bed-9142-4ce3-8eb8-47ad0e344070\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqwll"
Jul 02 19:11:45.959720 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.959487    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9ff33bed-9142-4ce3-8eb8-47ad0e344070-sys-fs\") pod \"aws-ebs-csi-driver-node-qqwll\" (UID: \"9ff33bed-9142-4ce3-8eb8-47ad0e344070\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqwll"
Jul 02 19:11:45.960796 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.960776    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 02 19:11:45.961084 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.961066    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rg9f6"
Jul 02 19:11:45.961756 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.961739    2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 02 19:11:45.961756 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.961745    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-chpbq\""
Jul 02 19:11:45.961904 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.961819    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 02 19:11:45.963506 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.963480    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9mhh9"
Jul 02 19:11:45.964606 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.964565    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 02 19:11:45.964682 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.964622    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 02 19:11:45.964748 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.964580    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 02 19:11:45.964869 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.964855    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-fj26f\""
Jul 02 19:11:45.966079 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.966062    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 02 19:11:45.966214 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.966123    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-bsvxx\""
Jul 02 19:11:45.966319 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.966154    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 02 19:11:45.967027 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.966617    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qw5fs"
Jul 02 19:11:45.969468 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.969449    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pxrmb"
Jul 02 19:11:45.969468 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.969460    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 02 19:11:45.969739 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.969715    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 02 19:11:45.970176 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.970160    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-bpt8l\""
Jul 02 19:11:45.970294 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.970260    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 02 19:11:45.970504 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.970353    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 02 19:11:45.970504 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.970261    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 02 19:11:45.972141 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.972123    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 02 19:11:45.972210 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.972168    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rm88z\""
Jul 02 19:11:45.981198 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.981124    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-rhmcw"
Jul 02 19:11:45.989060 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:45.989040    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-rhmcw"
Jul 02 19:11:46.046966 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.046938    2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 02 19:11:46.060012 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.059984    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/24385f8e-c947-4df0-bd2a-10f2562a4a7b-host-run-k8s-cni-cncf-io\") pod \"multus-pxrmb\" (UID: \"24385f8e-c947-4df0-bd2a-10f2562a4a7b\") " pod="openshift-multus/multus-pxrmb"
Jul 02 19:11:46.060151 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.060025    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/24385f8e-c947-4df0-bd2a-10f2562a4a7b-host-var-lib-kubelet\") pod \"multus-pxrmb\" (UID: \"24385f8e-c947-4df0-bd2a-10f2562a4a7b\") " pod="openshift-multus/multus-pxrmb"
Jul 02 19:11:46.060151 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.060057    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ce0f2b6b-90ee-4038-9ed6-6777dd9365eb-etc-kubernetes\") pod \"tuned-82xkb\" (UID: \"ce0f2b6b-90ee-4038-9ed6-6777dd9365eb\") " pod="openshift-cluster-node-tuning-operator/tuned-82xkb"
Jul 02 19:11:46.060151 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.060085    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0e53e82-59ae-4430-9470-2648eb4eafb4-metrics-certs\") pod \"network-metrics-daemon-2b9th\" (UID: \"d0e53e82-59ae-4430-9470-2648eb4eafb4\") " pod="openshift-multus/network-metrics-daemon-2b9th"
Jul 02 19:11:46.060151 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.060114    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b4bcbbc3-c3ea-4e9d-ba69-9312e20b21cd-dbus\") pod \"global-pull-secret-syncer-58jxn\" (UID: \"b4bcbbc3-c3ea-4e9d-ba69-9312e20b21cd\") " pod="kube-system/global-pull-secret-syncer-58jxn"
Jul 02 19:11:46.060151 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.060138    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d7c935ff-227d-4302-879d-c1a1f01755a9-hosts-file\") pod \"node-resolver-9mhh9\" (UID: \"d7c935ff-227d-4302-879d-c1a1f01755a9\") " pod="openshift-dns/node-resolver-9mhh9"
Jul 02 19:11:46.060382 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.060162    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtqzs\" (UniqueName: \"kubernetes.io/projected/d0e53e82-59ae-4430-9470-2648eb4eafb4-kube-api-access-wtqzs\") pod \"network-metrics-daemon-2b9th\" (UID: \"d0e53e82-59ae-4430-9470-2648eb4eafb4\") " pod="openshift-multus/network-metrics-daemon-2b9th"
Jul 02 19:11:46.060382 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.060205    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/21bc43fc-481b-4b52-a8e3-5ae352981994-host\") pod \"node-ca-6rmk4\" (UID: \"21bc43fc-481b-4b52-a8e3-5ae352981994\") " pod="openshift-image-registry/node-ca-6rmk4"
Jul 02 19:11:46.060382 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:46.060231    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:11:46.060382 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.060348    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/38beee50-e2c9-489e-91cb-f1bfad99fabf-host-cni-bin\") pod \"ovnkube-node-lgt7t\" (UID: \"38beee50-e2c9-489e-91cb-f1bfad99fabf\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgt7t"
Jul 02 19:11:46.060382 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.060365    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ce0f2b6b-90ee-4038-9ed6-6777dd9365eb-etc-kubernetes\") pod \"tuned-82xkb\" (UID: \"ce0f2b6b-90ee-4038-9ed6-6777dd9365eb\") " pod="openshift-cluster-node-tuning-operator/tuned-82xkb"
Jul 02 19:11:46.060629 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:46.060409    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0e53e82-59ae-4430-9470-2648eb4eafb4-metrics-certs podName:d0e53e82-59ae-4430-9470-2648eb4eafb4 nodeName:}" failed. No retries permitted until 2026-07-02 19:11:46.56038946 +0000 UTC m=+2.924459367 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d0e53e82-59ae-4430-9470-2648eb4eafb4-metrics-certs") pod "network-metrics-daemon-2b9th" (UID: "d0e53e82-59ae-4430-9470-2648eb4eafb4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:11:46.060629 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.060432    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrt2f\" (UniqueName: \"kubernetes.io/projected/d7c935ff-227d-4302-879d-c1a1f01755a9-kube-api-access-xrt2f\") pod \"node-resolver-9mhh9\" (UID: \"d7c935ff-227d-4302-879d-c1a1f01755a9\") " pod="openshift-dns/node-resolver-9mhh9"
Jul 02 19:11:46.060629 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.060458    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ce0f2b6b-90ee-4038-9ed6-6777dd9365eb-etc-sysctl-conf\") pod \"tuned-82xkb\" (UID: \"ce0f2b6b-90ee-4038-9ed6-6777dd9365eb\") " pod="openshift-cluster-node-tuning-operator/tuned-82xkb"
Jul 02 19:11:46.060629 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.060479    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnh4p\" (UniqueName: \"kubernetes.io/projected/ef227ade-6225-4022-8c2a-133c62174fa0-kube-api-access-hnh4p\") pod \"network-check-target-blvcs\" (UID: \"ef227ade-6225-4022-8c2a-133c62174fa0\") " pod="openshift-network-diagnostics/network-check-target-blvcs"
Jul 02 19:11:46.060629 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.060624    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/24385f8e-c947-4df0-bd2a-10f2562a4a7b-cni-binary-copy\") pod \"multus-pxrmb\" (UID: \"24385f8e-c947-4df0-bd2a-10f2562a4a7b\") " pod="openshift-multus/multus-pxrmb"
Jul 02 19:11:46.060902 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.060652    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/24385f8e-c947-4df0-bd2a-10f2562a4a7b-etc-kubernetes\") pod \"multus-pxrmb\" (UID: \"24385f8e-c947-4df0-bd2a-10f2562a4a7b\") " pod="openshift-multus/multus-pxrmb"
Jul 02 19:11:46.060902 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.060680    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ce0f2b6b-90ee-4038-9ed6-6777dd9365eb-tmp\") pod \"tuned-82xkb\" (UID: \"ce0f2b6b-90ee-4038-9ed6-6777dd9365eb\") " pod="openshift-cluster-node-tuning-operator/tuned-82xkb"
Jul 02 19:11:46.060902 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.060706    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/38beee50-e2c9-489e-91cb-f1bfad99fabf-host-kubelet\") pod \"ovnkube-node-lgt7t\" (UID: \"38beee50-e2c9-489e-91cb-f1bfad99fabf\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgt7t"
Jul 02 19:11:46.060902 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.060718    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ce0f2b6b-90ee-4038-9ed6-6777dd9365eb-etc-sysctl-conf\") pod \"tuned-82xkb\" (UID: \"ce0f2b6b-90ee-4038-9ed6-6777dd9365eb\") " pod="openshift-cluster-node-tuning-operator/tuned-82xkb"
Jul 02 19:11:46.060902 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.060727    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/38beee50-e2c9-489e-91cb-f1bfad99fabf-systemd-units\") pod \"ovnkube-node-lgt7t\" (UID: \"38beee50-e2c9-489e-91cb-f1bfad99fabf\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgt7t"
Jul 02 19:11:46.060902 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.060750    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/38beee50-e2c9-489e-91cb-f1bfad99fabf-run-systemd\") pod \"ovnkube-node-lgt7t\" (UID: \"38beee50-e2c9-489e-91cb-f1bfad99fabf\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgt7t"
Jul 02 19:11:46.060902 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.060773    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2fad0b2e-a705-44f4-91d1-d04cc9eec1e5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qw5fs\" (UID: \"2fad0b2e-a705-44f4-91d1-d04cc9eec1e5\") " pod="openshift-multus/multus-additional-cni-plugins-qw5fs"
Jul 02 19:11:46.060902 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.060797    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2fad0b2e-a705-44f4-91d1-d04cc9eec1e5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qw5fs\" (UID: \"2fad0b2e-a705-44f4-91d1-d04cc9eec1e5\") " pod="openshift-multus/multus-additional-cni-plugins-qw5fs"
Jul 02 19:11:46.060902 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.060822    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/24385f8e-c947-4df0-bd2a-10f2562a4a7b-cnibin\") pod \"multus-pxrmb\" (UID: \"24385f8e-c947-4df0-bd2a-10f2562a4a7b\") " pod="openshift-multus/multus-pxrmb"
Jul 02 19:11:46.060902 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.060845    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/24385f8e-c947-4df0-bd2a-10f2562a4a7b-os-release\") pod \"multus-pxrmb\" (UID: \"24385f8e-c947-4df0-bd2a-10f2562a4a7b\") " pod="openshift-multus/multus-pxrmb"
Jul 02 19:11:46.060902 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.060870    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/21bc43fc-481b-4b52-a8e3-5ae352981994-serviceca\") pod \"node-ca-6rmk4\" (UID: \"21bc43fc-481b-4b52-a8e3-5ae352981994\") " pod="openshift-image-registry/node-ca-6rmk4"
Jul 02 19:11:46.061354 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.060904    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/38beee50-e2c9-489e-91cb-f1bfad99fabf-run-ovn\") pod \"ovnkube-node-lgt7t\" (UID: \"38beee50-e2c9-489e-91cb-f1bfad99fabf\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgt7t"
Jul 02 19:11:46.061354 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.060962    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/38beee50-e2c9-489e-91cb-f1bfad99fabf-host-run-ovn-kubernetes\") pod \"ovnkube-node-lgt7t\" (UID: \"38beee50-e2c9-489e-91cb-f1bfad99fabf\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgt7t"
Jul 02 19:11:46.061354 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.060999    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b4bcbbc3-c3ea-4e9d-ba69-9312e20b21cd-kubelet-config\") pod \"global-pull-secret-syncer-58jxn\" (UID: \"b4bcbbc3-c3ea-4e9d-ba69-9312e20b21cd\") " pod="kube-system/global-pull-secret-syncer-58jxn"
Jul 02 19:11:46.061354 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.061034    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xck9d\" (UniqueName: \"kubernetes.io/projected/0b25f251-9f52-49f6-96f5-dfb4bc6bc1bc-kube-api-access-xck9d\") pod \"iptables-alerter-rg9f6\" (UID: \"0b25f251-9f52-49f6-96f5-dfb4bc6bc1bc\") " pod="openshift-network-operator/iptables-alerter-rg9f6"
Jul 02 19:11:46.061354 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.061058    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/24385f8e-c947-4df0-bd2a-10f2562a4a7b-multus-cni-dir\") pod \"multus-pxrmb\" (UID: \"24385f8e-c947-4df0-bd2a-10f2562a4a7b\") " pod="openshift-multus/multus-pxrmb"
Jul 02 19:11:46.061354 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.061068    2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 02 19:11:46.061354 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.061081    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/24385f8e-c947-4df0-bd2a-10f2562a4a7b-multus-socket-dir-parent\") pod \"multus-pxrmb\" (UID: \"24385f8e-c947-4df0-bd2a-10f2562a4a7b\") " pod="openshift-multus/multus-pxrmb"
Jul 02 19:11:46.061354 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.061102    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/24385f8e-c947-4df0-bd2a-10f2562a4a7b-host-var-lib-cni-bin\") pod \"multus-pxrmb\" (UID: \"24385f8e-c947-4df0-bd2a-10f2562a4a7b\") " pod="openshift-multus/multus-pxrmb"
Jul 02 19:11:46.061354 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.061127    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ce0f2b6b-90ee-4038-9ed6-6777dd9365eb-etc-sysconfig\") pod \"tuned-82xkb\" (UID: \"ce0f2b6b-90ee-4038-9ed6-6777dd9365eb\") " pod="openshift-cluster-node-tuning-operator/tuned-82xkb"
Jul 02 19:11:46.061354 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.061146    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ce0f2b6b-90ee-4038-9ed6-6777dd9365eb-sys\") pod \"tuned-82xkb\" (UID: \"ce0f2b6b-90ee-4038-9ed6-6777dd9365eb\") " pod="openshift-cluster-node-tuning-operator/tuned-82xkb"
Jul 02 19:11:46.061354 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.061165    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9ff33bed-9142-4ce3-8eb8-47ad0e344070-device-dir\") pod \"aws-ebs-csi-driver-node-qqwll\" (UID: \"9ff33bed-9142-4ce3-8eb8-47ad0e344070\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqwll"
Jul 02 19:11:46.061354 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.061188    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/38beee50-e2c9-489e-91cb-f1bfad99fabf-etc-openvswitch\") pod \"ovnkube-node-lgt7t\" (UID: \"38beee50-e2c9-489e-91cb-f1bfad99fabf\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgt7t"
Jul 02 19:11:46.061354 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.061211    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b4bcbbc3-c3ea-4e9d-ba69-9312e20b21cd-original-pull-secret\") pod \"global-pull-secret-syncer-58jxn\" (UID: \"b4bcbbc3-c3ea-4e9d-ba69-9312e20b21cd\") " pod="kube-system/global-pull-secret-syncer-58jxn"
Jul 02 19:11:46.061354 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.061231    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ce0f2b6b-90ee-4038-9ed6-6777dd9365eb-sys\") pod \"tuned-82xkb\" (UID: \"ce0f2b6b-90ee-4038-9ed6-6777dd9365eb\") " pod="openshift-cluster-node-tuning-operator/tuned-82xkb"
Jul 02 19:11:46.061354 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.061240    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9ff33bed-9142-4ce3-8eb8-47ad0e344070-device-dir\") pod \"aws-ebs-csi-driver-node-qqwll\" (UID: \"9ff33bed-9142-4ce3-8eb8-47ad0e344070\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqwll"
Jul 02 19:11:46.061354 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.061254    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0b25f251-9f52-49f6-96f5-dfb4bc6bc1bc-host-slash\") pod \"iptables-alerter-rg9f6\" (UID: \"0b25f251-9f52-49f6-96f5-dfb4bc6bc1bc\") " pod="openshift-network-operator/iptables-alerter-rg9f6"
Jul 02 19:11:46.061354 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.061288    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ce0f2b6b-90ee-4038-9ed6-6777dd9365eb-etc-sysconfig\") pod \"tuned-82xkb\" (UID: \"ce0f2b6b-90ee-4038-9ed6-6777dd9365eb\") " pod="openshift-cluster-node-tuning-operator/tuned-82xkb"
Jul 02 19:11:46.062108 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.061287    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2fad0b2e-a705-44f4-91d1-d04cc9eec1e5-cnibin\") pod \"multus-additional-cni-plugins-qw5fs\" (UID: \"2fad0b2e-a705-44f4-91d1-d04cc9eec1e5\") " pod="openshift-multus/multus-additional-cni-plugins-qw5fs"
Jul 02 19:11:46.062108 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.061326    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdmv4\" (UniqueName: \"kubernetes.io/projected/2fad0b2e-a705-44f4-91d1-d04cc9eec1e5-kube-api-access-wdmv4\") pod \"multus-additional-cni-plugins-qw5fs\" (UID: \"2fad0b2e-a705-44f4-91d1-d04cc9eec1e5\") " pod="openshift-multus/multus-additional-cni-plugins-qw5fs"
Jul 02 19:11:46.062108 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.061353    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ce0f2b6b-90ee-4038-9ed6-6777dd9365eb-run\") pod \"tuned-82xkb\" (UID: \"ce0f2b6b-90ee-4038-9ed6-6777dd9365eb\") " pod="openshift-cluster-node-tuning-operator/tuned-82xkb"
Jul 02 19:11:46.062108 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.061376    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rxnp\" (UniqueName: \"kubernetes.io/projected/ce0f2b6b-90ee-4038-9ed6-6777dd9365eb-kube-api-access-5rxnp\") pod \"tuned-82xkb\" (UID: \"ce0f2b6b-90ee-4038-9ed6-6777dd9365eb\") " pod="openshift-cluster-node-tuning-operator/tuned-82xkb"
Jul 02 19:11:46.062108 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.061402    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/38beee50-e2c9-489e-91cb-f1bfad99fabf-node-log\") pod \"ovnkube-node-lgt7t\" (UID: \"38beee50-e2c9-489e-91cb-f1bfad99fabf\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgt7t"
Jul 02 19:11:46.062108 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.061416    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ce0f2b6b-90ee-4038-9ed6-6777dd9365eb-run\") pod \"tuned-82xkb\" (UID: \"ce0f2b6b-90ee-4038-9ed6-6777dd9365eb\") " pod="openshift-cluster-node-tuning-operator/tuned-82xkb"
Jul 02 19:11:46.062108 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.061426    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzcvc\" (UniqueName: \"kubernetes.io/projected/38beee50-e2c9-489e-91cb-f1bfad99fabf-kube-api-access-rzcvc\") pod \"ovnkube-node-lgt7t\" (UID: \"38beee50-e2c9-489e-91cb-f1bfad99fabf\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgt7t"
Jul 02 19:11:46.062108 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.061461    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0b25f251-9f52-49f6-96f5-dfb4bc6bc1bc-iptables-alerter-script\") pod \"iptables-alerter-rg9f6\" (UID: \"0b25f251-9f52-49f6-96f5-dfb4bc6bc1bc\") " pod="openshift-network-operator/iptables-alerter-rg9f6"
Jul 02 19:11:46.062108 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.061492    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/38beee50-e2c9-489e-91cb-f1bfad99fabf-log-socket\") pod \"ovnkube-node-lgt7t\" (UID: \"38beee50-e2c9-489e-91cb-f1bfad99fabf\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgt7t"
Jul 02 19:11:46.062108 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.061517    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d7c935ff-227d-4302-879d-c1a1f01755a9-tmp-dir\") pod \"node-resolver-9mhh9\" (UID: \"d7c935ff-227d-4302-879d-c1a1f01755a9\") " pod="openshift-dns/node-resolver-9mhh9"
Jul 02 19:11:46.062108 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.061539    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/24385f8e-c947-4df0-bd2a-10f2562a4a7b-hostroot\") pod \"multus-pxrmb\" (UID: \"24385f8e-c947-4df0-bd2a-10f2562a4a7b\") " pod="openshift-multus/multus-pxrmb"
Jul 02 19:11:46.062108 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.061563    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/24385f8e-c947-4df0-bd2a-10f2562a4a7b-multus-conf-dir\") pod \"multus-pxrmb\" (UID: \"24385f8e-c947-4df0-bd2a-10f2562a4a7b\") " pod="openshift-multus/multus-pxrmb"
Jul 02 19:11:46.062108 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.061593    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/24385f8e-c947-4df0-bd2a-10f2562a4a7b-multus-daemon-config\") pod \"multus-pxrmb\" (UID: \"24385f8e-c947-4df0-bd2a-10f2562a4a7b\") " pod="openshift-multus/multus-pxrmb"
Jul 02 19:11:46.062108 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.061634    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8z96c\" (UniqueName: \"kubernetes.io/projected/24385f8e-c947-4df0-bd2a-10f2562a4a7b-kube-api-access-8z96c\") pod \"multus-pxrmb\" (UID: \"24385f8e-c947-4df0-bd2a-10f2562a4a7b\") " pod="openshift-multus/multus-pxrmb"
Jul 02 19:11:46.062108 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.061673    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2fad0b2e-a705-44f4-91d1-d04cc9eec1e5-system-cni-dir\") pod \"multus-additional-cni-plugins-qw5fs\" (UID: \"2fad0b2e-a705-44f4-91d1-d04cc9eec1e5\") " pod="openshift-multus/multus-additional-cni-plugins-qw5fs"
Jul 02 19:11:46.062108 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.061710    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ce0f2b6b-90ee-4038-9ed6-6777dd9365eb-var-lib-kubelet\") pod \"tuned-82xkb\" (UID: \"ce0f2b6b-90ee-4038-9ed6-6777dd9365eb\") " pod="openshift-cluster-node-tuning-operator/tuned-82xkb"
Jul 02 19:11:46.062108 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.061733    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ce0f2b6b-90ee-4038-9ed6-6777dd9365eb-etc-tuned\") pod \"tuned-82xkb\" (UID: \"ce0f2b6b-90ee-4038-9ed6-6777dd9365eb\") " pod="openshift-cluster-node-tuning-operator/tuned-82xkb"
Jul 02 19:11:46.062861 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.061756    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9ff33bed-9142-4ce3-8eb8-47ad0e344070-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qqwll\" (UID: \"9ff33bed-9142-4ce3-8eb8-47ad0e344070\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqwll"
Jul 02 19:11:46.062861 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.061781    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9ff33bed-9142-4ce3-8eb8-47ad0e344070-registration-dir\") pod \"aws-ebs-csi-driver-node-qqwll\" (UID: \"9ff33bed-9142-4ce3-8eb8-47ad0e344070\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqwll"
Jul 02 19:11:46.062861 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.061807    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2fad0b2e-a705-44f4-91d1-d04cc9eec1e5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qw5fs\" (UID: \"2fad0b2e-a705-44f4-91d1-d04cc9eec1e5\") " pod="openshift-multus/multus-additional-cni-plugins-qw5fs"
Jul 02 19:11:46.062861 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.061808    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ce0f2b6b-90ee-4038-9ed6-6777dd9365eb-var-lib-kubelet\") pod \"tuned-82xkb\" (UID: \"ce0f2b6b-90ee-4038-9ed6-6777dd9365eb\") " pod="openshift-cluster-node-tuning-operator/tuned-82xkb"
Jul 02 19:11:46.062861 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.061841    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9ff33bed-9142-4ce3-8eb8-47ad0e344070-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qqwll\" (UID: \"9ff33bed-9142-4ce3-8eb8-47ad0e344070\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqwll"
Jul 02 19:11:46.062861 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.061847    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9ff33bed-9142-4ce3-8eb8-47ad0e344070-sys-fs\") pod \"aws-ebs-csi-driver-node-qqwll\" (UID: \"9ff33bed-9142-4ce3-8eb8-47ad0e344070\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqwll"
Jul 02 19:11:46.062861 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.061873    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9ff33bed-9142-4ce3-8eb8-47ad0e344070-registration-dir\") pod \"aws-ebs-csi-driver-node-qqwll\" (UID: \"9ff33bed-9142-4ce3-8eb8-47ad0e344070\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqwll"
Jul 02 19:11:46.062861 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.061889    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/38beee50-e2c9-489e-91cb-f1bfad99fabf-ovnkube-config\") pod \"ovnkube-node-lgt7t\" (UID: \"38beee50-e2c9-489e-91cb-f1bfad99fabf\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgt7t"
Jul 02 19:11:46.062861 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.061930    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/38beee50-e2c9-489e-91cb-f1bfad99fabf-ovnkube-script-lib\") pod \"ovnkube-node-lgt7t\" (UID: \"38beee50-e2c9-489e-91cb-f1bfad99fabf\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgt7t"
Jul 02 19:11:46.062861 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.061905    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9ff33bed-9142-4ce3-8eb8-47ad0e344070-sys-fs\") pod \"aws-ebs-csi-driver-node-qqwll\" (UID: \"9ff33bed-9142-4ce3-8eb8-47ad0e344070\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqwll"
Jul 02 19:11:46.062861 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.061954    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/24385f8e-c947-4df0-bd2a-10f2562a4a7b-system-cni-dir\") pod \"multus-pxrmb\" (UID: \"24385f8e-c947-4df0-bd2a-10f2562a4a7b\") " pod="openshift-multus/multus-pxrmb"
Jul 02 19:11:46.062861 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.061978    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/24385f8e-c947-4df0-bd2a-10f2562a4a7b-host-var-lib-cni-multus\") pod \"multus-pxrmb\" (UID: \"24385f8e-c947-4df0-bd2a-10f2562a4a7b\") " pod="openshift-multus/multus-pxrmb"
Jul 02 19:11:46.062861 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.062003    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ce0f2b6b-90ee-4038-9ed6-6777dd9365eb-etc-systemd\") pod \"tuned-82xkb\" (UID: \"ce0f2b6b-90ee-4038-9ed6-6777dd9365eb\") " pod="openshift-cluster-node-tuning-operator/tuned-82xkb"
Jul 02 19:11:46.062861 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.062023    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/38beee50-e2c9-489e-91cb-f1bfad99fabf-host-run-netns\") pod \"ovnkube-node-lgt7t\" (UID: \"38beee50-e2c9-489e-91cb-f1bfad99fabf\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgt7t"
Jul 02 19:11:46.062861 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.062042    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/38beee50-e2c9-489e-91cb-f1bfad99fabf-var-lib-openvswitch\") pod \"ovnkube-node-lgt7t\" (UID: \"38beee50-e2c9-489e-91cb-f1bfad99fabf\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgt7t"
Jul 02 19:11:46.062861 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.062061    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cf087cb5-556e-4491-89d6-09e0b08db2b7-agent-certs\") pod \"konnectivity-agent-4pjcm\" (UID: \"cf087cb5-556e-4491-89d6-09e0b08db2b7\") " pod="kube-system/konnectivity-agent-4pjcm"
Jul 02 19:11:46.063590 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.062081    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2fad0b2e-a705-44f4-91d1-d04cc9eec1e5-os-release\") pod \"multus-additional-cni-plugins-qw5fs\" (UID: \"2fad0b2e-a705-44f4-91d1-d04cc9eec1e5\") " pod="openshift-multus/multus-additional-cni-plugins-qw5fs"
Jul 02 19:11:46.063590 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.062093    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ce0f2b6b-90ee-4038-9ed6-6777dd9365eb-etc-systemd\") pod \"tuned-82xkb\" (UID: \"ce0f2b6b-90ee-4038-9ed6-6777dd9365eb\") " pod="openshift-cluster-node-tuning-operator/tuned-82xkb"
Jul 02 19:11:46.063590 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.062102    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ce0f2b6b-90ee-4038-9ed6-6777dd9365eb-etc-modprobe-d\") pod \"tuned-82xkb\" (UID: \"ce0f2b6b-90ee-4038-9ed6-6777dd9365eb\") " pod="openshift-cluster-node-tuning-operator/tuned-82xkb"
Jul 02 19:11:46.063590 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.062147    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/38beee50-e2c9-489e-91cb-f1bfad99fabf-host-slash\") pod \"ovnkube-node-lgt7t\" (UID: \"38beee50-e2c9-489e-91cb-f1bfad99fabf\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgt7t"
Jul 02 19:11:46.063590 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.062175    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/38beee50-e2c9-489e-91cb-f1bfad99fabf-run-openvswitch\") pod \"ovnkube-node-lgt7t\" (UID: \"38beee50-e2c9-489e-91cb-f1bfad99fabf\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgt7t"
Jul 02 19:11:46.063590 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.062193    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ce0f2b6b-90ee-4038-9ed6-6777dd9365eb-etc-modprobe-d\") pod \"tuned-82xkb\" (UID: \"ce0f2b6b-90ee-4038-9ed6-6777dd9365eb\") " pod="openshift-cluster-node-tuning-operator/tuned-82xkb"
Jul 02 19:11:46.063590 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.062199    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cf087cb5-556e-4491-89d6-09e0b08db2b7-konnectivity-ca\") pod \"konnectivity-agent-4pjcm\" (UID: \"cf087cb5-556e-4491-89d6-09e0b08db2b7\") " pod="kube-system/konnectivity-agent-4pjcm"
Jul 02 19:11:46.063590 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.062238    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9ff33bed-9142-4ce3-8eb8-47ad0e344070-etc-selinux\") pod \"aws-ebs-csi-driver-node-qqwll\" (UID: \"9ff33bed-9142-4ce3-8eb8-47ad0e344070\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqwll"
Jul 02 19:11:46.063590 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.062359    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r89xf\" (UniqueName: \"kubernetes.io/projected/21bc43fc-481b-4b52-a8e3-5ae352981994-kube-api-access-r89xf\") pod \"node-ca-6rmk4\" (UID: \"21bc43fc-481b-4b52-a8e3-5ae352981994\") " pod="openshift-image-registry/node-ca-6rmk4"
Jul 02 19:11:46.063590 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.062485    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/38beee50-e2c9-489e-91cb-f1bfad99fabf-env-overrides\") pod \"ovnkube-node-lgt7t\" (UID: \"38beee50-e2c9-489e-91cb-f1bfad99fabf\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgt7t"
Jul 02 19:11:46.063590 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.062426    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9ff33bed-9142-4ce3-8eb8-47ad0e344070-etc-selinux\") pod \"aws-ebs-csi-driver-node-qqwll\" (UID: \"9ff33bed-9142-4ce3-8eb8-47ad0e344070\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqwll"
Jul 02 19:11:46.063590 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.062508    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2fad0b2e-a705-44f4-91d1-d04cc9eec1e5-cni-binary-copy\") pod \"multus-additional-cni-plugins-qw5fs\" (UID: \"2fad0b2e-a705-44f4-91d1-d04cc9eec1e5\") " pod="openshift-multus/multus-additional-cni-plugins-qw5fs"
Jul 02 19:11:46.063590 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.062535    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/24385f8e-c947-4df0-bd2a-10f2562a4a7b-host-run-multus-certs\") pod \"multus-pxrmb\" (UID: \"24385f8e-c947-4df0-bd2a-10f2562a4a7b\") " pod="openshift-multus/multus-pxrmb"
Jul 02 19:11:46.063590 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.062565    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ce0f2b6b-90ee-4038-9ed6-6777dd9365eb-host\") pod \"tuned-82xkb\" (UID: \"ce0f2b6b-90ee-4038-9ed6-6777dd9365eb\") " pod="openshift-cluster-node-tuning-operator/tuned-82xkb"
Jul 02 19:11:46.063590 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.062616    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ce0f2b6b-90ee-4038-9ed6-6777dd9365eb-host\") pod \"tuned-82xkb\" (UID: \"ce0f2b6b-90ee-4038-9ed6-6777dd9365eb\") " pod="openshift-cluster-node-tuning-operator/tuned-82xkb"
Jul 02 19:11:46.063590 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.062622    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ce0f2b6b-90ee-4038-9ed6-6777dd9365eb-etc-sysctl-d\") pod \"tuned-82xkb\" (UID: \"ce0f2b6b-90ee-4038-9ed6-6777dd9365eb\") " pod="openshift-cluster-node-tuning-operator/tuned-82xkb"
Jul 02 19:11:46.063590 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.062655    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtxcv\" (UniqueName: \"kubernetes.io/projected/9ff33bed-9142-4ce3-8eb8-47ad0e344070-kube-api-access-mtxcv\") pod \"aws-ebs-csi-driver-node-qqwll\" (UID: \"9ff33bed-9142-4ce3-8eb8-47ad0e344070\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqwll"
Jul 02 19:11:46.064235 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.062694    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/38beee50-e2c9-489e-91cb-f1bfad99fabf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lgt7t\" (UID: \"38beee50-e2c9-489e-91cb-f1bfad99fabf\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgt7t"
Jul 02 19:11:46.064235 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.062722    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/38beee50-e2c9-489e-91cb-f1bfad99fabf-ovn-node-metrics-cert\") pod \"ovnkube-node-lgt7t\" (UID: \"38beee50-e2c9-489e-91cb-f1bfad99fabf\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgt7t"
Jul 02 19:11:46.064235 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.062748    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/24385f8e-c947-4df0-bd2a-10f2562a4a7b-host-run-netns\") pod \"multus-pxrmb\" (UID: \"24385f8e-c947-4df0-bd2a-10f2562a4a7b\") " pod="openshift-multus/multus-pxrmb"
Jul 02 19:11:46.064235 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.062758    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ce0f2b6b-90ee-4038-9ed6-6777dd9365eb-etc-sysctl-d\") pod \"tuned-82xkb\" (UID: \"ce0f2b6b-90ee-4038-9ed6-6777dd9365eb\") " pod="openshift-cluster-node-tuning-operator/tuned-82xkb"
Jul 02 19:11:46.064235 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.062773    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ce0f2b6b-90ee-4038-9ed6-6777dd9365eb-lib-modules\") pod \"tuned-82xkb\" (UID: \"ce0f2b6b-90ee-4038-9ed6-6777dd9365eb\") " pod="openshift-cluster-node-tuning-operator/tuned-82xkb"
Jul 02 19:11:46.064235 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.062808    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9ff33bed-9142-4ce3-8eb8-47ad0e344070-socket-dir\") pod \"aws-ebs-csi-driver-node-qqwll\" (UID: \"9ff33bed-9142-4ce3-8eb8-47ad0e344070\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqwll"
Jul 02 19:11:46.064235 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.062837    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/38beee50-e2c9-489e-91cb-f1bfad99fabf-host-cni-netd\") pod \"ovnkube-node-lgt7t\" (UID: \"38beee50-e2c9-489e-91cb-f1bfad99fabf\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgt7t"
Jul 02 19:11:46.064235 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.062870    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ce0f2b6b-90ee-4038-9ed6-6777dd9365eb-lib-modules\") pod \"tuned-82xkb\" (UID: \"ce0f2b6b-90ee-4038-9ed6-6777dd9365eb\") " pod="openshift-cluster-node-tuning-operator/tuned-82xkb"
Jul 02 19:11:46.064235 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.063036    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9ff33bed-9142-4ce3-8eb8-47ad0e344070-socket-dir\") pod \"aws-ebs-csi-driver-node-qqwll\" (UID: \"9ff33bed-9142-4ce3-8eb8-47ad0e344070\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqwll"
Jul 02 19:11:46.064888 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.064865    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ce0f2b6b-90ee-4038-9ed6-6777dd9365eb-tmp\") pod \"tuned-82xkb\" (UID: \"ce0f2b6b-90ee-4038-9ed6-6777dd9365eb\") " pod="openshift-cluster-node-tuning-operator/tuned-82xkb"
Jul 02 19:11:46.065013 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.064886    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ce0f2b6b-90ee-4038-9ed6-6777dd9365eb-etc-tuned\") pod \"tuned-82xkb\" (UID: \"ce0f2b6b-90ee-4038-9ed6-6777dd9365eb\") " pod="openshift-cluster-node-tuning-operator/tuned-82xkb"
Jul 02 19:11:46.067475 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:46.067456    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 19:11:46.067475 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:46.067481    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 19:11:46.067610 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:46.067494    2562 projected.go:196] Error preparing data for projected volume kube-api-access-hnh4p for pod openshift-network-diagnostics/network-check-target-blvcs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:11:46.067610 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:46.067587    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ef227ade-6225-4022-8c2a-133c62174fa0-kube-api-access-hnh4p podName:ef227ade-6225-4022-8c2a-133c62174fa0 nodeName:}" failed. No retries permitted until 2026-07-02 19:11:46.567567846 +0000 UTC m=+2.931637757 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-hnh4p" (UniqueName: "kubernetes.io/projected/ef227ade-6225-4022-8c2a-133c62174fa0-kube-api-access-hnh4p") pod "network-check-target-blvcs" (UID: "ef227ade-6225-4022-8c2a-133c62174fa0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:11:46.070048 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.070029    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtqzs\" (UniqueName: \"kubernetes.io/projected/d0e53e82-59ae-4430-9470-2648eb4eafb4-kube-api-access-wtqzs\") pod \"network-metrics-daemon-2b9th\" (UID: \"d0e53e82-59ae-4430-9470-2648eb4eafb4\") " pod="openshift-multus/network-metrics-daemon-2b9th"
Jul 02 19:11:46.070890 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.070870    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rxnp\" (UniqueName: \"kubernetes.io/projected/ce0f2b6b-90ee-4038-9ed6-6777dd9365eb-kube-api-access-5rxnp\") pod \"tuned-82xkb\" (UID: \"ce0f2b6b-90ee-4038-9ed6-6777dd9365eb\") " pod="openshift-cluster-node-tuning-operator/tuned-82xkb"
Jul 02 19:11:46.074107 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.074086    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtxcv\" (UniqueName: \"kubernetes.io/projected/9ff33bed-9142-4ce3-8eb8-47ad0e344070-kube-api-access-mtxcv\") pod \"aws-ebs-csi-driver-node-qqwll\" (UID: \"9ff33bed-9142-4ce3-8eb8-47ad0e344070\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqwll"
Jul 02 19:11:46.116676 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.116615    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-38.ec2.internal" event={"ID":"fccf9d5a8864f519f8e3c7a4a069b572","Type":"ContainerStarted","Data":"3e85cf1454078d87de3b2405f3075de9baaeb647a1da2b4fcaf1bbcbdb68b655"}
Jul 02 19:11:46.117790 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.117763    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-38.ec2.internal" event={"ID":"6052bdddce80b6bdc62311715e9a4818","Type":"ContainerStarted","Data":"1886fe40da9ec496a3a92cf05f349ce7db98bfd51974fb2b601fc79702420215"}
Jul 02 19:11:46.163651 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.163620    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d7c935ff-227d-4302-879d-c1a1f01755a9-hosts-file\") pod \"node-resolver-9mhh9\" (UID: \"d7c935ff-227d-4302-879d-c1a1f01755a9\") " pod="openshift-dns/node-resolver-9mhh9"
Jul 02 19:11:46.163651 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.163656    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/21bc43fc-481b-4b52-a8e3-5ae352981994-host\") pod \"node-ca-6rmk4\" (UID: \"21bc43fc-481b-4b52-a8e3-5ae352981994\") " pod="openshift-image-registry/node-ca-6rmk4"
Jul 02 19:11:46.163868 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.163680    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/38beee50-e2c9-489e-91cb-f1bfad99fabf-host-cni-bin\") pod \"ovnkube-node-lgt7t\" (UID: \"38beee50-e2c9-489e-91cb-f1bfad99fabf\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgt7t"
Jul 02 19:11:46.163868 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.163698    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d7c935ff-227d-4302-879d-c1a1f01755a9-hosts-file\") pod \"node-resolver-9mhh9\" (UID: \"d7c935ff-227d-4302-879d-c1a1f01755a9\") " pod="openshift-dns/node-resolver-9mhh9"
Jul 02 19:11:46.163868 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.163730    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrt2f\" (UniqueName: \"kubernetes.io/projected/d7c935ff-227d-4302-879d-c1a1f01755a9-kube-api-access-xrt2f\") pod \"node-resolver-9mhh9\" (UID: \"d7c935ff-227d-4302-879d-c1a1f01755a9\") " pod="openshift-dns/node-resolver-9mhh9"
Jul 02 19:11:46.163868 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.163770    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/24385f8e-c947-4df0-bd2a-10f2562a4a7b-cni-binary-copy\") pod \"multus-pxrmb\" (UID: \"24385f8e-c947-4df0-bd2a-10f2562a4a7b\") " pod="openshift-multus/multus-pxrmb"
Jul 02 19:11:46.163868 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.163773    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/38beee50-e2c9-489e-91cb-f1bfad99fabf-host-cni-bin\") pod \"ovnkube-node-lgt7t\" (UID: \"38beee50-e2c9-489e-91cb-f1bfad99fabf\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgt7t"
Jul 02 19:11:46.163868 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.163811    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/24385f8e-c947-4df0-bd2a-10f2562a4a7b-etc-kubernetes\") pod \"multus-pxrmb\" (UID: \"24385f8e-c947-4df0-bd2a-10f2562a4a7b\") " pod="openshift-multus/multus-pxrmb"
Jul 02 19:11:46.163868 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.163835    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/38beee50-e2c9-489e-91cb-f1bfad99fabf-host-kubelet\") pod \"ovnkube-node-lgt7t\" (UID: \"38beee50-e2c9-489e-91cb-f1bfad99fabf\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgt7t"
Jul 02 19:11:46.163868 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.163861    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/38beee50-e2c9-489e-91cb-f1bfad99fabf-systemd-units\") pod \"ovnkube-node-lgt7t\" (UID: \"38beee50-e2c9-489e-91cb-f1bfad99fabf\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgt7t"
Jul 02 19:11:46.164286 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.163883    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/38beee50-e2c9-489e-91cb-f1bfad99fabf-run-systemd\") pod \"ovnkube-node-lgt7t\" (UID: \"38beee50-e2c9-489e-91cb-f1bfad99fabf\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgt7t"
Jul 02 19:11:46.164286 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.163907    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/24385f8e-c947-4df0-bd2a-10f2562a4a7b-etc-kubernetes\") pod \"multus-pxrmb\" (UID: \"24385f8e-c947-4df0-bd2a-10f2562a4a7b\") " pod="openshift-multus/multus-pxrmb"
Jul 02 19:11:46.164286 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.163909    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2fad0b2e-a705-44f4-91d1-d04cc9eec1e5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qw5fs\" (UID: \"2fad0b2e-a705-44f4-91d1-d04cc9eec1e5\") " pod="openshift-multus/multus-additional-cni-plugins-qw5fs"
Jul 02 19:11:46.164286 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.163971    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/38beee50-e2c9-489e-91cb-f1bfad99fabf-host-kubelet\") pod \"ovnkube-node-lgt7t\" (UID: \"38beee50-e2c9-489e-91cb-f1bfad99fabf\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgt7t"
Jul 02 19:11:46.164286 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.163972    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2fad0b2e-a705-44f4-91d1-d04cc9eec1e5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qw5fs\" (UID: \"2fad0b2e-a705-44f4-91d1-d04cc9eec1e5\") " pod="openshift-multus/multus-additional-cni-plugins-qw5fs"
Jul 02 19:11:46.164286 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.164009    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/24385f8e-c947-4df0-bd2a-10f2562a4a7b-cnibin\") pod \"multus-pxrmb\" (UID: \"24385f8e-c947-4df0-bd2a-10f2562a4a7b\") " pod="openshift-multus/multus-pxrmb"
Jul 02 19:11:46.164286 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.164032    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/24385f8e-c947-4df0-bd2a-10f2562a4a7b-os-release\") pod \"multus-pxrmb\" (UID: \"24385f8e-c947-4df0-bd2a-10f2562a4a7b\") " pod="openshift-multus/multus-pxrmb"
Jul 02 19:11:46.164286 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.164056    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/21bc43fc-481b-4b52-a8e3-5ae352981994-serviceca\") pod \"node-ca-6rmk4\" (UID: \"21bc43fc-481b-4b52-a8e3-5ae352981994\") " pod="openshift-image-registry/node-ca-6rmk4"
Jul 02 19:11:46.164286 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.164078    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/38beee50-e2c9-489e-91cb-f1bfad99fabf-systemd-units\") pod \"ovnkube-node-lgt7t\" (UID: \"38beee50-e2c9-489e-91cb-f1bfad99fabf\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgt7t"
Jul 02 19:11:46.164286 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.164081    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/38beee50-e2c9-489e-91cb-f1bfad99fabf-run-ovn\") pod \"ovnkube-node-lgt7t\" (UID: \"38beee50-e2c9-489e-91cb-f1bfad99fabf\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgt7t"
Jul 02 19:11:46.164286 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.164120    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/38beee50-e2c9-489e-91cb-f1bfad99fabf-host-run-ovn-kubernetes\") pod \"ovnkube-node-lgt7t\" (UID: \"38beee50-e2c9-489e-91cb-f1bfad99fabf\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgt7t"
Jul 02 19:11:46.164286 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.164117    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/38beee50-e2c9-489e-91cb-f1bfad99fabf-run-ovn\") pod \"ovnkube-node-lgt7t\" (UID: \"38beee50-e2c9-489e-91cb-f1bfad99fabf\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgt7t"
Jul 02 19:11:46.164286 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.164148    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b4bcbbc3-c3ea-4e9d-ba69-9312e20b21cd-kubelet-config\") pod \"global-pull-secret-syncer-58jxn\" (UID: \"b4bcbbc3-c3ea-4e9d-ba69-9312e20b21cd\") " pod="kube-system/global-pull-secret-syncer-58jxn"
Jul 02 19:11:46.164286 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.164172    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xck9d\" (UniqueName: \"kubernetes.io/projected/0b25f251-9f52-49f6-96f5-dfb4bc6bc1bc-kube-api-access-xck9d\") pod \"iptables-alerter-rg9f6\" (UID: \"0b25f251-9f52-49f6-96f5-dfb4bc6bc1bc\") " pod="openshift-network-operator/iptables-alerter-rg9f6"
Jul 02 19:11:46.164286 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.164196    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/24385f8e-c947-4df0-bd2a-10f2562a4a7b-multus-cni-dir\") pod \"multus-pxrmb\" (UID: \"24385f8e-c947-4df0-bd2a-10f2562a4a7b\") " pod="openshift-multus/multus-pxrmb"
Jul 02 19:11:46.164286 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.164218    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/24385f8e-c947-4df0-bd2a-10f2562a4a7b-multus-socket-dir-parent\") pod \"multus-pxrmb\" (UID: \"24385f8e-c947-4df0-bd2a-10f2562a4a7b\") " pod="openshift-multus/multus-pxrmb"
Jul 02 19:11:46.164286 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.164241    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/24385f8e-c947-4df0-bd2a-10f2562a4a7b-host-var-lib-cni-bin\") pod \"multus-pxrmb\" (UID: \"24385f8e-c947-4df0-bd2a-10f2562a4a7b\") " pod="openshift-multus/multus-pxrmb"
Jul 02 19:11:46.164286 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.164274    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/38beee50-e2c9-489e-91cb-f1bfad99fabf-etc-openvswitch\") pod \"ovnkube-node-lgt7t\" (UID: \"38beee50-e2c9-489e-91cb-f1bfad99fabf\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgt7t"
Jul 02 19:11:46.164884 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.164286    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2fad0b2e-a705-44f4-91d1-d04cc9eec1e5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qw5fs\" (UID: \"2fad0b2e-a705-44f4-91d1-d04cc9eec1e5\") " pod="openshift-multus/multus-additional-cni-plugins-qw5fs"
Jul 02 19:11:46.164884 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.164301    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b4bcbbc3-c3ea-4e9d-ba69-9312e20b21cd-original-pull-secret\") pod \"global-pull-secret-syncer-58jxn\" (UID: \"b4bcbbc3-c3ea-4e9d-ba69-9312e20b21cd\") " pod="kube-system/global-pull-secret-syncer-58jxn"
Jul 02 19:11:46.164884 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.164326    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0b25f251-9f52-49f6-96f5-dfb4bc6bc1bc-host-slash\") pod \"iptables-alerter-rg9f6\" (UID: \"0b25f251-9f52-49f6-96f5-dfb4bc6bc1bc\") " pod="openshift-network-operator/iptables-alerter-rg9f6"
Jul 02 19:11:46.164884 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.164333    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/24385f8e-c947-4df0-bd2a-10f2562a4a7b-cnibin\") pod \"multus-pxrmb\" (UID: \"24385f8e-c947-4df0-bd2a-10f2562a4a7b\") " pod="openshift-multus/multus-pxrmb"
Jul 02 19:11:46.164884 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.164351    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2fad0b2e-a705-44f4-91d1-d04cc9eec1e5-cnibin\") pod \"multus-additional-cni-plugins-qw5fs\" (UID: \"2fad0b2e-a705-44f4-91d1-d04cc9eec1e5\") " pod="openshift-multus/multus-additional-cni-plugins-qw5fs"
Jul 02 19:11:46.164884 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.164375    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdmv4\" (UniqueName: \"kubernetes.io/projected/2fad0b2e-a705-44f4-91d1-d04cc9eec1e5-kube-api-access-wdmv4\") pod \"multus-additional-cni-plugins-qw5fs\" (UID: \"2fad0b2e-a705-44f4-91d1-d04cc9eec1e5\") " pod="openshift-multus/multus-additional-cni-plugins-qw5fs"
Jul 02 19:11:46.164884 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.164379    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/24385f8e-c947-4df0-bd2a-10f2562a4a7b-cni-binary-copy\") pod \"multus-pxrmb\" (UID: \"24385f8e-c947-4df0-bd2a-10f2562a4a7b\") " pod="openshift-multus/multus-pxrmb"
Jul 02 19:11:46.164884 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.164394    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/24385f8e-c947-4df0-bd2a-10f2562a4a7b-os-release\") pod \"multus-pxrmb\" (UID: \"24385f8e-c947-4df0-bd2a-10f2562a4a7b\") " pod="openshift-multus/multus-pxrmb"
Jul 02 19:11:46.164884 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.164403    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/38beee50-e2c9-489e-91cb-f1bfad99fabf-node-log\") pod \"ovnkube-node-lgt7t\" (UID: \"38beee50-e2c9-489e-91cb-f1bfad99fabf\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgt7t"
Jul 02 19:11:46.164884 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.164432    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/38beee50-e2c9-489e-91cb-f1bfad99fabf-run-systemd\") pod \"ovnkube-node-lgt7t\" (UID: \"38beee50-e2c9-489e-91cb-f1bfad99fabf\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgt7t"
Jul 02 19:11:46.164884 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.164431    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzcvc\" (UniqueName: \"kubernetes.io/projected/38beee50-e2c9-489e-91cb-f1bfad99fabf-kube-api-access-rzcvc\") pod \"ovnkube-node-lgt7t\" (UID: \"38beee50-e2c9-489e-91cb-f1bfad99fabf\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgt7t"
Jul 02 19:11:46.164884 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.164464    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/38beee50-e2c9-489e-91cb-f1bfad99fabf-etc-openvswitch\") pod \"ovnkube-node-lgt7t\" (UID: \"38beee50-e2c9-489e-91cb-f1bfad99fabf\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgt7t"
Jul 02 19:11:46.164884 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.164468    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0b25f251-9f52-49f6-96f5-dfb4bc6bc1bc-iptables-alerter-script\") pod \"iptables-alerter-rg9f6\" (UID: \"0b25f251-9f52-49f6-96f5-dfb4bc6bc1bc\") " pod="openshift-network-operator/iptables-alerter-rg9f6"
Jul 02 19:11:46.164884 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.164490    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/38beee50-e2c9-489e-91cb-f1bfad99fabf-host-run-ovn-kubernetes\") pod \"ovnkube-node-lgt7t\" (UID: \"38beee50-e2c9-489e-91cb-f1bfad99fabf\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgt7t"
Jul 02 19:11:46.164884 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.164492    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/38beee50-e2c9-489e-91cb-f1bfad99fabf-log-socket\") pod \"ovnkube-node-lgt7t\" (UID: \"38beee50-e2c9-489e-91cb-f1bfad99fabf\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgt7t"
Jul 02 19:11:46.164884 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.164518    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d7c935ff-227d-4302-879d-c1a1f01755a9-tmp-dir\") pod \"node-resolver-9mhh9\" (UID: \"d7c935ff-227d-4302-879d-c1a1f01755a9\") " pod="openshift-dns/node-resolver-9mhh9"
Jul 02 19:11:46.164884 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.164528    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/38beee50-e2c9-489e-91cb-f1bfad99fabf-log-socket\") pod \"ovnkube-node-lgt7t\" (UID: \"38beee50-e2c9-489e-91cb-f1bfad99fabf\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgt7t"
Jul 02 19:11:46.164884 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:46.164546    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 19:11:46.165649 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.164558    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0b25f251-9f52-49f6-96f5-dfb4bc6bc1bc-host-slash\") pod \"iptables-alerter-rg9f6\" (UID: \"0b25f251-9f52-49f6-96f5-dfb4bc6bc1bc\") " pod="openshift-network-operator/iptables-alerter-rg9f6"
Jul 02 19:11:46.165649 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.164571    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/24385f8e-c947-4df0-bd2a-10f2562a4a7b-hostroot\") pod \"multus-pxrmb\" (UID: \"24385f8e-c947-4df0-bd2a-10f2562a4a7b\") " pod="openshift-multus/multus-pxrmb"
Jul 02 19:11:46.165649 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:46.164588    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4bcbbc3-c3ea-4e9d-ba69-9312e20b21cd-original-pull-secret podName:b4bcbbc3-c3ea-4e9d-ba69-9312e20b21cd nodeName:}" failed. No retries permitted until 2026-07-02 19:11:46.664577027 +0000 UTC m=+3.028646931 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b4bcbbc3-c3ea-4e9d-ba69-9312e20b21cd-original-pull-secret") pod "global-pull-secret-syncer-58jxn" (UID: "b4bcbbc3-c3ea-4e9d-ba69-9312e20b21cd") : object "kube-system"/"original-pull-secret" not registered
Jul 02 19:11:46.165649 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.164465    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2fad0b2e-a705-44f4-91d1-d04cc9eec1e5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qw5fs\" (UID: \"2fad0b2e-a705-44f4-91d1-d04cc9eec1e5\") " pod="openshift-multus/multus-additional-cni-plugins-qw5fs"
Jul 02 19:11:46.165649 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.164625    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b4bcbbc3-c3ea-4e9d-ba69-9312e20b21cd-kubelet-config\") pod \"global-pull-secret-syncer-58jxn\" (UID: \"b4bcbbc3-c3ea-4e9d-ba69-9312e20b21cd\") " pod="kube-system/global-pull-secret-syncer-58jxn"
Jul 02 19:11:46.165649 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.164549    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/24385f8e-c947-4df0-bd2a-10f2562a4a7b-hostroot\") pod \"multus-pxrmb\" (UID: \"24385f8e-c947-4df0-bd2a-10f2562a4a7b\") " pod="openshift-multus/multus-pxrmb"
Jul 02 19:11:46.165649 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.164643    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/24385f8e-c947-4df0-bd2a-10f2562a4a7b-host-var-lib-cni-bin\") pod \"multus-pxrmb\" (UID: \"24385f8e-c947-4df0-bd2a-10f2562a4a7b\") " pod="openshift-multus/multus-pxrmb"
Jul 02 19:11:46.165649 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.164659    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/24385f8e-c947-4df0-bd2a-10f2562a4a7b-multus-conf-dir\") pod \"multus-pxrmb\" (UID: \"24385f8e-c947-4df0-bd2a-10f2562a4a7b\") " pod="openshift-multus/multus-pxrmb"
Jul 02 19:11:46.165649 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.164676    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/24385f8e-c947-4df0-bd2a-10f2562a4a7b-multus-daemon-config\") pod \"multus-pxrmb\" (UID: \"24385f8e-c947-4df0-bd2a-10f2562a4a7b\") " pod="openshift-multus/multus-pxrmb"
Jul 02 19:11:46.165649 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.164692    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8z96c\" (UniqueName: \"kubernetes.io/projected/24385f8e-c947-4df0-bd2a-10f2562a4a7b-kube-api-access-8z96c\") pod \"multus-pxrmb\" (UID: \"24385f8e-c947-4df0-bd2a-10f2562a4a7b\") " pod="openshift-multus/multus-pxrmb"
Jul 02 19:11:46.165649 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.164715    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2fad0b2e-a705-44f4-91d1-d04cc9eec1e5-system-cni-dir\") pod \"multus-additional-cni-plugins-qw5fs\" (UID: \"2fad0b2e-a705-44f4-91d1-d04cc9eec1e5\") " pod="openshift-multus/multus-additional-cni-plugins-qw5fs"
Jul 02 19:11:46.165649 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.164737    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2fad0b2e-a705-44f4-91d1-d04cc9eec1e5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qw5fs\" (UID: \"2fad0b2e-a705-44f4-91d1-d04cc9eec1e5\") " pod="openshift-multus/multus-additional-cni-plugins-qw5fs"
Jul 02 19:11:46.165649 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.164754    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/38beee50-e2c9-489e-91cb-f1bfad99fabf-ovnkube-config\") pod \"ovnkube-node-lgt7t\" (UID: \"38beee50-e2c9-489e-91cb-f1bfad99fabf\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgt7t"
Jul 02 19:11:46.165649 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.164764    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d7c935ff-227d-4302-879d-c1a1f01755a9-tmp-dir\") pod \"node-resolver-9mhh9\" (UID: \"d7c935ff-227d-4302-879d-c1a1f01755a9\") " pod="openshift-dns/node-resolver-9mhh9"
Jul 02 19:11:46.165649 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.164770    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/38beee50-e2c9-489e-91cb-f1bfad99fabf-ovnkube-script-lib\") pod \"ovnkube-node-lgt7t\" (UID: \"38beee50-e2c9-489e-91cb-f1bfad99fabf\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgt7t"
Jul 02 19:11:46.165649 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.164794    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/24385f8e-c947-4df0-bd2a-10f2562a4a7b-system-cni-dir\") pod \"multus-pxrmb\" (UID: \"24385f8e-c947-4df0-bd2a-10f2562a4a7b\") " pod="openshift-multus/multus-pxrmb"
Jul 02 19:11:46.165649 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.164797    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/38beee50-e2c9-489e-91cb-f1bfad99fabf-node-log\") pod \"ovnkube-node-lgt7t\" (UID: \"38beee50-e2c9-489e-91cb-f1bfad99fabf\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgt7t"
Jul 02 19:11:46.166135 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.164811    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/24385f8e-c947-4df0-bd2a-10f2562a4a7b-host-var-lib-cni-multus\") pod \"multus-pxrmb\" (UID: \"24385f8e-c947-4df0-bd2a-10f2562a4a7b\") " pod="openshift-multus/multus-pxrmb"
Jul 02 19:11:46.166135 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.164837    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/24385f8e-c947-4df0-bd2a-10f2562a4a7b-host-var-lib-cni-multus\") pod \"multus-pxrmb\" (UID: \"24385f8e-c947-4df0-bd2a-10f2562a4a7b\") " pod="openshift-multus/multus-pxrmb"
Jul 02 19:11:46.166135 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.164843    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/38beee50-e2c9-489e-91cb-f1bfad99fabf-host-run-netns\") pod \"ovnkube-node-lgt7t\" (UID: \"38beee50-e2c9-489e-91cb-f1bfad99fabf\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgt7t"
Jul 02 19:11:46.166135 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.164867    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/38beee50-e2c9-489e-91cb-f1bfad99fabf-var-lib-openvswitch\") pod \"ovnkube-node-lgt7t\" (UID: \"38beee50-e2c9-489e-91cb-f1bfad99fabf\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgt7t"
Jul 02 19:11:46.166135 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.164888    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cf087cb5-556e-4491-89d6-09e0b08db2b7-agent-certs\") pod \"konnectivity-agent-4pjcm\" (UID: \"cf087cb5-556e-4491-89d6-09e0b08db2b7\") " pod="kube-system/konnectivity-agent-4pjcm"
Jul 02 19:11:46.166135 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.164932    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2fad0b2e-a705-44f4-91d1-d04cc9eec1e5-os-release\") pod \"multus-additional-cni-plugins-qw5fs\" (UID: \"2fad0b2e-a705-44f4-91d1-d04cc9eec1e5\") " pod="openshift-multus/multus-additional-cni-plugins-qw5fs"
Jul 02 19:11:46.166135 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.164956    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/38beee50-e2c9-489e-91cb-f1bfad99fabf-host-slash\") pod \"ovnkube-node-lgt7t\" (UID: \"38beee50-e2c9-489e-91cb-f1bfad99fabf\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgt7t"
Jul 02 19:11:46.166135 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.164981    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/38beee50-e2c9-489e-91cb-f1bfad99fabf-run-openvswitch\") pod \"ovnkube-node-lgt7t\" (UID: \"38beee50-e2c9-489e-91cb-f1bfad99fabf\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgt7t"
Jul 02 19:11:46.166135 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.164983    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/24385f8e-c947-4df0-bd2a-10f2562a4a7b-multus-cni-dir\") pod \"multus-pxrmb\" (UID: \"24385f8e-c947-4df0-bd2a-10f2562a4a7b\") " pod="openshift-multus/multus-pxrmb"
Jul 02 19:11:46.166135 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.165007    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cf087cb5-556e-4491-89d6-09e0b08db2b7-konnectivity-ca\") pod \"konnectivity-agent-4pjcm\" (UID: \"cf087cb5-556e-4491-89d6-09e0b08db2b7\") " pod="kube-system/konnectivity-agent-4pjcm"
Jul 02 19:11:46.166135 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.165036    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r89xf\" (UniqueName: \"kubernetes.io/projected/21bc43fc-481b-4b52-a8e3-5ae352981994-kube-api-access-r89xf\") pod \"node-ca-6rmk4\" (UID: \"21bc43fc-481b-4b52-a8e3-5ae352981994\") " pod="openshift-image-registry/node-ca-6rmk4"
Jul 02 19:11:46.166135 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.165055    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2fad0b2e-a705-44f4-91d1-d04cc9eec1e5-system-cni-dir\") pod \"multus-additional-cni-plugins-qw5fs\" (UID: \"2fad0b2e-a705-44f4-91d1-d04cc9eec1e5\") " pod="openshift-multus/multus-additional-cni-plugins-qw5fs"
Jul 02 19:11:46.166135 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.165103    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/21bc43fc-481b-4b52-a8e3-5ae352981994-serviceca\") pod \"node-ca-6rmk4\" (UID: \"21bc43fc-481b-4b52-a8e3-5ae352981994\") " pod="openshift-image-registry/node-ca-6rmk4"
Jul 02 19:11:46.166135 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.165060    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/38beee50-e2c9-489e-91cb-f1bfad99fabf-env-overrides\") pod \"ovnkube-node-lgt7t\" (UID: \"38beee50-e2c9-489e-91cb-f1bfad99fabf\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgt7t"
Jul 02 19:11:46.166135 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.165573    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2fad0b2e-a705-44f4-91d1-d04cc9eec1e5-cni-binary-copy\") pod \"multus-additional-cni-plugins-qw5fs\" (UID: \"2fad0b2e-a705-44f4-91d1-d04cc9eec1e5\") " pod="openshift-multus/multus-additional-cni-plugins-qw5fs"
Jul 02 19:11:46.166135 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.165589    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/38beee50-e2c9-489e-91cb-f1bfad99fabf-ovnkube-script-lib\") pod \"ovnkube-node-lgt7t\" (UID: \"38beee50-e2c9-489e-91cb-f1bfad99fabf\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgt7t"
Jul 02 19:11:46.166135 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.165602    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/24385f8e-c947-4df0-bd2a-10f2562a4a7b-host-run-multus-certs\") pod \"multus-pxrmb\" (UID: \"24385f8e-c947-4df0-bd2a-10f2562a4a7b\") " pod="openshift-multus/multus-pxrmb"
Jul 02 19:11:46.166803 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.165608    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0b25f251-9f52-49f6-96f5-dfb4bc6bc1bc-iptables-alerter-script\") pod \"iptables-alerter-rg9f6\" (UID: \"0b25f251-9f52-49f6-96f5-dfb4bc6bc1bc\") " pod="openshift-network-operator/iptables-alerter-rg9f6"
Jul 02 19:11:46.166803 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.165616    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2fad0b2e-a705-44f4-91d1-d04cc9eec1e5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qw5fs\" (UID: \"2fad0b2e-a705-44f4-91d1-d04cc9eec1e5\") " pod="openshift-multus/multus-additional-cni-plugins-qw5fs"
Jul 02 19:11:46.166803 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.165635    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/38beee50-e2c9-489e-91cb-f1bfad99fabf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lgt7t\" (UID: \"38beee50-e2c9-489e-91cb-f1bfad99fabf\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgt7t"
Jul 02 19:11:46.166803 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.165655    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/24385f8e-c947-4df0-bd2a-10f2562a4a7b-multus-conf-dir\") pod \"multus-pxrmb\" (UID: \"24385f8e-c947-4df0-bd2a-10f2562a4a7b\") " pod="openshift-multus/multus-pxrmb"
Jul 02 19:11:46.166803 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.165661    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/38beee50-e2c9-489e-91cb-f1bfad99fabf-ovn-node-metrics-cert\") pod \"ovnkube-node-lgt7t\" (UID: \"38beee50-e2c9-489e-91cb-f1bfad99fabf\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgt7t"
Jul 02 19:11:46.166803 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.165688    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/24385f8e-c947-4df0-bd2a-10f2562a4a7b-host-run-netns\") pod \"multus-pxrmb\" (UID: \"24385f8e-c947-4df0-bd2a-10f2562a4a7b\") " pod="openshift-multus/multus-pxrmb"
Jul 02 19:11:46.166803 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.165715    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/38beee50-e2c9-489e-91cb-f1bfad99fabf-host-cni-netd\") pod \"ovnkube-node-lgt7t\" (UID: \"38beee50-e2c9-489e-91cb-f1bfad99fabf\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgt7t"
Jul 02 19:11:46.166803 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.165740    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/24385f8e-c947-4df0-bd2a-10f2562a4a7b-host-run-k8s-cni-cncf-io\") pod \"multus-pxrmb\" (UID: \"24385f8e-c947-4df0-bd2a-10f2562a4a7b\") " pod="openshift-multus/multus-pxrmb"
Jul 02 19:11:46.166803 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.165786    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/24385f8e-c947-4df0-bd2a-10f2562a4a7b-host-var-lib-kubelet\") pod \"multus-pxrmb\" (UID: \"24385f8e-c947-4df0-bd2a-10f2562a4a7b\") " pod="openshift-multus/multus-pxrmb"
Jul 02 19:11:46.166803 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.165828    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b4bcbbc3-c3ea-4e9d-ba69-9312e20b21cd-dbus\") pod \"global-pull-secret-syncer-58jxn\" (UID: \"b4bcbbc3-c3ea-4e9d-ba69-9312e20b21cd\") " pod="kube-system/global-pull-secret-syncer-58jxn"
Jul 02 19:11:46.166803 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.165901    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/24385f8e-c947-4df0-bd2a-10f2562a4a7b-multus-daemon-config\") pod \"multus-pxrmb\" (UID: \"24385f8e-c947-4df0-bd2a-10f2562a4a7b\") " pod="openshift-multus/multus-pxrmb"
Jul 02 19:11:46.166803 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.165951    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2fad0b2e-a705-44f4-91d1-d04cc9eec1e5-cnibin\") pod \"multus-additional-cni-plugins-qw5fs\" (UID: \"2fad0b2e-a705-44f4-91d1-d04cc9eec1e5\") " pod="openshift-multus/multus-additional-cni-plugins-qw5fs"
Jul 02 19:11:46.166803 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.165965    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/24385f8e-c947-4df0-bd2a-10f2562a4a7b-system-cni-dir\") pod \"multus-pxrmb\" (UID: \"24385f8e-c947-4df0-bd2a-10f2562a4a7b\") " pod="openshift-multus/multus-pxrmb"
Jul 02 19:11:46.166803 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.165994    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/38beee50-e2c9-489e-91cb-f1bfad99fabf-host-run-netns\") pod \"ovnkube-node-lgt7t\" (UID: \"38beee50-e2c9-489e-91cb-f1bfad99fabf\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgt7t"
Jul 02 19:11:46.166803 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.166012    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b4bcbbc3-c3ea-4e9d-ba69-9312e20b21cd-dbus\") pod \"global-pull-secret-syncer-58jxn\" (UID: \"b4bcbbc3-c3ea-4e9d-ba69-9312e20b21cd\") " pod="kube-system/global-pull-secret-syncer-58jxn"
Jul 02 19:11:46.166803 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.166026    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/38beee50-e2c9-489e-91cb-f1bfad99fabf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lgt7t\" (UID: \"38beee50-e2c9-489e-91cb-f1bfad99fabf\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgt7t"
Jul 02 19:11:46.166803 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.165038    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/24385f8e-c947-4df0-bd2a-10f2562a4a7b-multus-socket-dir-parent\") pod \"multus-pxrmb\" (UID: \"24385f8e-c947-4df0-bd2a-10f2562a4a7b\") " pod="openshift-multus/multus-pxrmb"
Jul 02 19:11:46.167579 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.166069    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/38beee50-e2c9-489e-91cb-f1bfad99fabf-host-slash\") pod \"ovnkube-node-lgt7t\" (UID: \"38beee50-e2c9-489e-91cb-f1bfad99fabf\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgt7t"
Jul 02 19:11:46.167579 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.166071    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/38beee50-e2c9-489e-91cb-f1bfad99fabf-run-openvswitch\") pod \"ovnkube-node-lgt7t\" (UID: \"38beee50-e2c9-489e-91cb-f1bfad99fabf\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgt7t"
Jul 02 19:11:46.167579 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.166069    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/38beee50-e2c9-489e-91cb-f1bfad99fabf-ovnkube-config\") pod \"ovnkube-node-lgt7t\" (UID: \"38beee50-e2c9-489e-91cb-f1bfad99fabf\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgt7t"
Jul 02 19:11:46.167579 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.166105    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/38beee50-e2c9-489e-91cb-f1bfad99fabf-host-cni-netd\") pod \"ovnkube-node-lgt7t\" (UID: \"38beee50-e2c9-489e-91cb-f1bfad99fabf\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgt7t"
Jul 02 19:11:46.167579 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.166148    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/24385f8e-c947-4df0-bd2a-10f2562a4a7b-host-run-netns\") pod \"multus-pxrmb\" (UID: \"24385f8e-c947-4df0-bd2a-10f2562a4a7b\") " pod="openshift-multus/multus-pxrmb"
Jul 02 19:11:46.167579 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.166150    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2fad0b2e-a705-44f4-91d1-d04cc9eec1e5-os-release\") pod \"multus-additional-cni-plugins-qw5fs\" (UID: \"2fad0b2e-a705-44f4-91d1-d04cc9eec1e5\") " pod="openshift-multus/multus-additional-cni-plugins-qw5fs"
Jul 02 19:11:46.167579 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.166377    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/38beee50-e2c9-489e-91cb-f1bfad99fabf-env-overrides\") pod \"ovnkube-node-lgt7t\" (UID: \"38beee50-e2c9-489e-91cb-f1bfad99fabf\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgt7t"
Jul 02 19:11:46.167579 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.167309    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cf087cb5-556e-4491-89d6-09e0b08db2b7-konnectivity-ca\") pod \"konnectivity-agent-4pjcm\" (UID: \"cf087cb5-556e-4491-89d6-09e0b08db2b7\") " pod="kube-system/konnectivity-agent-4pjcm"
Jul 02 19:11:46.167579 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.166592    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/24385f8e-c947-4df0-bd2a-10f2562a4a7b-host-run-multus-certs\") pod \"multus-pxrmb\" (UID: \"24385f8e-c947-4df0-bd2a-10f2562a4a7b\") " pod="openshift-multus/multus-pxrmb"
Jul 02 19:11:46.167579 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.167098    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2fad0b2e-a705-44f4-91d1-d04cc9eec1e5-cni-binary-copy\") pod \"multus-additional-cni-plugins-qw5fs\" (UID: \"2fad0b2e-a705-44f4-91d1-d04cc9eec1e5\") " pod="openshift-multus/multus-additional-cni-plugins-qw5fs"
Jul 02 19:11:46.167579 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.167143    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/24385f8e-c947-4df0-bd2a-10f2562a4a7b-host-run-k8s-cni-cncf-io\") pod \"multus-pxrmb\" (UID: \"24385f8e-c947-4df0-bd2a-10f2562a4a7b\") " pod="openshift-multus/multus-pxrmb"
Jul 02 19:11:46.167579 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.166435    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/21bc43fc-481b-4b52-a8e3-5ae352981994-host\") pod \"node-ca-6rmk4\" (UID: \"21bc43fc-481b-4b52-a8e3-5ae352981994\") " pod="openshift-image-registry/node-ca-6rmk4"
Jul 02 19:11:46.167579 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.167568    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/24385f8e-c947-4df0-bd2a-10f2562a4a7b-host-var-lib-kubelet\") pod \"multus-pxrmb\" (UID: \"24385f8e-c947-4df0-bd2a-10f2562a4a7b\") " pod="openshift-multus/multus-pxrmb"
Jul 02 19:11:46.168031 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.167734    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/38beee50-e2c9-489e-91cb-f1bfad99fabf-var-lib-openvswitch\") pod \"ovnkube-node-lgt7t\" (UID: \"38beee50-e2c9-489e-91cb-f1bfad99fabf\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgt7t"
Jul 02 19:11:46.168743 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.168721    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/38beee50-e2c9-489e-91cb-f1bfad99fabf-ovn-node-metrics-cert\") pod \"ovnkube-node-lgt7t\" (UID: \"38beee50-e2c9-489e-91cb-f1bfad99fabf\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgt7t"
Jul 02 19:11:46.170419 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.169465    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cf087cb5-556e-4491-89d6-09e0b08db2b7-agent-certs\") pod \"konnectivity-agent-4pjcm\" (UID: \"cf087cb5-556e-4491-89d6-09e0b08db2b7\") " pod="kube-system/konnectivity-agent-4pjcm"
Jul 02 19:11:46.178300 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.178275    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrt2f\" (UniqueName: \"kubernetes.io/projected/d7c935ff-227d-4302-879d-c1a1f01755a9-kube-api-access-xrt2f\") pod \"node-resolver-9mhh9\" (UID: \"d7c935ff-227d-4302-879d-c1a1f01755a9\") " pod="openshift-dns/node-resolver-9mhh9"
Jul 02 19:11:46.182894 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.182871    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8z96c\" (UniqueName: \"kubernetes.io/projected/24385f8e-c947-4df0-bd2a-10f2562a4a7b-kube-api-access-8z96c\") pod \"multus-pxrmb\" (UID: \"24385f8e-c947-4df0-bd2a-10f2562a4a7b\") " pod="openshift-multus/multus-pxrmb"
Jul 02 19:11:46.183850 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.183445    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r89xf\" (UniqueName: \"kubernetes.io/projected/21bc43fc-481b-4b52-a8e3-5ae352981994-kube-api-access-r89xf\") pod \"node-ca-6rmk4\" (UID: \"21bc43fc-481b-4b52-a8e3-5ae352981994\") " pod="openshift-image-registry/node-ca-6rmk4"
Jul 02 19:11:46.183850 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.183512    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdmv4\" (UniqueName: \"kubernetes.io/projected/2fad0b2e-a705-44f4-91d1-d04cc9eec1e5-kube-api-access-wdmv4\") pod \"multus-additional-cni-plugins-qw5fs\" (UID: \"2fad0b2e-a705-44f4-91d1-d04cc9eec1e5\") " pod="openshift-multus/multus-additional-cni-plugins-qw5fs"
Jul 02 19:11:46.183850 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.183816    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xck9d\" (UniqueName: \"kubernetes.io/projected/0b25f251-9f52-49f6-96f5-dfb4bc6bc1bc-kube-api-access-xck9d\") pod \"iptables-alerter-rg9f6\" (UID: \"0b25f251-9f52-49f6-96f5-dfb4bc6bc1bc\") " pod="openshift-network-operator/iptables-alerter-rg9f6"
Jul 02 19:11:46.183850 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.183844    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzcvc\" (UniqueName: \"kubernetes.io/projected/38beee50-e2c9-489e-91cb-f1bfad99fabf-kube-api-access-rzcvc\") pod \"ovnkube-node-lgt7t\" (UID: \"38beee50-e2c9-489e-91cb-f1bfad99fabf\") " pod="openshift-ovn-kubernetes/ovnkube-node-lgt7t"
Jul 02 19:11:46.261249 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.261176    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqwll"
Jul 02 19:11:46.272265 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.272242    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-82xkb"
Jul 02 19:11:46.283987 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.283959    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6rmk4"
Jul 02 19:11:46.290070 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.290040    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lgt7t"
Jul 02 19:11:46.298848 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.298693    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4pjcm"
Jul 02 19:11:46.306344 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.306326    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rg9f6"
Jul 02 19:11:46.312997 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.312966    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9mhh9"
Jul 02 19:11:46.318701 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.318682    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qw5fs"
Jul 02 19:11:46.323869 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.323851    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pxrmb"
Jul 02 19:11:46.568155 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.568064    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnh4p\" (UniqueName: \"kubernetes.io/projected/ef227ade-6225-4022-8c2a-133c62174fa0-kube-api-access-hnh4p\") pod \"network-check-target-blvcs\" (UID: \"ef227ade-6225-4022-8c2a-133c62174fa0\") " pod="openshift-network-diagnostics/network-check-target-blvcs"
Jul 02 19:11:46.568290 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.568175    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0e53e82-59ae-4430-9470-2648eb4eafb4-metrics-certs\") pod \"network-metrics-daemon-2b9th\" (UID: \"d0e53e82-59ae-4430-9470-2648eb4eafb4\") " pod="openshift-multus/network-metrics-daemon-2b9th"
Jul 02 19:11:46.568290 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:46.568240    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 19:11:46.568290 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:46.568263    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 19:11:46.568290 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:46.568261    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:11:46.568290 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:46.568272    2562 projected.go:196] Error preparing data for projected volume kube-api-access-hnh4p for pod openshift-network-diagnostics/network-check-target-blvcs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:11:46.568444 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:46.568315    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ef227ade-6225-4022-8c2a-133c62174fa0-kube-api-access-hnh4p podName:ef227ade-6225-4022-8c2a-133c62174fa0 nodeName:}" failed. No retries permitted until 2026-07-02 19:11:47.568303111 +0000 UTC m=+3.932373006 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-hnh4p" (UniqueName: "kubernetes.io/projected/ef227ade-6225-4022-8c2a-133c62174fa0-kube-api-access-hnh4p") pod "network-check-target-blvcs" (UID: "ef227ade-6225-4022-8c2a-133c62174fa0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:11:46.568444 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:46.568331    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0e53e82-59ae-4430-9470-2648eb4eafb4-metrics-certs podName:d0e53e82-59ae-4430-9470-2648eb4eafb4 nodeName:}" failed. No retries permitted until 2026-07-02 19:11:47.568323919 +0000 UTC m=+3.932393809 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d0e53e82-59ae-4430-9470-2648eb4eafb4-metrics-certs") pod "network-metrics-daemon-2b9th" (UID: "d0e53e82-59ae-4430-9470-2648eb4eafb4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:11:46.668773 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.668735    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b4bcbbc3-c3ea-4e9d-ba69-9312e20b21cd-original-pull-secret\") pod \"global-pull-secret-syncer-58jxn\" (UID: \"b4bcbbc3-c3ea-4e9d-ba69-9312e20b21cd\") " pod="kube-system/global-pull-secret-syncer-58jxn"
Jul 02 19:11:46.668949 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:46.668865    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 19:11:46.668949 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:46.668943    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4bcbbc3-c3ea-4e9d-ba69-9312e20b21cd-original-pull-secret podName:b4bcbbc3-c3ea-4e9d-ba69-9312e20b21cd nodeName:}" failed. No retries permitted until 2026-07-02 19:11:47.668924432 +0000 UTC m=+4.032994338 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b4bcbbc3-c3ea-4e9d-ba69-9312e20b21cd-original-pull-secret") pod "global-pull-secret-syncer-58jxn" (UID: "b4bcbbc3-c3ea-4e9d-ba69-9312e20b21cd") : object "kube-system"/"original-pull-secret" not registered
Jul 02 19:11:46.992585 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.992203    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 19:06:45 +0000 UTC" deadline="2028-02-20 07:19:58.162423697 +0000 UTC"
Jul 02 19:11:46.992585 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:46.992247    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14340h8m11.170179338s"
Jul 02 19:11:47.009547 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:47.009522    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ff33bed_9142_4ce3_8eb8_47ad0e344070.slice/crio-363074ee7471626fa85398bfcb302e6009c0418d64eefc4b9b3d97721fd87b72 WatchSource:0}: Error finding container 363074ee7471626fa85398bfcb302e6009c0418d64eefc4b9b3d97721fd87b72: Status 404 returned error can't find the container with id 363074ee7471626fa85398bfcb302e6009c0418d64eefc4b9b3d97721fd87b72
Jul 02 19:11:47.010844 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:47.010814    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b25f251_9f52_49f6_96f5_dfb4bc6bc1bc.slice/crio-fe106e251d31bb7d9db0eab952b607754aea04afc4268bcc08ecef168349e38b WatchSource:0}: Error finding container fe106e251d31bb7d9db0eab952b607754aea04afc4268bcc08ecef168349e38b: Status 404 returned error can't find the container with id fe106e251d31bb7d9db0eab952b607754aea04afc4268bcc08ecef168349e38b
Jul 02 19:11:47.013333 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:47.013262    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce0f2b6b_90ee_4038_9ed6_6777dd9365eb.slice/crio-7d876811a1f4827d1fd6bc6539ff5c6dfe910bf7a6bca68e65c03e17670daa26 WatchSource:0}: Error finding container 7d876811a1f4827d1fd6bc6539ff5c6dfe910bf7a6bca68e65c03e17670daa26: Status 404 returned error can't find the container with id 7d876811a1f4827d1fd6bc6539ff5c6dfe910bf7a6bca68e65c03e17670daa26
Jul 02 19:11:47.016483 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:47.016463    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38beee50_e2c9_489e_91cb_f1bfad99fabf.slice/crio-c0071ffdbde09ebc1545c1666fb60eb355e87c0fe46e0e4e5cfa18de03f72001 WatchSource:0}: Error finding container c0071ffdbde09ebc1545c1666fb60eb355e87c0fe46e0e4e5cfa18de03f72001: Status 404 returned error can't find the container with id c0071ffdbde09ebc1545c1666fb60eb355e87c0fe46e0e4e5cfa18de03f72001
Jul 02 19:11:47.017388 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:11:47.017365    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24385f8e_c947_4df0_bd2a_10f2562a4a7b.slice/crio-f80bebf327ba5f9309e952e950eb4496560f63b101444ce6fe324b4f5235bc03 WatchSource:0}: Error finding container f80bebf327ba5f9309e952e950eb4496560f63b101444ce6fe324b4f5235bc03: Status 404 returned error can't find the container with id f80bebf327ba5f9309e952e950eb4496560f63b101444ce6fe324b4f5235bc03
Jul 02 19:11:47.112240 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:47.112080    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2b9th"
Jul 02 19:11:47.112333 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:47.112135    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-blvcs"
Jul 02 19:11:47.112380 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:47.112351    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2b9th" podUID="d0e53e82-59ae-4430-9470-2648eb4eafb4"
Jul 02 19:11:47.112419 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:47.112382    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-blvcs" podUID="ef227ade-6225-4022-8c2a-133c62174fa0"
Jul 02 19:11:47.120604 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:47.120581    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rg9f6" event={"ID":"0b25f251-9f52-49f6-96f5-dfb4bc6bc1bc","Type":"ContainerStarted","Data":"fe106e251d31bb7d9db0eab952b607754aea04afc4268bcc08ecef168349e38b"}
Jul 02 19:11:47.122613 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:47.122581    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-38.ec2.internal" event={"ID":"fccf9d5a8864f519f8e3c7a4a069b572","Type":"ContainerStarted","Data":"3e37930630bf4bd9fe89967a9be364e62951e1a45b5842f31bee245665bf5db8"}
Jul 02 19:11:47.123784 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:47.123764    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4pjcm" event={"ID":"cf087cb5-556e-4491-89d6-09e0b08db2b7","Type":"ContainerStarted","Data":"34faa80fd1edd1bd7b7418e9d89a18111a300bda769dca323fa85a1295d2983b"}
Jul 02 19:11:47.124873 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:47.124846    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-82xkb" event={"ID":"ce0f2b6b-90ee-4038-9ed6-6777dd9365eb","Type":"ContainerStarted","Data":"7d876811a1f4827d1fd6bc6539ff5c6dfe910bf7a6bca68e65c03e17670daa26"}
Jul 02 19:11:47.125989 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:47.125936    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqwll" event={"ID":"9ff33bed-9142-4ce3-8eb8-47ad0e344070","Type":"ContainerStarted","Data":"363074ee7471626fa85398bfcb302e6009c0418d64eefc4b9b3d97721fd87b72"}
Jul 02 19:11:47.127508 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:47.127485    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6rmk4" event={"ID":"21bc43fc-481b-4b52-a8e3-5ae352981994","Type":"ContainerStarted","Data":"0a9214f03a2b66da1ffcfb622e6c9f6b3810ae64001f13bfaf7273efd5ec31dd"}
Jul 02 19:11:47.128487 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:47.128469    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qw5fs" event={"ID":"2fad0b2e-a705-44f4-91d1-d04cc9eec1e5","Type":"ContainerStarted","Data":"67fe1b802cc518bb69e85658a725098b58659e2b763aa662cd2d8d08ba176eff"}
Jul 02 19:11:47.129510 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:47.129488    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9mhh9" event={"ID":"d7c935ff-227d-4302-879d-c1a1f01755a9","Type":"ContainerStarted","Data":"009ba45a524d00c3b9d7c2f45451e106fa0bad7382a83d4fb1f1db4abff7967c"}
Jul 02 19:11:47.130687 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:47.130661    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pxrmb" event={"ID":"24385f8e-c947-4df0-bd2a-10f2562a4a7b","Type":"ContainerStarted","Data":"f80bebf327ba5f9309e952e950eb4496560f63b101444ce6fe324b4f5235bc03"}
Jul 02 19:11:47.132136 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:47.132116    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lgt7t" event={"ID":"38beee50-e2c9-489e-91cb-f1bfad99fabf","Type":"ContainerStarted","Data":"c0071ffdbde09ebc1545c1666fb60eb355e87c0fe46e0e4e5cfa18de03f72001"}
Jul 02 19:11:47.139529 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:47.139492    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-38.ec2.internal" podStartSLOduration=2.1394801230000002 podStartE2EDuration="2.139480123s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:11:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:11:47.139324406 +0000 UTC m=+3.503394320" watchObservedRunningTime="2026-07-02 19:11:47.139480123 +0000 UTC m=+3.503550037"
Jul 02 19:11:47.576539 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:47.576449    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0e53e82-59ae-4430-9470-2648eb4eafb4-metrics-certs\") pod \"network-metrics-daemon-2b9th\" (UID: \"d0e53e82-59ae-4430-9470-2648eb4eafb4\") " pod="openshift-multus/network-metrics-daemon-2b9th"
Jul 02 19:11:47.576539 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:47.576508    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnh4p\" (UniqueName: \"kubernetes.io/projected/ef227ade-6225-4022-8c2a-133c62174fa0-kube-api-access-hnh4p\") pod \"network-check-target-blvcs\" (UID: \"ef227ade-6225-4022-8c2a-133c62174fa0\") " pod="openshift-network-diagnostics/network-check-target-blvcs"
Jul 02 19:11:47.576771 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:47.576675    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 19:11:47.576771 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:47.576693    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 19:11:47.576771 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:47.576705    2562 projected.go:196] Error preparing data for projected volume kube-api-access-hnh4p for pod openshift-network-diagnostics/network-check-target-blvcs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:11:47.576771 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:47.576767    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ef227ade-6225-4022-8c2a-133c62174fa0-kube-api-access-hnh4p podName:ef227ade-6225-4022-8c2a-133c62174fa0 nodeName:}" failed. No retries permitted until 2026-07-02 19:11:49.576748992 +0000 UTC m=+5.940818903 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-hnh4p" (UniqueName: "kubernetes.io/projected/ef227ade-6225-4022-8c2a-133c62174fa0-kube-api-access-hnh4p") pod "network-check-target-blvcs" (UID: "ef227ade-6225-4022-8c2a-133c62174fa0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:11:47.577195 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:47.577176    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:11:47.577268 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:47.577230    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0e53e82-59ae-4430-9470-2648eb4eafb4-metrics-certs podName:d0e53e82-59ae-4430-9470-2648eb4eafb4 nodeName:}" failed. No retries permitted until 2026-07-02 19:11:49.577215465 +0000 UTC m=+5.941285359 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d0e53e82-59ae-4430-9470-2648eb4eafb4-metrics-certs") pod "network-metrics-daemon-2b9th" (UID: "d0e53e82-59ae-4430-9470-2648eb4eafb4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:11:47.677143 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:47.677102    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b4bcbbc3-c3ea-4e9d-ba69-9312e20b21cd-original-pull-secret\") pod \"global-pull-secret-syncer-58jxn\" (UID: \"b4bcbbc3-c3ea-4e9d-ba69-9312e20b21cd\") " pod="kube-system/global-pull-secret-syncer-58jxn"
Jul 02 19:11:47.677348 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:47.677300    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 19:11:47.677421 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:47.677365    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4bcbbc3-c3ea-4e9d-ba69-9312e20b21cd-original-pull-secret podName:b4bcbbc3-c3ea-4e9d-ba69-9312e20b21cd nodeName:}" failed. No retries permitted until 2026-07-02 19:11:49.677347264 +0000 UTC m=+6.041417174 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b4bcbbc3-c3ea-4e9d-ba69-9312e20b21cd-original-pull-secret") pod "global-pull-secret-syncer-58jxn" (UID: "b4bcbbc3-c3ea-4e9d-ba69-9312e20b21cd") : object "kube-system"/"original-pull-secret" not registered
Jul 02 19:11:47.992934 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:47.992808    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 19:06:45 +0000 UTC" deadline="2028-02-22 21:02:29.444715908 +0000 UTC"
Jul 02 19:11:47.992934 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:47.992871    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14401h50m41.451848756s"
Jul 02 19:11:48.115196 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:48.114646    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58jxn"
Jul 02 19:11:48.115196 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:48.114774    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58jxn" podUID="b4bcbbc3-c3ea-4e9d-ba69-9312e20b21cd"
Jul 02 19:11:48.145136 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:48.145097    2562 generic.go:356] "Generic (PLEG): container finished" podID="6052bdddce80b6bdc62311715e9a4818" containerID="a37bdb9288ff575a244774e2630a8715c8734caff60a96995dafaa04ef58498b" exitCode=0
Jul 02 19:11:48.146013 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:48.145976    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-38.ec2.internal" event={"ID":"6052bdddce80b6bdc62311715e9a4818","Type":"ContainerDied","Data":"a37bdb9288ff575a244774e2630a8715c8734caff60a96995dafaa04ef58498b"}
Jul 02 19:11:49.112319 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:49.112283    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2b9th"
Jul 02 19:11:49.112770 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:49.112416    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2b9th" podUID="d0e53e82-59ae-4430-9470-2648eb4eafb4"
Jul 02 19:11:49.112840 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:49.112830    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-blvcs"
Jul 02 19:11:49.112974 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:49.112942    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-blvcs" podUID="ef227ade-6225-4022-8c2a-133c62174fa0"
Jul 02 19:11:49.159009 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:49.158974    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-38.ec2.internal" event={"ID":"6052bdddce80b6bdc62311715e9a4818","Type":"ContainerStarted","Data":"fdc38c48cee4d0a8597d44895404d68f53019ebcbbc10a66589ce4d7f2c2c79b"}
Jul 02 19:11:49.598817 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:49.598017    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0e53e82-59ae-4430-9470-2648eb4eafb4-metrics-certs\") pod \"network-metrics-daemon-2b9th\" (UID: \"d0e53e82-59ae-4430-9470-2648eb4eafb4\") " pod="openshift-multus/network-metrics-daemon-2b9th"
Jul 02 19:11:49.598817 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:49.598071    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnh4p\" (UniqueName: \"kubernetes.io/projected/ef227ade-6225-4022-8c2a-133c62174fa0-kube-api-access-hnh4p\") pod \"network-check-target-blvcs\" (UID: \"ef227ade-6225-4022-8c2a-133c62174fa0\") " pod="openshift-network-diagnostics/network-check-target-blvcs"
Jul 02 19:11:49.598817 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:49.598231    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 19:11:49.598817 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:49.598248    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 19:11:49.598817 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:49.598261    2562 projected.go:196] Error preparing data for projected volume kube-api-access-hnh4p for pod openshift-network-diagnostics/network-check-target-blvcs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:11:49.598817 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:49.598317    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ef227ade-6225-4022-8c2a-133c62174fa0-kube-api-access-hnh4p podName:ef227ade-6225-4022-8c2a-133c62174fa0 nodeName:}" failed. No retries permitted until 2026-07-02 19:11:53.598300111 +0000 UTC m=+9.962370017 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-hnh4p" (UniqueName: "kubernetes.io/projected/ef227ade-6225-4022-8c2a-133c62174fa0-kube-api-access-hnh4p") pod "network-check-target-blvcs" (UID: "ef227ade-6225-4022-8c2a-133c62174fa0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:11:49.598817 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:49.598695    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:11:49.598817 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:49.598738    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0e53e82-59ae-4430-9470-2648eb4eafb4-metrics-certs podName:d0e53e82-59ae-4430-9470-2648eb4eafb4 nodeName:}" failed. No retries permitted until 2026-07-02 19:11:53.598725418 +0000 UTC m=+9.962795322 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d0e53e82-59ae-4430-9470-2648eb4eafb4-metrics-certs") pod "network-metrics-daemon-2b9th" (UID: "d0e53e82-59ae-4430-9470-2648eb4eafb4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:11:49.699795 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:49.699212    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b4bcbbc3-c3ea-4e9d-ba69-9312e20b21cd-original-pull-secret\") pod \"global-pull-secret-syncer-58jxn\" (UID: \"b4bcbbc3-c3ea-4e9d-ba69-9312e20b21cd\") " pod="kube-system/global-pull-secret-syncer-58jxn"
Jul 02 19:11:49.699795 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:49.699365    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 19:11:49.699795 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:49.699427    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4bcbbc3-c3ea-4e9d-ba69-9312e20b21cd-original-pull-secret podName:b4bcbbc3-c3ea-4e9d-ba69-9312e20b21cd nodeName:}" failed. No retries permitted until 2026-07-02 19:11:53.699409012 +0000 UTC m=+10.063478920 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b4bcbbc3-c3ea-4e9d-ba69-9312e20b21cd-original-pull-secret") pod "global-pull-secret-syncer-58jxn" (UID: "b4bcbbc3-c3ea-4e9d-ba69-9312e20b21cd") : object "kube-system"/"original-pull-secret" not registered
Jul 02 19:11:50.112109 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:50.112065    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58jxn"
Jul 02 19:11:50.112326 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:50.112204    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58jxn" podUID="b4bcbbc3-c3ea-4e9d-ba69-9312e20b21cd"
Jul 02 19:11:51.112644 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:51.111988    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2b9th"
Jul 02 19:11:51.112644 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:51.112134    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2b9th" podUID="d0e53e82-59ae-4430-9470-2648eb4eafb4"
Jul 02 19:11:51.112644 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:51.112518    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-blvcs"
Jul 02 19:11:51.112644 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:51.112600    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-blvcs" podUID="ef227ade-6225-4022-8c2a-133c62174fa0"
Jul 02 19:11:52.114114 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:52.114084    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58jxn"
Jul 02 19:11:52.114503 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:52.114222    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58jxn" podUID="b4bcbbc3-c3ea-4e9d-ba69-9312e20b21cd"
Jul 02 19:11:53.112322 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:53.112286    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2b9th"
Jul 02 19:11:53.112494 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:53.112432    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2b9th" podUID="d0e53e82-59ae-4430-9470-2648eb4eafb4"
Jul 02 19:11:53.112800 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:53.112783    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-blvcs"
Jul 02 19:11:53.112890 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:53.112872    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-blvcs" podUID="ef227ade-6225-4022-8c2a-133c62174fa0"
Jul 02 19:11:53.638517 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:53.638478    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnh4p\" (UniqueName: \"kubernetes.io/projected/ef227ade-6225-4022-8c2a-133c62174fa0-kube-api-access-hnh4p\") pod \"network-check-target-blvcs\" (UID: \"ef227ade-6225-4022-8c2a-133c62174fa0\") " pod="openshift-network-diagnostics/network-check-target-blvcs"
Jul 02 19:11:53.638905 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:53.638579    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0e53e82-59ae-4430-9470-2648eb4eafb4-metrics-certs\") pod \"network-metrics-daemon-2b9th\" (UID: \"d0e53e82-59ae-4430-9470-2648eb4eafb4\") " pod="openshift-multus/network-metrics-daemon-2b9th"
Jul 02 19:11:53.638905 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:53.638695    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:11:53.638905 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:53.638756    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0e53e82-59ae-4430-9470-2648eb4eafb4-metrics-certs podName:d0e53e82-59ae-4430-9470-2648eb4eafb4 nodeName:}" failed. No retries permitted until 2026-07-02 19:12:01.638737934 +0000 UTC m=+18.002807845 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d0e53e82-59ae-4430-9470-2648eb4eafb4-metrics-certs") pod "network-metrics-daemon-2b9th" (UID: "d0e53e82-59ae-4430-9470-2648eb4eafb4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:11:53.639211 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:53.639198    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 19:11:53.639251 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:53.639219    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 19:11:53.639251 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:53.639228    2562 projected.go:196] Error preparing data for projected volume kube-api-access-hnh4p for pod openshift-network-diagnostics/network-check-target-blvcs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:11:53.639304 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:53.639262    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ef227ade-6225-4022-8c2a-133c62174fa0-kube-api-access-hnh4p podName:ef227ade-6225-4022-8c2a-133c62174fa0 nodeName:}" failed. No retries permitted until 2026-07-02 19:12:01.639251231 +0000 UTC m=+18.003321134 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-hnh4p" (UniqueName: "kubernetes.io/projected/ef227ade-6225-4022-8c2a-133c62174fa0-kube-api-access-hnh4p") pod "network-check-target-blvcs" (UID: "ef227ade-6225-4022-8c2a-133c62174fa0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:11:53.739779 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:53.739254    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b4bcbbc3-c3ea-4e9d-ba69-9312e20b21cd-original-pull-secret\") pod \"global-pull-secret-syncer-58jxn\" (UID: \"b4bcbbc3-c3ea-4e9d-ba69-9312e20b21cd\") " pod="kube-system/global-pull-secret-syncer-58jxn"
Jul 02 19:11:53.739779 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:53.739398    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 19:11:53.739779 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:53.739457    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4bcbbc3-c3ea-4e9d-ba69-9312e20b21cd-original-pull-secret podName:b4bcbbc3-c3ea-4e9d-ba69-9312e20b21cd nodeName:}" failed. No retries permitted until 2026-07-02 19:12:01.739439037 +0000 UTC m=+18.103508930 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b4bcbbc3-c3ea-4e9d-ba69-9312e20b21cd-original-pull-secret") pod "global-pull-secret-syncer-58jxn" (UID: "b4bcbbc3-c3ea-4e9d-ba69-9312e20b21cd") : object "kube-system"/"original-pull-secret" not registered
Jul 02 19:11:54.114991 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:54.114161    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58jxn"
Jul 02 19:11:54.114991 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:54.114273    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58jxn" podUID="b4bcbbc3-c3ea-4e9d-ba69-9312e20b21cd"
Jul 02 19:11:55.113220 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:55.113182    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2b9th"
Jul 02 19:11:55.113580 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:55.113328    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2b9th" podUID="d0e53e82-59ae-4430-9470-2648eb4eafb4"
Jul 02 19:11:55.113833 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:55.113685    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-blvcs"
Jul 02 19:11:55.113833 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:55.113771    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-blvcs" podUID="ef227ade-6225-4022-8c2a-133c62174fa0"
Jul 02 19:11:56.111975 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:56.111943    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58jxn"
Jul 02 19:11:56.112125 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:56.112087    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58jxn" podUID="b4bcbbc3-c3ea-4e9d-ba69-9312e20b21cd"
Jul 02 19:11:57.112089 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:57.112053    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2b9th"
Jul 02 19:11:57.112636 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:57.112105    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-blvcs"
Jul 02 19:11:57.112636 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:57.112202    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2b9th" podUID="d0e53e82-59ae-4430-9470-2648eb4eafb4"
Jul 02 19:11:57.112636 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:57.112361    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-blvcs" podUID="ef227ade-6225-4022-8c2a-133c62174fa0"
Jul 02 19:11:58.112087 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:58.112016    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58jxn"
Jul 02 19:11:58.112231 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:58.112152    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58jxn" podUID="b4bcbbc3-c3ea-4e9d-ba69-9312e20b21cd"
Jul 02 19:11:59.112647 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:59.112608    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2b9th"
Jul 02 19:11:59.113048 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:11:59.112608    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-blvcs"
Jul 02 19:11:59.113048 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:59.112724    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2b9th" podUID="d0e53e82-59ae-4430-9470-2648eb4eafb4"
Jul 02 19:11:59.113048 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:11:59.112795    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-blvcs" podUID="ef227ade-6225-4022-8c2a-133c62174fa0"
Jul 02 19:12:00.112536 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:00.112063    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58jxn"
Jul 02 19:12:00.112536 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:12:00.112202    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58jxn" podUID="b4bcbbc3-c3ea-4e9d-ba69-9312e20b21cd"
Jul 02 19:12:01.112449 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:01.112409    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2b9th"
Jul 02 19:12:01.112692 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:01.112409    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-blvcs"
Jul 02 19:12:01.112692 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:12:01.112563    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2b9th" podUID="d0e53e82-59ae-4430-9470-2648eb4eafb4"
Jul 02 19:12:01.112692 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:12:01.112618    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-blvcs" podUID="ef227ade-6225-4022-8c2a-133c62174fa0"
Jul 02 19:12:01.699678 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:01.699641    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0e53e82-59ae-4430-9470-2648eb4eafb4-metrics-certs\") pod \"network-metrics-daemon-2b9th\" (UID: \"d0e53e82-59ae-4430-9470-2648eb4eafb4\") " pod="openshift-multus/network-metrics-daemon-2b9th"
Jul 02 19:12:01.699893 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:01.699695    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnh4p\" (UniqueName: \"kubernetes.io/projected/ef227ade-6225-4022-8c2a-133c62174fa0-kube-api-access-hnh4p\") pod \"network-check-target-blvcs\" (UID: \"ef227ade-6225-4022-8c2a-133c62174fa0\") " pod="openshift-network-diagnostics/network-check-target-blvcs"
Jul 02 19:12:01.699893 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:12:01.699812    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:12:01.699893 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:12:01.699879    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0e53e82-59ae-4430-9470-2648eb4eafb4-metrics-certs podName:d0e53e82-59ae-4430-9470-2648eb4eafb4 nodeName:}" failed. No retries permitted until 2026-07-02 19:12:17.699863572 +0000 UTC m=+34.063933462 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d0e53e82-59ae-4430-9470-2648eb4eafb4-metrics-certs") pod "network-metrics-daemon-2b9th" (UID: "d0e53e82-59ae-4430-9470-2648eb4eafb4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:12:01.699893 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:12:01.699817    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 19:12:01.700068 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:12:01.699906    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 19:12:01.700068 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:12:01.699938    2562 projected.go:196] Error preparing data for projected volume kube-api-access-hnh4p for pod openshift-network-diagnostics/network-check-target-blvcs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:12:01.700068 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:12:01.699969    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ef227ade-6225-4022-8c2a-133c62174fa0-kube-api-access-hnh4p podName:ef227ade-6225-4022-8c2a-133c62174fa0 nodeName:}" failed. No retries permitted until 2026-07-02 19:12:17.699962297 +0000 UTC m=+34.064032189 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-hnh4p" (UniqueName: "kubernetes.io/projected/ef227ade-6225-4022-8c2a-133c62174fa0-kube-api-access-hnh4p") pod "network-check-target-blvcs" (UID: "ef227ade-6225-4022-8c2a-133c62174fa0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:12:01.800300 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:01.800264    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b4bcbbc3-c3ea-4e9d-ba69-9312e20b21cd-original-pull-secret\") pod \"global-pull-secret-syncer-58jxn\" (UID: \"b4bcbbc3-c3ea-4e9d-ba69-9312e20b21cd\") " pod="kube-system/global-pull-secret-syncer-58jxn"
Jul 02 19:12:01.800452 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:12:01.800383    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 19:12:01.800452 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:12:01.800440    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4bcbbc3-c3ea-4e9d-ba69-9312e20b21cd-original-pull-secret podName:b4bcbbc3-c3ea-4e9d-ba69-9312e20b21cd nodeName:}" failed. No retries permitted until 2026-07-02 19:12:17.800424402 +0000 UTC m=+34.164494313 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b4bcbbc3-c3ea-4e9d-ba69-9312e20b21cd-original-pull-secret") pod "global-pull-secret-syncer-58jxn" (UID: "b4bcbbc3-c3ea-4e9d-ba69-9312e20b21cd") : object "kube-system"/"original-pull-secret" not registered
Jul 02 19:12:02.112144 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:02.112112    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58jxn"
Jul 02 19:12:02.112291 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:12:02.112229    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58jxn" podUID="b4bcbbc3-c3ea-4e9d-ba69-9312e20b21cd"
Jul 02 19:12:03.112704 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:03.112667    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2b9th"
Jul 02 19:12:03.113147 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:12:03.112799    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2b9th" podUID="d0e53e82-59ae-4430-9470-2648eb4eafb4"
Jul 02 19:12:03.113147 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:03.112864    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-blvcs"
Jul 02 19:12:03.113147 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:12:03.112995    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-blvcs" podUID="ef227ade-6225-4022-8c2a-133c62174fa0"
Jul 02 19:12:04.112414 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:04.112377    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58jxn"
Jul 02 19:12:04.112577 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:12:04.112468    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58jxn" podUID="b4bcbbc3-c3ea-4e9d-ba69-9312e20b21cd"
Jul 02 19:12:05.112727 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:05.112694    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2b9th"
Jul 02 19:12:05.112727 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:05.112694    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-blvcs"
Jul 02 19:12:05.113221 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:12:05.112826    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2b9th" podUID="d0e53e82-59ae-4430-9470-2648eb4eafb4"
Jul 02 19:12:05.113221 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:12:05.112980    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-blvcs" podUID="ef227ade-6225-4022-8c2a-133c62174fa0"
Jul 02 19:12:06.114895 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:06.114869    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58jxn"
Jul 02 19:12:06.117190 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:12:06.116792    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58jxn" podUID="b4bcbbc3-c3ea-4e9d-ba69-9312e20b21cd"
Jul 02 19:12:06.203829 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:06.203674    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qw5fs" event={"ID":"2fad0b2e-a705-44f4-91d1-d04cc9eec1e5","Type":"ContainerStarted","Data":"b59ec76092d37c6f56e03d6812b12215b2f5adeb0acbdc48db0372fdbe9ca909"}
Jul 02 19:12:06.206103 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:06.206074    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4pjcm" event={"ID":"cf087cb5-556e-4491-89d6-09e0b08db2b7","Type":"ContainerStarted","Data":"425794084fe42be4754059451a155dd33c50e21195174a46262e29602b170612"}
Jul 02 19:12:06.210692 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:06.210609    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqwll" event={"ID":"9ff33bed-9142-4ce3-8eb8-47ad0e344070","Type":"ContainerStarted","Data":"750b15010d67a8d5f9e260b646036ef9234ec3953bd86fa5158b27e57b9521ff"}
Jul 02 19:12:06.228416 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:06.228250    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-38.ec2.internal" podStartSLOduration=21.228229523 podStartE2EDuration="21.228229523s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:11:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:11:49.176439047 +0000 UTC m=+5.540508964" watchObservedRunningTime="2026-07-02 19:12:06.228229523 +0000 UTC m=+22.592299436"
Jul 02 19:12:06.556256 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:06.556117    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:12:06.628693 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:06.628663    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:12:07.112191 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:07.112162    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2b9th"
Jul 02 19:12:07.112337 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:07.112206    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-blvcs"
Jul 02 19:12:07.112337 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:12:07.112283    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2b9th" podUID="d0e53e82-59ae-4430-9470-2648eb4eafb4"
Jul 02 19:12:07.112414 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:12:07.112381    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-blvcs" podUID="ef227ade-6225-4022-8c2a-133c62174fa0"
Jul 02 19:12:07.214974 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:07.214937    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-82xkb" event={"ID":"ce0f2b6b-90ee-4038-9ed6-6777dd9365eb","Type":"ContainerStarted","Data":"ca8ec95d0aa096c049d21e0f1cc215ae13453c3b292bbf69a5ab87c525ca093f"}
Jul 02 19:12:07.216601 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:07.216559    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6rmk4" event={"ID":"21bc43fc-481b-4b52-a8e3-5ae352981994","Type":"ContainerStarted","Data":"80416f77e193996229032459ce2bad33e6908f931c28268fd8097ede7a8f04be"}
Jul 02 19:12:07.218243 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:07.218218    2562 generic.go:356] "Generic (PLEG): container finished" podID="2fad0b2e-a705-44f4-91d1-d04cc9eec1e5" containerID="b59ec76092d37c6f56e03d6812b12215b2f5adeb0acbdc48db0372fdbe9ca909" exitCode=0
Jul 02 19:12:07.218349 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:07.218299    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qw5fs" event={"ID":"2fad0b2e-a705-44f4-91d1-d04cc9eec1e5","Type":"ContainerDied","Data":"b59ec76092d37c6f56e03d6812b12215b2f5adeb0acbdc48db0372fdbe9ca909"}
Jul 02 19:12:07.220509 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:07.220488    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9mhh9" event={"ID":"d7c935ff-227d-4302-879d-c1a1f01755a9","Type":"ContainerStarted","Data":"96bc64c078e27cf07bd23db57e4726fc979b6871aadddfabe1e9a4f462fc5302"}
Jul 02 19:12:07.221594 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:07.221572    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pxrmb" event={"ID":"24385f8e-c947-4df0-bd2a-10f2562a4a7b","Type":"ContainerStarted","Data":"02916791515df87f58f22f6edfbb51563dcd7e18c949f7dd9086408a5471d9d4"}
Jul 02 19:12:07.225845 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:07.225829    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lgt7t_38beee50-e2c9-489e-91cb-f1bfad99fabf/ovn-acl-logging/0.log"
Jul 02 19:12:07.226280 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:07.226257    2562 generic.go:356] "Generic (PLEG): container finished" podID="38beee50-e2c9-489e-91cb-f1bfad99fabf" containerID="7c1e64c6049eb7643c0b3658c20c702d51470f750a44ca7ed9e087d9acd344c4" exitCode=1
Jul 02 19:12:07.226365 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:07.226327    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lgt7t" event={"ID":"38beee50-e2c9-489e-91cb-f1bfad99fabf","Type":"ContainerStarted","Data":"14a4a046c35f3e4ecdc4f80dc0429db7fa5a00e2f1ba127c414909f41461b4d9"}
Jul 02 19:12:07.226414 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:07.226406    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lgt7t" event={"ID":"38beee50-e2c9-489e-91cb-f1bfad99fabf","Type":"ContainerStarted","Data":"f1fd0f297d0446ecc0d8b2d677f695fdf37431e63832bd9aa5d160f46d3103de"}
Jul 02 19:12:07.226450 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:07.226438    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lgt7t" event={"ID":"38beee50-e2c9-489e-91cb-f1bfad99fabf","Type":"ContainerStarted","Data":"64de8e0438b6916702689cbc6559d6f849eec86ec7089ea1f7e24bee48362281"}
Jul 02 19:12:07.226495 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:07.226468    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lgt7t" event={"ID":"38beee50-e2c9-489e-91cb-f1bfad99fabf","Type":"ContainerStarted","Data":"e840d75c16e239db1847aefbd96eaaf91c96f23e716ed646ff107ca09549f218"}
Jul 02 19:12:07.226547 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:07.226500    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lgt7t" event={"ID":"38beee50-e2c9-489e-91cb-f1bfad99fabf","Type":"ContainerDied","Data":"7c1e64c6049eb7643c0b3658c20c702d51470f750a44ca7ed9e087d9acd344c4"}
Jul 02 19:12:07.226547 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:07.226539    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lgt7t" event={"ID":"38beee50-e2c9-489e-91cb-f1bfad99fabf","Type":"ContainerStarted","Data":"9109d21da38448947651473f4fa791b5cad6c57c6dcf355fc7264e6cf6dc278e"}
Jul 02 19:12:07.237211 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:07.237121    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-4pjcm" podStartSLOduration=8.075892276 podStartE2EDuration="23.237102782s" totalImagesPullingTime="15.161210506s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:11:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:12:06.229034502 +0000 UTC m=+22.593104418" watchObservedRunningTime="2026-07-02 19:12:07.237102782 +0000 UTC m=+23.601172695"
Jul 02 19:12:07.237318 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:07.237294    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-82xkb" podStartSLOduration=4.246208508 podStartE2EDuration="23.237286375s" totalImagesPullingTime="18.991077867s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:11:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:12:07.236595492 +0000 UTC m=+23.600665429" watchObservedRunningTime="2026-07-02 19:12:07.237286375 +0000 UTC m=+23.601356288"
Jul 02 19:12:07.255206 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:07.253839    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-9mhh9" podStartSLOduration=4.270875755 podStartE2EDuration="23.253812377s" totalImagesPullingTime="18.982936622s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:11:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:12:07.252842642 +0000 UTC m=+23.616912556" watchObservedRunningTime="2026-07-02 19:12:07.253812377 +0000 UTC m=+23.617882291"
Jul 02 19:12:07.296997 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:07.296940    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-pxrmb" podStartSLOduration=4.103907775 podStartE2EDuration="23.296904767s" totalImagesPullingTime="19.192996992s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:11:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:12:07.296329416 +0000 UTC m=+23.660399328" watchObservedRunningTime="2026-07-02 19:12:07.296904767 +0000 UTC m=+23.660974680"
Jul 02 19:12:07.314805 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:07.314750    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-6rmk4" podStartSLOduration=4.334267083 podStartE2EDuration="23.314730457s" totalImagesPullingTime="18.980463374s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:11:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:12:07.314552025 +0000 UTC m=+23.678621937" watchObservedRunningTime="2026-07-02 19:12:07.314730457 +0000 UTC m=+23.678800369"
Jul 02 19:12:07.420167 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:07.420123    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:12:07.486820 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:07.486786    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:12:07.753567 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:07.753542    2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 02 19:12:08.024682 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:08.024476    2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-02T19:12:07.753562098Z","UUID":"bca7cc81-44b4-4f88-8fd0-d44e9732186b","Handler":null,"Name":"","Endpoint":""}
Jul 02 19:12:08.026310 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:08.026277    2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 02 19:12:08.026449 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:08.026322    2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 02 19:12:08.112838 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:08.112809    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58jxn"
Jul 02 19:12:08.113067 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:12:08.112957    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58jxn" podUID="b4bcbbc3-c3ea-4e9d-ba69-9312e20b21cd"
Jul 02 19:12:08.230173 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:08.230138    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rg9f6" event={"ID":"0b25f251-9f52-49f6-96f5-dfb4bc6bc1bc","Type":"ContainerStarted","Data":"1552c922ead9b1dfd26843d0b70b2cb431d64d487f2936c5b0f57610edbabf92"}
Jul 02 19:12:08.232368 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:08.232338    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqwll" event={"ID":"9ff33bed-9142-4ce3-8eb8-47ad0e344070","Type":"ContainerStarted","Data":"1dccc748b4357db8522df2b2fd825bab9576e5ce80835ceb1c2faef7b2c0b26f"}
Jul 02 19:12:08.248131 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:08.248091    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-rg9f6" podStartSLOduration=5.2524212 podStartE2EDuration="24.24807513s" totalImagesPullingTime="18.99565393s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:11:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:12:08.247540458 +0000 UTC m=+24.611610373" watchObservedRunningTime="2026-07-02 19:12:08.24807513 +0000 UTC m=+24.612145045"
Jul 02 19:12:08.354617 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:08.354531    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:12:08.433248 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:08.433202    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:12:08.517700 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:08.517631    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:12:08.582828 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:08.582795    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:12:08.943995 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:08.943964    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-4pjcm"
Jul 02 19:12:08.945006 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:08.944898    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-4pjcm"
Jul 02 19:12:08.976598 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:08.976572    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:12:09.048193 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:09.048129    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:12:09.112185 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:09.112160    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2b9th"
Jul 02 19:12:09.112322 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:12:09.112277    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2b9th" podUID="d0e53e82-59ae-4430-9470-2648eb4eafb4"
Jul 02 19:12:09.112385 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:09.112337    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-blvcs"
Jul 02 19:12:09.112455 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:12:09.112430    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-blvcs" podUID="ef227ade-6225-4022-8c2a-133c62174fa0"
Jul 02 19:12:09.238443 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:09.238373    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lgt7t_38beee50-e2c9-489e-91cb-f1bfad99fabf/ovn-acl-logging/0.log"
Jul 02 19:12:09.239003 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:09.238978    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lgt7t" event={"ID":"38beee50-e2c9-489e-91cb-f1bfad99fabf","Type":"ContainerStarted","Data":"9b1c47cbf4b3b42a3d8de85d9c6e479357f54d5ceb34fce664f564172418b828"}
Jul 02 19:12:10.112339 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:10.112174    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58jxn"
Jul 02 19:12:10.112511 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:12:10.112419    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58jxn" podUID="b4bcbbc3-c3ea-4e9d-ba69-9312e20b21cd"
Jul 02 19:12:10.243721 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:10.243686    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqwll" event={"ID":"9ff33bed-9142-4ce3-8eb8-47ad0e344070","Type":"ContainerStarted","Data":"8801f4e41afbdcf18bebc1413564dde58bf2fc0d6918fe396816a9d3d9519634"}
Jul 02 19:12:10.263539 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:10.263493    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qqwll" podStartSLOduration=4.26610833 podStartE2EDuration="26.263479378s" totalImagesPullingTime="21.997371048s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:11:44 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:12:10.263208753 +0000 UTC m=+26.627278667" watchObservedRunningTime="2026-07-02 19:12:10.263479378 +0000 UTC m=+26.627549288"
Jul 02 19:12:11.112188 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:11.112156    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-blvcs"
Jul 02 19:12:11.112188 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:11.112197    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2b9th"
Jul 02 19:12:11.112486 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:12:11.112282    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-blvcs" podUID="ef227ade-6225-4022-8c2a-133c62174fa0"
Jul 02 19:12:11.112486 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:12:11.112410    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2b9th" podUID="d0e53e82-59ae-4430-9470-2648eb4eafb4"
Jul 02 19:12:11.524991 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:11.524901    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-4pjcm"
Jul 02 19:12:11.525509 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:11.525039    2562 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 02 19:12:11.525509 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:11.525472    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-4pjcm"
Jul 02 19:12:11.596447 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:11.596407    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:12:12.112731 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:12.112474    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58jxn"
Jul 02 19:12:12.112869 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:12:12.112759    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58jxn" podUID="b4bcbbc3-c3ea-4e9d-ba69-9312e20b21cd"
Jul 02 19:12:12.253471 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:12.253435    2562 generic.go:356] "Generic (PLEG): container finished" podID="2fad0b2e-a705-44f4-91d1-d04cc9eec1e5" containerID="a21481da5a0efe9c8ae067d2f1b5f0d0eb08e3b171ba3eccffa4eb82f0e9052f" exitCode=0
Jul 02 19:12:12.253648 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:12.253512    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qw5fs" event={"ID":"2fad0b2e-a705-44f4-91d1-d04cc9eec1e5","Type":"ContainerDied","Data":"a21481da5a0efe9c8ae067d2f1b5f0d0eb08e3b171ba3eccffa4eb82f0e9052f"}
Jul 02 19:12:12.257036 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:12.257018    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lgt7t_38beee50-e2c9-489e-91cb-f1bfad99fabf/ovn-acl-logging/0.log"
Jul 02 19:12:12.257471 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:12.257443    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lgt7t" event={"ID":"38beee50-e2c9-489e-91cb-f1bfad99fabf","Type":"ContainerStarted","Data":"07092c27d7e9e0eb254023a26f71be6790aa62af45c80c3a3c42459d1d103e51"}
Jul 02 19:12:12.257896 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:12.257881    2562 scope.go:117] "RemoveContainer" containerID="7c1e64c6049eb7643c0b3658c20c702d51470f750a44ca7ed9e087d9acd344c4"
Jul 02 19:12:12.398439 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:12.398364    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:12:13.112366 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:13.112333    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2b9th"
Jul 02 19:12:13.112366 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:13.112355    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-blvcs"
Jul 02 19:12:13.113067 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:12:13.112429    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2b9th" podUID="d0e53e82-59ae-4430-9470-2648eb4eafb4"
Jul 02 19:12:13.113067 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:12:13.112538    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-blvcs" podUID="ef227ade-6225-4022-8c2a-133c62174fa0"
Jul 02 19:12:13.263285 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:13.263259    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lgt7t_38beee50-e2c9-489e-91cb-f1bfad99fabf/ovn-acl-logging/0.log"
Jul 02 19:12:13.263710 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:13.263683    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lgt7t" event={"ID":"38beee50-e2c9-489e-91cb-f1bfad99fabf","Type":"ContainerStarted","Data":"267d7b3dce56b8e380a1f2f45dc21413f9f5c5f0a3b8005b0629cd80b9babcb3"}
Jul 02 19:12:13.263960 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:13.263944    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lgt7t"
Jul 02 19:12:13.264062 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:13.264037    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lgt7t"
Jul 02 19:12:13.264174 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:13.264091    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lgt7t"
Jul 02 19:12:13.279233 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:13.279208    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lgt7t"
Jul 02 19:12:13.279885 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:13.279863    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lgt7t"
Jul 02 19:12:13.296318 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:13.296276    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-lgt7t" podStartSLOduration=10.159615563 podStartE2EDuration="29.296263321s" totalImagesPullingTime="19.136647758s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:11:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:12:13.294757394 +0000 UTC m=+29.658827307" watchObservedRunningTime="2026-07-02 19:12:13.296263321 +0000 UTC m=+29.660333234"
Jul 02 19:12:13.749217 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:13.749191    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-58jxn"]
Jul 02 19:12:13.749367 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:13.749353    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58jxn"
Jul 02 19:12:13.749489 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:12:13.749466    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58jxn" podUID="b4bcbbc3-c3ea-4e9d-ba69-9312e20b21cd"
Jul 02 19:12:13.760730 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:13.760703    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-blvcs"]
Jul 02 19:12:13.760847 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:13.760821    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-blvcs"
Jul 02 19:12:13.760950 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:12:13.760908    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-blvcs" podUID="ef227ade-6225-4022-8c2a-133c62174fa0"
Jul 02 19:12:13.761408 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:13.761382    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2b9th"]
Jul 02 19:12:13.761506 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:13.761495    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2b9th"
Jul 02 19:12:13.761622 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:12:13.761599    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2b9th" podUID="d0e53e82-59ae-4430-9470-2648eb4eafb4"
Jul 02 19:12:14.267673 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:14.267493    2562 generic.go:356] "Generic (PLEG): container finished" podID="2fad0b2e-a705-44f4-91d1-d04cc9eec1e5" containerID="5b44fbde5c4e5a76679fb85689234d903f862f1cf8780b21b3e6000744f5deb3" exitCode=0
Jul 02 19:12:14.268211 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:14.267582    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qw5fs" event={"ID":"2fad0b2e-a705-44f4-91d1-d04cc9eec1e5","Type":"ContainerDied","Data":"5b44fbde5c4e5a76679fb85689234d903f862f1cf8780b21b3e6000744f5deb3"}
Jul 02 19:12:15.112112 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:15.112079    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-blvcs"
Jul 02 19:12:15.112112 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:15.112112    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58jxn"
Jul 02 19:12:15.112316 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:12:15.112180    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-blvcs" podUID="ef227ade-6225-4022-8c2a-133c62174fa0"
Jul 02 19:12:15.112316 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:15.112206    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2b9th"
Jul 02 19:12:15.112316 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:12:15.112294    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58jxn" podUID="b4bcbbc3-c3ea-4e9d-ba69-9312e20b21cd"
Jul 02 19:12:15.112448 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:12:15.112372    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2b9th" podUID="d0e53e82-59ae-4430-9470-2648eb4eafb4"
Jul 02 19:12:16.274956 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:16.274854    2562 generic.go:356] "Generic (PLEG): container finished" podID="2fad0b2e-a705-44f4-91d1-d04cc9eec1e5" containerID="301c2359e5c33991b60f57d3095ecaae582aa8596e24acea51ba33a51861d3d3" exitCode=0
Jul 02 19:12:16.274956 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:16.274929    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qw5fs" event={"ID":"2fad0b2e-a705-44f4-91d1-d04cc9eec1e5","Type":"ContainerDied","Data":"301c2359e5c33991b60f57d3095ecaae582aa8596e24acea51ba33a51861d3d3"}
Jul 02 19:12:17.112348 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:17.112310    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-blvcs"
Jul 02 19:12:17.112538 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:17.112422    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58jxn"
Jul 02 19:12:17.112538 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:12:17.112437    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-blvcs" podUID="ef227ade-6225-4022-8c2a-133c62174fa0"
Jul 02 19:12:17.112538 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:17.112450    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2b9th"
Jul 02 19:12:17.112538 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:12:17.112530    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58jxn" podUID="b4bcbbc3-c3ea-4e9d-ba69-9312e20b21cd"
Jul 02 19:12:17.112705 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:12:17.112613    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2b9th" podUID="d0e53e82-59ae-4430-9470-2648eb4eafb4"
Jul 02 19:12:17.726214 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:17.726180    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0e53e82-59ae-4430-9470-2648eb4eafb4-metrics-certs\") pod \"network-metrics-daemon-2b9th\" (UID: \"d0e53e82-59ae-4430-9470-2648eb4eafb4\") " pod="openshift-multus/network-metrics-daemon-2b9th"
Jul 02 19:12:17.726803 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:17.726223    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnh4p\" (UniqueName: \"kubernetes.io/projected/ef227ade-6225-4022-8c2a-133c62174fa0-kube-api-access-hnh4p\") pod \"network-check-target-blvcs\" (UID: \"ef227ade-6225-4022-8c2a-133c62174fa0\") " pod="openshift-network-diagnostics/network-check-target-blvcs"
Jul 02 19:12:17.726803 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:12:17.726362    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:12:17.726803 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:12:17.726392    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 19:12:17.726803 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:12:17.726418    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 19:12:17.726803 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:12:17.726431    2562 projected.go:196] Error preparing data for projected volume kube-api-access-hnh4p for pod openshift-network-diagnostics/network-check-target-blvcs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:12:17.726803 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:12:17.726432    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0e53e82-59ae-4430-9470-2648eb4eafb4-metrics-certs podName:d0e53e82-59ae-4430-9470-2648eb4eafb4 nodeName:}" failed. No retries permitted until 2026-07-02 19:12:49.72641052 +0000 UTC m=+66.090480443 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d0e53e82-59ae-4430-9470-2648eb4eafb4-metrics-certs") pod "network-metrics-daemon-2b9th" (UID: "d0e53e82-59ae-4430-9470-2648eb4eafb4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:12:17.726803 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:12:17.726493    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ef227ade-6225-4022-8c2a-133c62174fa0-kube-api-access-hnh4p podName:ef227ade-6225-4022-8c2a-133c62174fa0 nodeName:}" failed. No retries permitted until 2026-07-02 19:12:49.726475848 +0000 UTC m=+66.090545758 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-hnh4p" (UniqueName: "kubernetes.io/projected/ef227ade-6225-4022-8c2a-133c62174fa0-kube-api-access-hnh4p") pod "network-check-target-blvcs" (UID: "ef227ade-6225-4022-8c2a-133c62174fa0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:12:17.827169 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:17.827129    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b4bcbbc3-c3ea-4e9d-ba69-9312e20b21cd-original-pull-secret\") pod \"global-pull-secret-syncer-58jxn\" (UID: \"b4bcbbc3-c3ea-4e9d-ba69-9312e20b21cd\") " pod="kube-system/global-pull-secret-syncer-58jxn"
Jul 02 19:12:17.827333 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:12:17.827280    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 19:12:17.827379 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:12:17.827341    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4bcbbc3-c3ea-4e9d-ba69-9312e20b21cd-original-pull-secret podName:b4bcbbc3-c3ea-4e9d-ba69-9312e20b21cd nodeName:}" failed. No retries permitted until 2026-07-02 19:12:49.827326961 +0000 UTC m=+66.191396852 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b4bcbbc3-c3ea-4e9d-ba69-9312e20b21cd-original-pull-secret") pod "global-pull-secret-syncer-58jxn" (UID: "b4bcbbc3-c3ea-4e9d-ba69-9312e20b21cd") : object "kube-system"/"original-pull-secret" not registered
Jul 02 19:12:18.897595 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:18.897530    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-38.ec2.internal" event="NodeReady"
Jul 02 19:12:18.897987 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:18.897671    2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 02 19:12:18.966575 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:18.966545    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-bdfpb"]
Jul 02 19:12:18.970056 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:18.970030    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-pl552"]
Jul 02 19:12:18.970194 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:18.970169    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bdfpb"
Jul 02 19:12:18.973022 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:18.972996    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9snh5\""
Jul 02 19:12:18.973261 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:18.973243    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 02 19:12:18.974639 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:18.974617    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 02 19:12:18.976372 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:18.976352    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pl552"
Jul 02 19:12:18.981324 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:18.981295    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 02 19:12:18.981426 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:18.981375    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 02 19:12:18.981496 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:18.981303    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 02 19:12:18.981728 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:18.981708    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-gv77g\""
Jul 02 19:12:18.983714 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:18.982432    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bdfpb"]
Jul 02 19:12:18.984882 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:18.984832    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pl552"]
Jul 02 19:12:19.078437 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:19.078392    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:12:19.112317 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:19.112275    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58jxn"
Jul 02 19:12:19.112481 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:19.112286    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2b9th"
Jul 02 19:12:19.112481 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:19.112398    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-blvcs"
Jul 02 19:12:19.115550 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:19.115424    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 02 19:12:19.115550 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:19.115438    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 02 19:12:19.115550 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:19.115448    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-shdtl\""
Jul 02 19:12:19.115736 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:19.115613    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bjk9g\""
Jul 02 19:12:19.115845 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:19.115830    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 02 19:12:19.115948 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:19.115908    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 02 19:12:19.134929 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:19.134896    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2s5js\" (UniqueName: \"kubernetes.io/projected/186d4a7b-65a2-4613-92bf-5bbeee5f6a56-kube-api-access-2s5js\") pod \"ingress-canary-pl552\" (UID: \"186d4a7b-65a2-4613-92bf-5bbeee5f6a56\") " pod="openshift-ingress-canary/ingress-canary-pl552"
Jul 02 19:12:19.135014 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:19.134973    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f923f505-7d21-406b-ae68-e3cb0606b23c-tmp-dir\") pod \"dns-default-bdfpb\" (UID: \"f923f505-7d21-406b-ae68-e3cb0606b23c\") " pod="openshift-dns/dns-default-bdfpb"
Jul 02 19:12:19.135014 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:19.135000    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f923f505-7d21-406b-ae68-e3cb0606b23c-config-volume\") pod \"dns-default-bdfpb\" (UID: \"f923f505-7d21-406b-ae68-e3cb0606b23c\") " pod="openshift-dns/dns-default-bdfpb"
Jul 02 19:12:19.135090 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:19.135015    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f923f505-7d21-406b-ae68-e3cb0606b23c-metrics-tls\") pod \"dns-default-bdfpb\" (UID: \"f923f505-7d21-406b-ae68-e3cb0606b23c\") " pod="openshift-dns/dns-default-bdfpb"
Jul 02 19:12:19.135090 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:19.135030    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/186d4a7b-65a2-4613-92bf-5bbeee5f6a56-cert\") pod \"ingress-canary-pl552\" (UID: \"186d4a7b-65a2-4613-92bf-5bbeee5f6a56\") " pod="openshift-ingress-canary/ingress-canary-pl552"
Jul 02 19:12:19.135090 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:19.135056    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wfz4\" (UniqueName: \"kubernetes.io/projected/f923f505-7d21-406b-ae68-e3cb0606b23c-kube-api-access-4wfz4\") pod \"dns-default-bdfpb\" (UID: \"f923f505-7d21-406b-ae68-e3cb0606b23c\") " pod="openshift-dns/dns-default-bdfpb"
Jul 02 19:12:19.236121 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:19.236049    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2s5js\" (UniqueName: \"kubernetes.io/projected/186d4a7b-65a2-4613-92bf-5bbeee5f6a56-kube-api-access-2s5js\") pod \"ingress-canary-pl552\" (UID: \"186d4a7b-65a2-4613-92bf-5bbeee5f6a56\") " pod="openshift-ingress-canary/ingress-canary-pl552"
Jul 02 19:12:19.236278 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:19.236131    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f923f505-7d21-406b-ae68-e3cb0606b23c-tmp-dir\") pod \"dns-default-bdfpb\" (UID: \"f923f505-7d21-406b-ae68-e3cb0606b23c\") " pod="openshift-dns/dns-default-bdfpb"
Jul 02 19:12:19.236278 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:19.236162    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f923f505-7d21-406b-ae68-e3cb0606b23c-config-volume\") pod \"dns-default-bdfpb\" (UID: \"f923f505-7d21-406b-ae68-e3cb0606b23c\") " pod="openshift-dns/dns-default-bdfpb"
Jul 02 19:12:19.236278 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:19.236184    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f923f505-7d21-406b-ae68-e3cb0606b23c-metrics-tls\") pod \"dns-default-bdfpb\" (UID: \"f923f505-7d21-406b-ae68-e3cb0606b23c\") " pod="openshift-dns/dns-default-bdfpb"
Jul 02 19:12:19.236278 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:19.236207    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/186d4a7b-65a2-4613-92bf-5bbeee5f6a56-cert\") pod \"ingress-canary-pl552\" (UID: \"186d4a7b-65a2-4613-92bf-5bbeee5f6a56\") " pod="openshift-ingress-canary/ingress-canary-pl552"
Jul 02 19:12:19.236278 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:19.236232    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wfz4\" (UniqueName: \"kubernetes.io/projected/f923f505-7d21-406b-ae68-e3cb0606b23c-kube-api-access-4wfz4\") pod \"dns-default-bdfpb\" (UID: \"f923f505-7d21-406b-ae68-e3cb0606b23c\") " pod="openshift-dns/dns-default-bdfpb"
Jul 02 19:12:19.236503 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:12:19.236322    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 19:12:19.236503 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:12:19.236388    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f923f505-7d21-406b-ae68-e3cb0606b23c-metrics-tls podName:f923f505-7d21-406b-ae68-e3cb0606b23c nodeName:}" failed. No retries permitted until 2026-07-02 19:12:19.736367602 +0000 UTC m=+36.100437497 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f923f505-7d21-406b-ae68-e3cb0606b23c-metrics-tls") pod "dns-default-bdfpb" (UID: "f923f505-7d21-406b-ae68-e3cb0606b23c") : secret "dns-default-metrics-tls" not found
Jul 02 19:12:19.236611 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:19.236581    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f923f505-7d21-406b-ae68-e3cb0606b23c-tmp-dir\") pod \"dns-default-bdfpb\" (UID: \"f923f505-7d21-406b-ae68-e3cb0606b23c\") " pod="openshift-dns/dns-default-bdfpb"
Jul 02 19:12:19.236824 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:19.236802    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f923f505-7d21-406b-ae68-e3cb0606b23c-config-volume\") pod \"dns-default-bdfpb\" (UID: \"f923f505-7d21-406b-ae68-e3cb0606b23c\") " pod="openshift-dns/dns-default-bdfpb"
Jul 02 19:12:19.240443 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:19.240423    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/186d4a7b-65a2-4613-92bf-5bbeee5f6a56-cert\") pod \"ingress-canary-pl552\" (UID: \"186d4a7b-65a2-4613-92bf-5bbeee5f6a56\") " pod="openshift-ingress-canary/ingress-canary-pl552"
Jul 02 19:12:19.245929 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:19.245883    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2s5js\" (UniqueName: \"kubernetes.io/projected/186d4a7b-65a2-4613-92bf-5bbeee5f6a56-kube-api-access-2s5js\") pod \"ingress-canary-pl552\" (UID: \"186d4a7b-65a2-4613-92bf-5bbeee5f6a56\") " pod="openshift-ingress-canary/ingress-canary-pl552"
Jul 02 19:12:19.246634 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:19.246613    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wfz4\" (UniqueName: \"kubernetes.io/projected/f923f505-7d21-406b-ae68-e3cb0606b23c-kube-api-access-4wfz4\") pod \"dns-default-bdfpb\" (UID: \"f923f505-7d21-406b-ae68-e3cb0606b23c\") " pod="openshift-dns/dns-default-bdfpb"
Jul 02 19:12:19.293540 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:19.293516    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pl552"
Jul 02 19:12:19.429140 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:19.428906    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pl552"]
Jul 02 19:12:19.431617 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:12:19.431591    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod186d4a7b_65a2_4613_92bf_5bbeee5f6a56.slice/crio-6475c4cd5089e9d450c9ad73a2bb509cafbbc0619dd2e64c68abbc8f410d5ee7 WatchSource:0}: Error finding container 6475c4cd5089e9d450c9ad73a2bb509cafbbc0619dd2e64c68abbc8f410d5ee7: Status 404 returned error can't find the container with id 6475c4cd5089e9d450c9ad73a2bb509cafbbc0619dd2e64c68abbc8f410d5ee7
Jul 02 19:12:19.740968 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:19.740934    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f923f505-7d21-406b-ae68-e3cb0606b23c-metrics-tls\") pod \"dns-default-bdfpb\" (UID: \"f923f505-7d21-406b-ae68-e3cb0606b23c\") " pod="openshift-dns/dns-default-bdfpb"
Jul 02 19:12:19.741122 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:12:19.741106    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 19:12:19.741194 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:12:19.741170    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f923f505-7d21-406b-ae68-e3cb0606b23c-metrics-tls podName:f923f505-7d21-406b-ae68-e3cb0606b23c nodeName:}" failed. No retries permitted until 2026-07-02 19:12:20.741151346 +0000 UTC m=+37.105221257 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f923f505-7d21-406b-ae68-e3cb0606b23c-metrics-tls") pod "dns-default-bdfpb" (UID: "f923f505-7d21-406b-ae68-e3cb0606b23c") : secret "dns-default-metrics-tls" not found
Jul 02 19:12:20.287155 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:20.287115    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pl552" event={"ID":"186d4a7b-65a2-4613-92bf-5bbeee5f6a56","Type":"ContainerStarted","Data":"6475c4cd5089e9d450c9ad73a2bb509cafbbc0619dd2e64c68abbc8f410d5ee7"}
Jul 02 19:12:20.749099 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:20.749007    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f923f505-7d21-406b-ae68-e3cb0606b23c-metrics-tls\") pod \"dns-default-bdfpb\" (UID: \"f923f505-7d21-406b-ae68-e3cb0606b23c\") " pod="openshift-dns/dns-default-bdfpb"
Jul 02 19:12:20.749262 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:12:20.749207    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 19:12:20.749262 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:12:20.749261    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f923f505-7d21-406b-ae68-e3cb0606b23c-metrics-tls podName:f923f505-7d21-406b-ae68-e3cb0606b23c nodeName:}" failed. No retries permitted until 2026-07-02 19:12:22.749246701 +0000 UTC m=+39.113316605 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f923f505-7d21-406b-ae68-e3cb0606b23c-metrics-tls") pod "dns-default-bdfpb" (UID: "f923f505-7d21-406b-ae68-e3cb0606b23c") : secret "dns-default-metrics-tls" not found
Jul 02 19:12:22.765228 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:22.765198    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f923f505-7d21-406b-ae68-e3cb0606b23c-metrics-tls\") pod \"dns-default-bdfpb\" (UID: \"f923f505-7d21-406b-ae68-e3cb0606b23c\") " pod="openshift-dns/dns-default-bdfpb"
Jul 02 19:12:22.765546 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:12:22.765354    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 19:12:22.765546 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:12:22.765417    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f923f505-7d21-406b-ae68-e3cb0606b23c-metrics-tls podName:f923f505-7d21-406b-ae68-e3cb0606b23c nodeName:}" failed. No retries permitted until 2026-07-02 19:12:26.765396857 +0000 UTC m=+43.129466764 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f923f505-7d21-406b-ae68-e3cb0606b23c-metrics-tls") pod "dns-default-bdfpb" (UID: "f923f505-7d21-406b-ae68-e3cb0606b23c") : secret "dns-default-metrics-tls" not found
Jul 02 19:12:23.295986 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:23.295951    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pl552" event={"ID":"186d4a7b-65a2-4613-92bf-5bbeee5f6a56","Type":"ContainerStarted","Data":"fe1bf5fdbbaaa654db1cf3f4afd3749d50f1b7a7683f8e728c78a29c1e450702"}
Jul 02 19:12:23.298863 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:23.298836    2562 generic.go:356] "Generic (PLEG): container finished" podID="2fad0b2e-a705-44f4-91d1-d04cc9eec1e5" containerID="430c7eb55eb62bb7af15a6b2b08eb3e14c5c6eb415c5d1ae33f3c963190a1884" exitCode=0
Jul 02 19:12:23.298982 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:23.298887    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qw5fs" event={"ID":"2fad0b2e-a705-44f4-91d1-d04cc9eec1e5","Type":"ContainerDied","Data":"430c7eb55eb62bb7af15a6b2b08eb3e14c5c6eb415c5d1ae33f3c963190a1884"}
Jul 02 19:12:23.315557 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:23.315516    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-pl552" podStartSLOduration=2.104775738 podStartE2EDuration="5.315502851s" totalImagesPullingTime="3.210727113s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:12:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:12:23.314786009 +0000 UTC m=+39.678855927" watchObservedRunningTime="2026-07-02 19:12:23.315502851 +0000 UTC m=+39.679572763"
Jul 02 19:12:24.307195 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:24.307000    2562 generic.go:356] "Generic (PLEG): container finished" podID="2fad0b2e-a705-44f4-91d1-d04cc9eec1e5" containerID="8c3749b586338f279963ffe5a1f092c5a55c49b021bb0fcd2b0bd4612d5a28ce" exitCode=0
Jul 02 19:12:24.307590 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:24.307089    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qw5fs" event={"ID":"2fad0b2e-a705-44f4-91d1-d04cc9eec1e5","Type":"ContainerDied","Data":"8c3749b586338f279963ffe5a1f092c5a55c49b021bb0fcd2b0bd4612d5a28ce"}
Jul 02 19:12:24.791322 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:24.791241    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:12:24.851173 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:24.851132    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:12:25.313450 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:25.313421    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qw5fs" event={"ID":"2fad0b2e-a705-44f4-91d1-d04cc9eec1e5","Type":"ContainerStarted","Data":"7b84515dbc91370a82e4d774c4d116d56c2e5178c0da9549b35c600b3f4b3679"}
Jul 02 19:12:25.342268 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:25.342223    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-qw5fs" podStartSLOduration=9.035306938 podStartE2EDuration="41.342205457s" totalImagesPullingTime="32.306898519s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:11:44 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:12:25.340894506 +0000 UTC m=+41.704964416" watchObservedRunningTime="2026-07-02 19:12:25.342205457 +0000 UTC m=+41.706275353"
Jul 02 19:12:25.467353 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:25.467321    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:12:25.534860 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:25.534792    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:12:25.599314 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:25.599237    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:12:25.668054 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:25.668023    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:12:26.797473 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:26.797443    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f923f505-7d21-406b-ae68-e3cb0606b23c-metrics-tls\") pod \"dns-default-bdfpb\" (UID: \"f923f505-7d21-406b-ae68-e3cb0606b23c\") " pod="openshift-dns/dns-default-bdfpb"
Jul 02 19:12:26.797845 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:12:26.797555    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 19:12:26.797845 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:12:26.797608    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f923f505-7d21-406b-ae68-e3cb0606b23c-metrics-tls podName:f923f505-7d21-406b-ae68-e3cb0606b23c nodeName:}" failed. No retries permitted until 2026-07-02 19:12:34.797594213 +0000 UTC m=+51.161664104 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f923f505-7d21-406b-ae68-e3cb0606b23c-metrics-tls") pod "dns-default-bdfpb" (UID: "f923f505-7d21-406b-ae68-e3cb0606b23c") : secret "dns-default-metrics-tls" not found
Jul 02 19:12:27.325780 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:27.325709    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:12:27.426288 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:27.426264    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:12:30.230453 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:30.230422    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:12:30.296925 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:30.296896    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:12:33.840567 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:33.840538    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:12:34.849848 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:34.849805    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f923f505-7d21-406b-ae68-e3cb0606b23c-metrics-tls\") pod \"dns-default-bdfpb\" (UID: \"f923f505-7d21-406b-ae68-e3cb0606b23c\") " pod="openshift-dns/dns-default-bdfpb"
Jul 02 19:12:34.850238 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:12:34.849944    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 19:12:34.850238 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:12:34.850008    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f923f505-7d21-406b-ae68-e3cb0606b23c-metrics-tls podName:f923f505-7d21-406b-ae68-e3cb0606b23c nodeName:}" failed. No retries permitted until 2026-07-02 19:12:50.849994944 +0000 UTC m=+67.214064835 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f923f505-7d21-406b-ae68-e3cb0606b23c-metrics-tls") pod "dns-default-bdfpb" (UID: "f923f505-7d21-406b-ae68-e3cb0606b23c") : secret "dns-default-metrics-tls" not found
Jul 02 19:12:44.548688 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:44.548658    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:12:44.649805 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:44.649771    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:12:45.288540 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:45.288508    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lgt7t"
Jul 02 19:12:45.417563 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:45.417532    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:12:45.485245 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:45.485204    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:12:46.502887 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:46.502853    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cdff566b4-sk2d9"]
Jul 02 19:12:46.505175 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:46.505158    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cdff566b4-sk2d9"
Jul 02 19:12:46.508131 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:46.508114    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 02 19:12:46.509381 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:46.509363    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 02 19:12:46.509494 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:46.509392    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 02 19:12:46.509494 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:46.509413    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-d794w\""
Jul 02 19:12:46.509494 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:46.509448    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 02 19:12:46.518635 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:46.518609    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cdff566b4-sk2d9"]
Jul 02 19:12:46.532727 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:46.532698    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rs8r\" (UniqueName: \"kubernetes.io/projected/f86c2979-cffa-4f58-b22b-ac977c2208ed-kube-api-access-5rs8r\") pod \"managed-serviceaccount-addon-agent-cdff566b4-sk2d9\" (UID: \"f86c2979-cffa-4f58-b22b-ac977c2208ed\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cdff566b4-sk2d9"
Jul 02 19:12:46.532865 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:46.532761    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f86c2979-cffa-4f58-b22b-ac977c2208ed-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-cdff566b4-sk2d9\" (UID: \"f86c2979-cffa-4f58-b22b-ac977c2208ed\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cdff566b4-sk2d9"
Jul 02 19:12:46.633437 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:46.633399    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f86c2979-cffa-4f58-b22b-ac977c2208ed-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-cdff566b4-sk2d9\" (UID: \"f86c2979-cffa-4f58-b22b-ac977c2208ed\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cdff566b4-sk2d9"
Jul 02 19:12:46.633613 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:46.633497    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rs8r\" (UniqueName: \"kubernetes.io/projected/f86c2979-cffa-4f58-b22b-ac977c2208ed-kube-api-access-5rs8r\") pod \"managed-serviceaccount-addon-agent-cdff566b4-sk2d9\" (UID: \"f86c2979-cffa-4f58-b22b-ac977c2208ed\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cdff566b4-sk2d9"
Jul 02 19:12:46.637339 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:46.637314    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f86c2979-cffa-4f58-b22b-ac977c2208ed-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-cdff566b4-sk2d9\" (UID: \"f86c2979-cffa-4f58-b22b-ac977c2208ed\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cdff566b4-sk2d9"
Jul 02 19:12:46.642643 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:46.642618    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rs8r\" (UniqueName: \"kubernetes.io/projected/f86c2979-cffa-4f58-b22b-ac977c2208ed-kube-api-access-5rs8r\") pod \"managed-serviceaccount-addon-agent-cdff566b4-sk2d9\" (UID: \"f86c2979-cffa-4f58-b22b-ac977c2208ed\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cdff566b4-sk2d9"
Jul 02 19:12:46.827076 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:46.826989    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cdff566b4-sk2d9"
Jul 02 19:12:46.947817 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:46.947783    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cdff566b4-sk2d9"]
Jul 02 19:12:46.950463 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:12:46.950437    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf86c2979_cffa_4f58_b22b_ac977c2208ed.slice/crio-649007179a016820456b3b3cdf61b307165c853d3027a5fa2ff801b22735d282 WatchSource:0}: Error finding container 649007179a016820456b3b3cdf61b307165c853d3027a5fa2ff801b22735d282: Status 404 returned error can't find the container with id 649007179a016820456b3b3cdf61b307165c853d3027a5fa2ff801b22735d282
Jul 02 19:12:47.363862 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:47.363829    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cdff566b4-sk2d9" event={"ID":"f86c2979-cffa-4f58-b22b-ac977c2208ed","Type":"ContainerStarted","Data":"649007179a016820456b3b3cdf61b307165c853d3027a5fa2ff801b22735d282"}
Jul 02 19:12:49.758238 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:49.758193    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0e53e82-59ae-4430-9470-2648eb4eafb4-metrics-certs\") pod \"network-metrics-daemon-2b9th\" (UID: \"d0e53e82-59ae-4430-9470-2648eb4eafb4\") " pod="openshift-multus/network-metrics-daemon-2b9th"
Jul 02 19:12:49.758690 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:49.758247    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnh4p\" (UniqueName: \"kubernetes.io/projected/ef227ade-6225-4022-8c2a-133c62174fa0-kube-api-access-hnh4p\") pod \"network-check-target-blvcs\" (UID: \"ef227ade-6225-4022-8c2a-133c62174fa0\") " pod="openshift-network-diagnostics/network-check-target-blvcs"
Jul 02 19:12:49.761175 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:49.761153    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 02 19:12:49.761303 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:49.761203    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 02 19:12:49.768657 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:12:49.768623    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 02 19:12:49.768736 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:12:49.768695    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0e53e82-59ae-4430-9470-2648eb4eafb4-metrics-certs podName:d0e53e82-59ae-4430-9470-2648eb4eafb4 nodeName:}" failed. No retries permitted until 2026-07-02 19:13:53.76867643 +0000 UTC m=+130.132746321 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d0e53e82-59ae-4430-9470-2648eb4eafb4-metrics-certs") pod "network-metrics-daemon-2b9th" (UID: "d0e53e82-59ae-4430-9470-2648eb4eafb4") : secret "metrics-daemon-secret" not found
Jul 02 19:12:49.771235 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:49.771219    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 02 19:12:49.781337 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:49.781310    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnh4p\" (UniqueName: \"kubernetes.io/projected/ef227ade-6225-4022-8c2a-133c62174fa0-kube-api-access-hnh4p\") pod \"network-check-target-blvcs\" (UID: \"ef227ade-6225-4022-8c2a-133c62174fa0\") " pod="openshift-network-diagnostics/network-check-target-blvcs"
Jul 02 19:12:49.859533 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:49.859495    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b4bcbbc3-c3ea-4e9d-ba69-9312e20b21cd-original-pull-secret\") pod \"global-pull-secret-syncer-58jxn\" (UID: \"b4bcbbc3-c3ea-4e9d-ba69-9312e20b21cd\") " pod="kube-system/global-pull-secret-syncer-58jxn"
Jul 02 19:12:49.862614 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:49.862598    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 02 19:12:49.872325 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:49.872298    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b4bcbbc3-c3ea-4e9d-ba69-9312e20b21cd-original-pull-secret\") pod \"global-pull-secret-syncer-58jxn\" (UID: \"b4bcbbc3-c3ea-4e9d-ba69-9312e20b21cd\") " pod="kube-system/global-pull-secret-syncer-58jxn"
Jul 02 19:12:50.022143 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:50.022054    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58jxn"
Jul 02 19:12:50.034347 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:50.034323    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bjk9g\""
Jul 02 19:12:50.041907 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:50.041880    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-blvcs"
Jul 02 19:12:50.173201 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:50.173163    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-58jxn"]
Jul 02 19:12:50.177154 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:12:50.177125    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4bcbbc3_c3ea_4e9d_ba69_9312e20b21cd.slice/crio-2f141eff4012d5afd1038b3c9db8ab552efddcf2a495a2bf742677ef3557bea2 WatchSource:0}: Error finding container 2f141eff4012d5afd1038b3c9db8ab552efddcf2a495a2bf742677ef3557bea2: Status 404 returned error can't find the container with id 2f141eff4012d5afd1038b3c9db8ab552efddcf2a495a2bf742677ef3557bea2
Jul 02 19:12:50.190786 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:50.190759    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-blvcs"]
Jul 02 19:12:50.195376 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:12:50.195353    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef227ade_6225_4022_8c2a_133c62174fa0.slice/crio-bdf6f4ef58ecf3be9d026b4b1ede7f2a2bb22e9a3642a53b40785b2e1589b90a WatchSource:0}: Error finding container bdf6f4ef58ecf3be9d026b4b1ede7f2a2bb22e9a3642a53b40785b2e1589b90a: Status 404 returned error can't find the container with id bdf6f4ef58ecf3be9d026b4b1ede7f2a2bb22e9a3642a53b40785b2e1589b90a
Jul 02 19:12:50.375143 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:50.375045    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cdff566b4-sk2d9" event={"ID":"f86c2979-cffa-4f58-b22b-ac977c2208ed","Type":"ContainerStarted","Data":"def69273c2a914bf4ee14c696ba4129c77eabb26a702e56cbca38d8801ef90c3"}
Jul 02 19:12:50.376251 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:50.376226    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-blvcs" event={"ID":"ef227ade-6225-4022-8c2a-133c62174fa0","Type":"ContainerStarted","Data":"bdf6f4ef58ecf3be9d026b4b1ede7f2a2bb22e9a3642a53b40785b2e1589b90a"}
Jul 02 19:12:50.377324 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:50.377302    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-58jxn" event={"ID":"b4bcbbc3-c3ea-4e9d-ba69-9312e20b21cd","Type":"ContainerStarted","Data":"2f141eff4012d5afd1038b3c9db8ab552efddcf2a495a2bf742677ef3557bea2"}
Jul 02 19:12:50.392638 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:50.392595    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cdff566b4-sk2d9" podStartSLOduration=1.964527362 podStartE2EDuration="4.392580833s" totalImagesPullingTime="2.428053471s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:12:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:12:50.391687284 +0000 UTC m=+66.755757219" watchObservedRunningTime="2026-07-02 19:12:50.392580833 +0000 UTC m=+66.756650745"
Jul 02 19:12:50.867556 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:50.867513    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f923f505-7d21-406b-ae68-e3cb0606b23c-metrics-tls\") pod \"dns-default-bdfpb\" (UID: \"f923f505-7d21-406b-ae68-e3cb0606b23c\") " pod="openshift-dns/dns-default-bdfpb"
Jul 02 19:12:50.867993 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:12:50.867699    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 19:12:50.867993 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:12:50.867759    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f923f505-7d21-406b-ae68-e3cb0606b23c-metrics-tls podName:f923f505-7d21-406b-ae68-e3cb0606b23c nodeName:}" failed. No retries permitted until 2026-07-02 19:13:22.867745733 +0000 UTC m=+99.231815624 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f923f505-7d21-406b-ae68-e3cb0606b23c-metrics-tls") pod "dns-default-bdfpb" (UID: "f923f505-7d21-406b-ae68-e3cb0606b23c") : secret "dns-default-metrics-tls" not found
Jul 02 19:12:55.392140 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:55.392098    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-blvcs" event={"ID":"ef227ade-6225-4022-8c2a-133c62174fa0","Type":"ContainerStarted","Data":"850be4db385893e4e679c81f3f86bc606123258b94003f9b6066e65c9a20706b"}
Jul 02 19:12:55.392563 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:55.392192    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-blvcs"
Jul 02 19:12:55.393394 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:55.393376    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-58jxn" event={"ID":"b4bcbbc3-c3ea-4e9d-ba69-9312e20b21cd","Type":"ContainerStarted","Data":"61c94d00f6442776b30dba12ad40462f1ad68dc01a4665149b3ccde7d7530213"}
Jul 02 19:12:55.410317 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:55.410272    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-blvcs" podStartSLOduration=66.990001918 podStartE2EDuration="1m11.4102582s" totalImagesPullingTime="4.420256282s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:11:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:12:55.409658223 +0000 UTC m=+71.773728146" watchObservedRunningTime="2026-07-02 19:12:55.4102582 +0000 UTC m=+71.774328114"
Jul 02 19:12:55.425985 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:12:55.425944    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-58jxn" podStartSLOduration=66.984654366 podStartE2EDuration="1m11.425928775s" totalImagesPullingTime="4.441274409s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:11:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:12:55.42538458 +0000 UTC m=+71.789454505" watchObservedRunningTime="2026-07-02 19:12:55.425928775 +0000 UTC m=+71.789998679"
Jul 02 19:13:22.883884 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:13:22.883753    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f923f505-7d21-406b-ae68-e3cb0606b23c-metrics-tls\") pod \"dns-default-bdfpb\" (UID: \"f923f505-7d21-406b-ae68-e3cb0606b23c\") " pod="openshift-dns/dns-default-bdfpb"
Jul 02 19:13:22.884367 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:13:22.883932    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 19:13:22.884367 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:13:22.884010    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f923f505-7d21-406b-ae68-e3cb0606b23c-metrics-tls podName:f923f505-7d21-406b-ae68-e3cb0606b23c nodeName:}" failed. No retries permitted until 2026-07-02 19:14:26.883989743 +0000 UTC m=+163.248059652 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f923f505-7d21-406b-ae68-e3cb0606b23c-metrics-tls") pod "dns-default-bdfpb" (UID: "f923f505-7d21-406b-ae68-e3cb0606b23c") : secret "dns-default-metrics-tls" not found
Jul 02 19:13:26.398493 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:13:26.398465    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-blvcs"
Jul 02 19:13:53.797227 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:13:53.797186    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0e53e82-59ae-4430-9470-2648eb4eafb4-metrics-certs\") pod \"network-metrics-daemon-2b9th\" (UID: \"d0e53e82-59ae-4430-9470-2648eb4eafb4\") " pod="openshift-multus/network-metrics-daemon-2b9th"
Jul 02 19:13:53.797686 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:13:53.797343    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 02 19:13:53.797686 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:13:53.797414    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0e53e82-59ae-4430-9470-2648eb4eafb4-metrics-certs podName:d0e53e82-59ae-4430-9470-2648eb4eafb4 nodeName:}" failed. No retries permitted until 2026-07-02 19:15:55.79739609 +0000 UTC m=+252.161465992 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d0e53e82-59ae-4430-9470-2648eb4eafb4-metrics-certs") pod "network-metrics-daemon-2b9th" (UID: "d0e53e82-59ae-4430-9470-2648eb4eafb4") : secret "metrics-daemon-secret" not found
Jul 02 19:14:21.987012 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:14:21.986951    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-bdfpb" podUID="f923f505-7d21-406b-ae68-e3cb0606b23c"
Jul 02 19:14:22.127184 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:14:22.127138    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-2b9th" podUID="d0e53e82-59ae-4430-9470-2648eb4eafb4"
Jul 02 19:14:22.599692 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:14:22.599662    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bdfpb"
Jul 02 19:14:26.919384 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:14:26.919332    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f923f505-7d21-406b-ae68-e3cb0606b23c-metrics-tls\") pod \"dns-default-bdfpb\" (UID: \"f923f505-7d21-406b-ae68-e3cb0606b23c\") " pod="openshift-dns/dns-default-bdfpb"
Jul 02 19:14:26.919849 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:14:26.919490    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 19:14:26.919849 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:14:26.919565    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f923f505-7d21-406b-ae68-e3cb0606b23c-metrics-tls podName:f923f505-7d21-406b-ae68-e3cb0606b23c nodeName:}" failed. No retries permitted until 2026-07-02 19:16:28.919549382 +0000 UTC m=+285.283619290 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f923f505-7d21-406b-ae68-e3cb0606b23c-metrics-tls") pod "dns-default-bdfpb" (UID: "f923f505-7d21-406b-ae68-e3cb0606b23c") : secret "dns-default-metrics-tls" not found
Jul 02 19:14:34.113537 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:14:34.113498    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2b9th"
Jul 02 19:14:49.667063 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:14:49.667031    2562 generic.go:356] "Generic (PLEG): container finished" podID="f86c2979-cffa-4f58-b22b-ac977c2208ed" containerID="def69273c2a914bf4ee14c696ba4129c77eabb26a702e56cbca38d8801ef90c3" exitCode=255
Jul 02 19:14:49.667464 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:14:49.667095    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cdff566b4-sk2d9" event={"ID":"f86c2979-cffa-4f58-b22b-ac977c2208ed","Type":"ContainerDied","Data":"def69273c2a914bf4ee14c696ba4129c77eabb26a702e56cbca38d8801ef90c3"}
Jul 02 19:14:49.672435 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:14:49.672418    2562 scope.go:117] "RemoveContainer" containerID="def69273c2a914bf4ee14c696ba4129c77eabb26a702e56cbca38d8801ef90c3"
Jul 02 19:14:50.673048 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:14:50.673017    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cdff566b4-sk2d9" event={"ID":"f86c2979-cffa-4f58-b22b-ac977c2208ed","Type":"ContainerStarted","Data":"61b73e73c2644f80dee691aa1b55fee1f48ffadc7a266b99a24d841c3e6ff351"}
Jul 02 19:15:55.822010 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:15:55.821969    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0e53e82-59ae-4430-9470-2648eb4eafb4-metrics-certs\") pod \"network-metrics-daemon-2b9th\" (UID: \"d0e53e82-59ae-4430-9470-2648eb4eafb4\") " pod="openshift-multus/network-metrics-daemon-2b9th"
Jul 02 19:15:55.822504 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:15:55.822106    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 02 19:15:55.822504 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:15:55.822177    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0e53e82-59ae-4430-9470-2648eb4eafb4-metrics-certs podName:d0e53e82-59ae-4430-9470-2648eb4eafb4 nodeName:}" failed. No retries permitted until 2026-07-02 19:17:57.822160631 +0000 UTC m=+374.186230521 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d0e53e82-59ae-4430-9470-2648eb4eafb4-metrics-certs") pod "network-metrics-daemon-2b9th" (UID: "d0e53e82-59ae-4430-9470-2648eb4eafb4") : secret "metrics-daemon-secret" not found
Jul 02 19:15:57.547698 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:15:57.547661    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vfd6h"]
Jul 02 19:15:57.550423 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:15:57.550407    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-kc8ht"]
Jul 02 19:15:57.550535 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:15:57.550517    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vfd6h"
Jul 02 19:15:57.552876 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:15:57.552859    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7b6dc76c65-jtd7c"]
Jul 02 19:15:57.552993 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:15:57.552965    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-kc8ht"
Jul 02 19:15:57.555326 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:15:57.555309    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7b6dc76c65-jtd7c"
Jul 02 19:15:57.556433 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:15:57.556413    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 02 19:15:57.556541 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:15:57.556415    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 02 19:15:57.556541 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:15:57.556470    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-w2ffm\""
Jul 02 19:15:57.556541 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:15:57.556485    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 02 19:15:57.556700 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:15:57.556418    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 02 19:15:57.560984 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:15:57.560968    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 02 19:15:57.561080 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:15:57.560994    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 02 19:15:57.561196 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:15:57.561181    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 02 19:15:57.561274 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:15:57.561260    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-k8rdn\""
Jul 02 19:15:57.561659 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:15:57.561638    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 02 19:15:57.561882 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:15:57.561863    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 02 19:15:57.561882 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:15:57.561874    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 02 19:15:57.562044 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:15:57.561965    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 02 19:15:57.562044 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:15:57.561969    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-mtsm6\""
Jul 02 19:15:57.562379 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:15:57.562354    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 02 19:15:57.562379 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:15:57.562372    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 02 19:15:57.563479 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:15:57.563324    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 02 19:15:57.570329 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:15:57.570310    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vfd6h"]
Jul 02 19:15:57.576018 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:15:57.576000    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-kc8ht"]
Jul 02 19:15:57.597002 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:15:57.596979    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7b6dc76c65-jtd7c"]
Jul 02 19:15:57.634490 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:15:57.634461    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9df21515-928e-4ce4-a97f-b90af84dbd02-default-certificate\") pod \"router-default-7b6dc76c65-jtd7c\" (UID: \"9df21515-928e-4ce4-a97f-b90af84dbd02\") " pod="openshift-ingress/router-default-7b6dc76c65-jtd7c"
Jul 02 19:15:57.634490 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:15:57.634492    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9df21515-928e-4ce4-a97f-b90af84dbd02-service-ca-bundle\") pod \"router-default-7b6dc76c65-jtd7c\" (UID: \"9df21515-928e-4ce4-a97f-b90af84dbd02\") " pod="openshift-ingress/router-default-7b6dc76c65-jtd7c"
Jul 02 19:15:57.634673 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:15:57.634536    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3639ebc4-c5e8-4a3d-9576-c34de3fb40e4-config\") pod \"service-ca-operator-5d46d9ffd4-kc8ht\" (UID: \"3639ebc4-c5e8-4a3d-9576-c34de3fb40e4\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-kc8ht"
Jul 02 19:15:57.634673 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:15:57.634555    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4c5vk\" (UniqueName: \"kubernetes.io/projected/3639ebc4-c5e8-4a3d-9576-c34de3fb40e4-kube-api-access-4c5vk\") pod \"service-ca-operator-5d46d9ffd4-kc8ht\" (UID: \"3639ebc4-c5e8-4a3d-9576-c34de3fb40e4\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-kc8ht"
Jul 02 19:15:57.634673 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:15:57.634576    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/acf32f4f-6cfd-40a3-8579-d62ea69d5cb6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-vfd6h\" (UID: \"acf32f4f-6cfd-40a3-8579-d62ea69d5cb6\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vfd6h"
Jul 02 19:15:57.634673 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:15:57.634598    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3639ebc4-c5e8-4a3d-9576-c34de3fb40e4-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-kc8ht\" (UID: \"3639ebc4-c5e8-4a3d-9576-c34de3fb40e4\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-kc8ht"
Jul 02 19:15:57.634673 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:15:57.634635    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9df21515-928e-4ce4-a97f-b90af84dbd02-stats-auth\") pod \"router-default-7b6dc76c65-jtd7c\" (UID: \"9df21515-928e-4ce4-a97f-b90af84dbd02\") " pod="openshift-ingress/router-default-7b6dc76c65-jtd7c"
Jul 02 19:15:57.634673 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:15:57.634650    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9df21515-928e-4ce4-a97f-b90af84dbd02-metrics-certs\") pod \"router-default-7b6dc76c65-jtd7c\" (UID: \"9df21515-928e-4ce4-a97f-b90af84dbd02\") " pod="openshift-ingress/router-default-7b6dc76c65-jtd7c"
Jul 02 19:15:57.634849 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:15:57.634685    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/acf32f4f-6cfd-40a3-8579-d62ea69d5cb6-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-vfd6h\" (UID: \"acf32f4f-6cfd-40a3-8579-d62ea69d5cb6\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vfd6h"
Jul 02 19:15:57.634849 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:15:57.634730    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hq62z\" (UniqueName: \"kubernetes.io/projected/9df21515-928e-4ce4-a97f-b90af84dbd02-kube-api-access-hq62z\") pod \"router-default-7b6dc76c65-jtd7c\" (UID: \"9df21515-928e-4ce4-a97f-b90af84dbd02\") " pod="openshift-ingress/router-default-7b6dc76c65-jtd7c"
Jul 02 19:15:57.634849 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:15:57.634748    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rv4pn\" (UniqueName: \"kubernetes.io/projected/acf32f4f-6cfd-40a3-8579-d62ea69d5cb6-kube-api-access-rv4pn\") pod \"cluster-monitoring-operator-64786d9cbb-vfd6h\" (UID: \"acf32f4f-6cfd-40a3-8579-d62ea69d5cb6\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vfd6h"
Jul 02 19:15:57.735637 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:15:57.735599    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9df21515-928e-4ce4-a97f-b90af84dbd02-default-certificate\") pod \"router-default-7b6dc76c65-jtd7c\" (UID: \"9df21515-928e-4ce4-a97f-b90af84dbd02\") " pod="openshift-ingress/router-default-7b6dc76c65-jtd7c"
Jul 02 19:15:57.735637 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:15:57.735636    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9df21515-928e-4ce4-a97f-b90af84dbd02-service-ca-bundle\") pod \"router-default-7b6dc76c65-jtd7c\" (UID: \"9df21515-928e-4ce4-a97f-b90af84dbd02\") " pod="openshift-ingress/router-default-7b6dc76c65-jtd7c"
Jul 02 19:15:57.735852 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:15:57.735660    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3639ebc4-c5e8-4a3d-9576-c34de3fb40e4-config\") pod \"service-ca-operator-5d46d9ffd4-kc8ht\" (UID: \"3639ebc4-c5e8-4a3d-9576-c34de3fb40e4\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-kc8ht"
Jul 02 19:15:57.735852 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:15:57.735680    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4c5vk\" (UniqueName: \"kubernetes.io/projected/3639ebc4-c5e8-4a3d-9576-c34de3fb40e4-kube-api-access-4c5vk\") pod \"service-ca-operator-5d46d9ffd4-kc8ht\" (UID: \"3639ebc4-c5e8-4a3d-9576-c34de3fb40e4\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-kc8ht"
Jul 02 19:15:57.735852 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:15:57.735699    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/acf32f4f-6cfd-40a3-8579-d62ea69d5cb6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-vfd6h\" (UID: \"acf32f4f-6cfd-40a3-8579-d62ea69d5cb6\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vfd6h"
Jul 02 19:15:57.735852 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:15:57.735728    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3639ebc4-c5e8-4a3d-9576-c34de3fb40e4-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-kc8ht\" (UID: \"3639ebc4-c5e8-4a3d-9576-c34de3fb40e4\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-kc8ht"
Jul 02 19:15:57.735852 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:15:57.735833    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 02 19:15:57.736126 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:15:57.735894    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9df21515-928e-4ce4-a97f-b90af84dbd02-service-ca-bundle podName:9df21515-928e-4ce4-a97f-b90af84dbd02 nodeName:}" failed. No retries permitted until 2026-07-02 19:15:58.235875946 +0000 UTC m=+254.599945840 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9df21515-928e-4ce4-a97f-b90af84dbd02-service-ca-bundle") pod "router-default-7b6dc76c65-jtd7c" (UID: "9df21515-928e-4ce4-a97f-b90af84dbd02") : configmap references non-existent config key: service-ca.crt
Jul 02 19:15:57.736126 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:15:57.735959    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acf32f4f-6cfd-40a3-8579-d62ea69d5cb6-cluster-monitoring-operator-tls podName:acf32f4f-6cfd-40a3-8579-d62ea69d5cb6 nodeName:}" failed. No retries permitted until 2026-07-02 19:15:58.235946045 +0000 UTC m=+254.600015950 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/acf32f4f-6cfd-40a3-8579-d62ea69d5cb6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-vfd6h" (UID: "acf32f4f-6cfd-40a3-8579-d62ea69d5cb6") : secret "cluster-monitoring-operator-tls" not found
Jul 02 19:15:57.736126 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:15:57.735981    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9df21515-928e-4ce4-a97f-b90af84dbd02-stats-auth\") pod \"router-default-7b6dc76c65-jtd7c\" (UID: \"9df21515-928e-4ce4-a97f-b90af84dbd02\") " pod="openshift-ingress/router-default-7b6dc76c65-jtd7c"
Jul 02 19:15:57.736126 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:15:57.735999    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9df21515-928e-4ce4-a97f-b90af84dbd02-metrics-certs\") pod \"router-default-7b6dc76c65-jtd7c\" (UID: \"9df21515-928e-4ce4-a97f-b90af84dbd02\") " pod="openshift-ingress/router-default-7b6dc76c65-jtd7c"
Jul 02 19:15:57.736126 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:15:57.736059    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/acf32f4f-6cfd-40a3-8579-d62ea69d5cb6-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-vfd6h\" (UID: \"acf32f4f-6cfd-40a3-8579-d62ea69d5cb6\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vfd6h"
Jul 02 19:15:57.736126 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:15:57.736088    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hq62z\" (UniqueName: \"kubernetes.io/projected/9df21515-928e-4ce4-a97f-b90af84dbd02-kube-api-access-hq62z\") pod \"router-default-7b6dc76c65-jtd7c\" (UID: \"9df21515-928e-4ce4-a97f-b90af84dbd02\") " pod="openshift-ingress/router-default-7b6dc76c65-jtd7c"
Jul 02 19:15:57.736126 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:15:57.736109    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rv4pn\" (UniqueName: \"kubernetes.io/projected/acf32f4f-6cfd-40a3-8579-d62ea69d5cb6-kube-api-access-rv4pn\") pod \"cluster-monitoring-operator-64786d9cbb-vfd6h\" (UID: \"acf32f4f-6cfd-40a3-8579-d62ea69d5cb6\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vfd6h"
Jul 02 19:15:57.736850 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:15:57.736171    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 02 19:15:57.736850 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:15:57.736219    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9df21515-928e-4ce4-a97f-b90af84dbd02-metrics-certs podName:9df21515-928e-4ce4-a97f-b90af84dbd02 nodeName:}" failed. No retries permitted until 2026-07-02 19:15:58.236203753 +0000 UTC m=+254.600273647 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9df21515-928e-4ce4-a97f-b90af84dbd02-metrics-certs") pod "router-default-7b6dc76c65-jtd7c" (UID: "9df21515-928e-4ce4-a97f-b90af84dbd02") : secret "router-metrics-certs-default" not found
Jul 02 19:15:57.736850 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:15:57.736821    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3639ebc4-c5e8-4a3d-9576-c34de3fb40e4-config\") pod \"service-ca-operator-5d46d9ffd4-kc8ht\" (UID: \"3639ebc4-c5e8-4a3d-9576-c34de3fb40e4\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-kc8ht"
Jul 02 19:15:57.737396 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:15:57.737373    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/acf32f4f-6cfd-40a3-8579-d62ea69d5cb6-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-vfd6h\" (UID: \"acf32f4f-6cfd-40a3-8579-d62ea69d5cb6\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vfd6h"
Jul 02 19:15:57.738824 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:15:57.738803    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9df21515-928e-4ce4-a97f-b90af84dbd02-default-certificate\") pod \"router-default-7b6dc76c65-jtd7c\" (UID: \"9df21515-928e-4ce4-a97f-b90af84dbd02\") " pod="openshift-ingress/router-default-7b6dc76c65-jtd7c"
Jul 02 19:15:57.741826 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:15:57.741807    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3639ebc4-c5e8-4a3d-9576-c34de3fb40e4-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-kc8ht\" (UID: \"3639ebc4-c5e8-4a3d-9576-c34de3fb40e4\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-kc8ht"
Jul 02 19:15:57.741973 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:15:57.741957    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9df21515-928e-4ce4-a97f-b90af84dbd02-stats-auth\") pod \"router-default-7b6dc76c65-jtd7c\" (UID: \"9df21515-928e-4ce4-a97f-b90af84dbd02\") " pod="openshift-ingress/router-default-7b6dc76c65-jtd7c"
Jul 02 19:15:57.749942 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:15:57.749901    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4c5vk\" (UniqueName: \"kubernetes.io/projected/3639ebc4-c5e8-4a3d-9576-c34de3fb40e4-kube-api-access-4c5vk\") pod \"service-ca-operator-5d46d9ffd4-kc8ht\" (UID: \"3639ebc4-c5e8-4a3d-9576-c34de3fb40e4\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-kc8ht"
Jul 02 19:15:57.750499 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:15:57.750483    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hq62z\" (UniqueName: \"kubernetes.io/projected/9df21515-928e-4ce4-a97f-b90af84dbd02-kube-api-access-hq62z\") pod \"router-default-7b6dc76c65-jtd7c\" (UID: \"9df21515-928e-4ce4-a97f-b90af84dbd02\") " pod="openshift-ingress/router-default-7b6dc76c65-jtd7c"
Jul 02 19:15:57.751654 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:15:57.751632    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rv4pn\" (UniqueName: \"kubernetes.io/projected/acf32f4f-6cfd-40a3-8579-d62ea69d5cb6-kube-api-access-rv4pn\") pod \"cluster-monitoring-operator-64786d9cbb-vfd6h\" (UID: \"acf32f4f-6cfd-40a3-8579-d62ea69d5cb6\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vfd6h"
Jul 02 19:15:57.801661 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:15:57.801577    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:15:57.866338 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:15:57.866302    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-kc8ht"
Jul 02 19:15:57.871071 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:15:57.871049    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:15:57.990996 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:15:57.990969    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-kc8ht"]
Jul 02 19:15:57.993703 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:15:57.993682    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3639ebc4_c5e8_4a3d_9576_c34de3fb40e4.slice/crio-d7eebe454750b9c4f6b485d911e61fac9bcad5cfa1b75d168f08d349092484d0 WatchSource:0}: Error finding container d7eebe454750b9c4f6b485d911e61fac9bcad5cfa1b75d168f08d349092484d0: Status 404 returned error can't find the container with id d7eebe454750b9c4f6b485d911e61fac9bcad5cfa1b75d168f08d349092484d0
Jul 02 19:15:58.239499 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:15:58.239471    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9df21515-928e-4ce4-a97f-b90af84dbd02-metrics-certs\") pod \"router-default-7b6dc76c65-jtd7c\" (UID: \"9df21515-928e-4ce4-a97f-b90af84dbd02\") " pod="openshift-ingress/router-default-7b6dc76c65-jtd7c"
Jul 02 19:15:58.239657 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:15:58.239577    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9df21515-928e-4ce4-a97f-b90af84dbd02-service-ca-bundle\") pod \"router-default-7b6dc76c65-jtd7c\" (UID: \"9df21515-928e-4ce4-a97f-b90af84dbd02\") " pod="openshift-ingress/router-default-7b6dc76c65-jtd7c"
Jul 02 19:15:58.239657 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:15:58.239621    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/acf32f4f-6cfd-40a3-8579-d62ea69d5cb6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-vfd6h\" (UID: \"acf32f4f-6cfd-40a3-8579-d62ea69d5cb6\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vfd6h"
Jul 02 19:15:58.239657 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:15:58.239642    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 02 19:15:58.239853 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:15:58.239711    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 02 19:15:58.239853 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:15:58.239713    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9df21515-928e-4ce4-a97f-b90af84dbd02-metrics-certs podName:9df21515-928e-4ce4-a97f-b90af84dbd02 nodeName:}" failed. No retries permitted until 2026-07-02 19:15:59.239694552 +0000 UTC m=+255.603764460 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9df21515-928e-4ce4-a97f-b90af84dbd02-metrics-certs") pod "router-default-7b6dc76c65-jtd7c" (UID: "9df21515-928e-4ce4-a97f-b90af84dbd02") : secret "router-metrics-certs-default" not found
Jul 02 19:15:58.239853 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:15:58.239780    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9df21515-928e-4ce4-a97f-b90af84dbd02-service-ca-bundle podName:9df21515-928e-4ce4-a97f-b90af84dbd02 nodeName:}" failed. No retries permitted until 2026-07-02 19:15:59.2397695 +0000 UTC m=+255.603839398 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9df21515-928e-4ce4-a97f-b90af84dbd02-service-ca-bundle") pod "router-default-7b6dc76c65-jtd7c" (UID: "9df21515-928e-4ce4-a97f-b90af84dbd02") : configmap references non-existent config key: service-ca.crt
Jul 02 19:15:58.239853 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:15:58.239794    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acf32f4f-6cfd-40a3-8579-d62ea69d5cb6-cluster-monitoring-operator-tls podName:acf32f4f-6cfd-40a3-8579-d62ea69d5cb6 nodeName:}" failed. No retries permitted until 2026-07-02 19:15:59.239785368 +0000 UTC m=+255.603855258 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/acf32f4f-6cfd-40a3-8579-d62ea69d5cb6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-vfd6h" (UID: "acf32f4f-6cfd-40a3-8579-d62ea69d5cb6") : secret "cluster-monitoring-operator-tls" not found
Jul 02 19:15:58.861687 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:15:58.861655    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-kc8ht" event={"ID":"3639ebc4-c5e8-4a3d-9576-c34de3fb40e4","Type":"ContainerStarted","Data":"d7eebe454750b9c4f6b485d911e61fac9bcad5cfa1b75d168f08d349092484d0"}
Jul 02 19:15:59.246158 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:15:59.246123    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9df21515-928e-4ce4-a97f-b90af84dbd02-metrics-certs\") pod \"router-default-7b6dc76c65-jtd7c\" (UID: \"9df21515-928e-4ce4-a97f-b90af84dbd02\") " pod="openshift-ingress/router-default-7b6dc76c65-jtd7c"
Jul 02 19:15:59.246327 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:15:59.246186    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9df21515-928e-4ce4-a97f-b90af84dbd02-service-ca-bundle\") pod \"router-default-7b6dc76c65-jtd7c\" (UID: \"9df21515-928e-4ce4-a97f-b90af84dbd02\") " pod="openshift-ingress/router-default-7b6dc76c65-jtd7c"
Jul 02 19:15:59.246327 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:15:59.246210    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/acf32f4f-6cfd-40a3-8579-d62ea69d5cb6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-vfd6h\" (UID: \"acf32f4f-6cfd-40a3-8579-d62ea69d5cb6\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vfd6h"
Jul 02 19:15:59.246327 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:15:59.246279    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 02 19:15:59.246327 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:15:59.246310    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 02 19:15:59.246457 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:15:59.246352    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9df21515-928e-4ce4-a97f-b90af84dbd02-service-ca-bundle podName:9df21515-928e-4ce4-a97f-b90af84dbd02 nodeName:}" failed. No retries permitted until 2026-07-02 19:16:01.246336555 +0000 UTC m=+257.610406446 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9df21515-928e-4ce4-a97f-b90af84dbd02-service-ca-bundle") pod "router-default-7b6dc76c65-jtd7c" (UID: "9df21515-928e-4ce4-a97f-b90af84dbd02") : configmap references non-existent config key: service-ca.crt
Jul 02 19:15:59.246457 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:15:59.246373    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acf32f4f-6cfd-40a3-8579-d62ea69d5cb6-cluster-monitoring-operator-tls podName:acf32f4f-6cfd-40a3-8579-d62ea69d5cb6 nodeName:}" failed. No retries permitted until 2026-07-02 19:16:01.246364233 +0000 UTC m=+257.610434124 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/acf32f4f-6cfd-40a3-8579-d62ea69d5cb6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-vfd6h" (UID: "acf32f4f-6cfd-40a3-8579-d62ea69d5cb6") : secret "cluster-monitoring-operator-tls" not found
Jul 02 19:15:59.246457 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:15:59.246385    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9df21515-928e-4ce4-a97f-b90af84dbd02-metrics-certs podName:9df21515-928e-4ce4-a97f-b90af84dbd02 nodeName:}" failed. No retries permitted until 2026-07-02 19:16:01.246379434 +0000 UTC m=+257.610449324 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9df21515-928e-4ce4-a97f-b90af84dbd02-metrics-certs") pod "router-default-7b6dc76c65-jtd7c" (UID: "9df21515-928e-4ce4-a97f-b90af84dbd02") : secret "router-metrics-certs-default" not found
Jul 02 19:15:59.964210 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:15:59.964171    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:00.026820 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:00.026789    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:00.934847 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:00.934799    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:01.035474 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:01.035436    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:01.260934 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:01.260872    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/acf32f4f-6cfd-40a3-8579-d62ea69d5cb6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-vfd6h\" (UID: \"acf32f4f-6cfd-40a3-8579-d62ea69d5cb6\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vfd6h"
Jul 02 19:16:01.261132 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:01.260974    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9df21515-928e-4ce4-a97f-b90af84dbd02-metrics-certs\") pod \"router-default-7b6dc76c65-jtd7c\" (UID: \"9df21515-928e-4ce4-a97f-b90af84dbd02\") " pod="openshift-ingress/router-default-7b6dc76c65-jtd7c"
Jul 02 19:16:01.261132 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:01.261035    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9df21515-928e-4ce4-a97f-b90af84dbd02-service-ca-bundle\") pod \"router-default-7b6dc76c65-jtd7c\" (UID: \"9df21515-928e-4ce4-a97f-b90af84dbd02\") " pod="openshift-ingress/router-default-7b6dc76c65-jtd7c"
Jul 02 19:16:01.261132 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:16:01.261046    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 02 19:16:01.261132 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:16:01.261121    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 02 19:16:01.261132 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:16:01.261134    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acf32f4f-6cfd-40a3-8579-d62ea69d5cb6-cluster-monitoring-operator-tls podName:acf32f4f-6cfd-40a3-8579-d62ea69d5cb6 nodeName:}" failed. No retries permitted until 2026-07-02 19:16:05.261114395 +0000 UTC m=+261.625184290 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/acf32f4f-6cfd-40a3-8579-d62ea69d5cb6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-vfd6h" (UID: "acf32f4f-6cfd-40a3-8579-d62ea69d5cb6") : secret "cluster-monitoring-operator-tls" not found
Jul 02 19:16:01.261404 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:16:01.261153    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9df21515-928e-4ce4-a97f-b90af84dbd02-service-ca-bundle podName:9df21515-928e-4ce4-a97f-b90af84dbd02 nodeName:}" failed. No retries permitted until 2026-07-02 19:16:05.26114368 +0000 UTC m=+261.625213571 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9df21515-928e-4ce4-a97f-b90af84dbd02-service-ca-bundle") pod "router-default-7b6dc76c65-jtd7c" (UID: "9df21515-928e-4ce4-a97f-b90af84dbd02") : configmap references non-existent config key: service-ca.crt
Jul 02 19:16:01.261404 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:16:01.261169    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9df21515-928e-4ce4-a97f-b90af84dbd02-metrics-certs podName:9df21515-928e-4ce4-a97f-b90af84dbd02 nodeName:}" failed. No retries permitted until 2026-07-02 19:16:05.261161359 +0000 UTC m=+261.625231251 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9df21515-928e-4ce4-a97f-b90af84dbd02-metrics-certs") pod "router-default-7b6dc76c65-jtd7c" (UID: "9df21515-928e-4ce4-a97f-b90af84dbd02") : secret "router-metrics-certs-default" not found
Jul 02 19:16:01.872791 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:01.872698    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-kc8ht" event={"ID":"3639ebc4-c5e8-4a3d-9576-c34de3fb40e4","Type":"ContainerStarted","Data":"adf427182a2f637d618f1e55f71fa5425becce9a0d6720a29d6df1a20debfe7e"}
Jul 02 19:16:01.891382 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:01.891336    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-kc8ht" podStartSLOduration=1.379540334 podStartE2EDuration="4.891320006s" totalImagesPullingTime="3.511779672s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:15:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:16:01.890690025 +0000 UTC m=+258.254759950" watchObservedRunningTime="2026-07-02 19:16:01.891320006 +0000 UTC m=+258.255389919"
Jul 02 19:16:02.735709 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:02.735669    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-q2bp9"]
Jul 02 19:16:02.738682 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:02.738663    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-q2bp9"
Jul 02 19:16:02.742993 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:02.742963    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 02 19:16:02.743517 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:02.743498    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 02 19:16:02.744367 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:02.744318    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 02 19:16:02.744367 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:02.744324    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 02 19:16:02.744367 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:02.744366    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9h8cm\""
Jul 02 19:16:02.756308 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:02.756282    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-q2bp9"]
Jul 02 19:16:02.762733 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:02.762713    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:02.838654 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:02.838623    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:02.872774 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:02.872740    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/477be61a-e59f-4190-b987-3f5d23690fcd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q2bp9\" (UID: \"477be61a-e59f-4190-b987-3f5d23690fcd\") " pod="openshift-insights/insights-runtime-extractor-q2bp9"
Jul 02 19:16:02.872936 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:02.872823    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/477be61a-e59f-4190-b987-3f5d23690fcd-crio-socket\") pod \"insights-runtime-extractor-q2bp9\" (UID: \"477be61a-e59f-4190-b987-3f5d23690fcd\") " pod="openshift-insights/insights-runtime-extractor-q2bp9"
Jul 02 19:16:02.872936 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:02.872878    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/477be61a-e59f-4190-b987-3f5d23690fcd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q2bp9\" (UID: \"477be61a-e59f-4190-b987-3f5d23690fcd\") " pod="openshift-insights/insights-runtime-extractor-q2bp9"
Jul 02 19:16:02.873056 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:02.872939    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6k6z\" (UniqueName: \"kubernetes.io/projected/477be61a-e59f-4190-b987-3f5d23690fcd-kube-api-access-n6k6z\") pod \"insights-runtime-extractor-q2bp9\" (UID: \"477be61a-e59f-4190-b987-3f5d23690fcd\") " pod="openshift-insights/insights-runtime-extractor-q2bp9"
Jul 02 19:16:02.873056 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:02.872989    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/477be61a-e59f-4190-b987-3f5d23690fcd-data-volume\") pod \"insights-runtime-extractor-q2bp9\" (UID: \"477be61a-e59f-4190-b987-3f5d23690fcd\") " pod="openshift-insights/insights-runtime-extractor-q2bp9"
Jul 02 19:16:02.973856 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:02.973818    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/477be61a-e59f-4190-b987-3f5d23690fcd-crio-socket\") pod \"insights-runtime-extractor-q2bp9\" (UID: \"477be61a-e59f-4190-b987-3f5d23690fcd\") " pod="openshift-insights/insights-runtime-extractor-q2bp9"
Jul 02 19:16:02.974026 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:02.973874    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/477be61a-e59f-4190-b987-3f5d23690fcd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q2bp9\" (UID: \"477be61a-e59f-4190-b987-3f5d23690fcd\") " pod="openshift-insights/insights-runtime-extractor-q2bp9"
Jul 02 19:16:02.974026 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:16:02.973949    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 19:16:02.974026 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:02.973967    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/477be61a-e59f-4190-b987-3f5d23690fcd-crio-socket\") pod \"insights-runtime-extractor-q2bp9\" (UID: \"477be61a-e59f-4190-b987-3f5d23690fcd\") " pod="openshift-insights/insights-runtime-extractor-q2bp9"
Jul 02 19:16:02.974026 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:02.973980    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6k6z\" (UniqueName: \"kubernetes.io/projected/477be61a-e59f-4190-b987-3f5d23690fcd-kube-api-access-n6k6z\") pod \"insights-runtime-extractor-q2bp9\" (UID: \"477be61a-e59f-4190-b987-3f5d23690fcd\") " pod="openshift-insights/insights-runtime-extractor-q2bp9"
Jul 02 19:16:02.974026 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:16:02.973997    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/477be61a-e59f-4190-b987-3f5d23690fcd-kube-rbac-proxy-cm podName:477be61a-e59f-4190-b987-3f5d23690fcd nodeName:}" failed. No retries permitted until 2026-07-02 19:16:03.473985235 +0000 UTC m=+259.838055125 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/477be61a-e59f-4190-b987-3f5d23690fcd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-q2bp9" (UID: "477be61a-e59f-4190-b987-3f5d23690fcd") : configmap "kube-rbac-proxy" not found
Jul 02 19:16:02.974305 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:02.974046    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/477be61a-e59f-4190-b987-3f5d23690fcd-data-volume\") pod \"insights-runtime-extractor-q2bp9\" (UID: \"477be61a-e59f-4190-b987-3f5d23690fcd\") " pod="openshift-insights/insights-runtime-extractor-q2bp9"
Jul 02 19:16:02.974305 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:02.974111    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/477be61a-e59f-4190-b987-3f5d23690fcd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q2bp9\" (UID: \"477be61a-e59f-4190-b987-3f5d23690fcd\") " pod="openshift-insights/insights-runtime-extractor-q2bp9"
Jul 02 19:16:02.974305 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:16:02.974220    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 19:16:02.974305 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:16:02.974266    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/477be61a-e59f-4190-b987-3f5d23690fcd-insights-runtime-extractor-tls podName:477be61a-e59f-4190-b987-3f5d23690fcd nodeName:}" failed. No retries permitted until 2026-07-02 19:16:03.474253661 +0000 UTC m=+259.838323555 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/477be61a-e59f-4190-b987-3f5d23690fcd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-q2bp9" (UID: "477be61a-e59f-4190-b987-3f5d23690fcd") : secret "insights-runtime-extractor-tls" not found
Jul 02 19:16:02.974445 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:02.974382    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/477be61a-e59f-4190-b987-3f5d23690fcd-data-volume\") pod \"insights-runtime-extractor-q2bp9\" (UID: \"477be61a-e59f-4190-b987-3f5d23690fcd\") " pod="openshift-insights/insights-runtime-extractor-q2bp9"
Jul 02 19:16:02.982580 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:02.982552    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6k6z\" (UniqueName: \"kubernetes.io/projected/477be61a-e59f-4190-b987-3f5d23690fcd-kube-api-access-n6k6z\") pod \"insights-runtime-extractor-q2bp9\" (UID: \"477be61a-e59f-4190-b987-3f5d23690fcd\") " pod="openshift-insights/insights-runtime-extractor-q2bp9"
Jul 02 19:16:03.092351 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:03.092268    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:03.164670 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:03.161867    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:03.322674 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:03.322646    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:03.423893 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:03.423815    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:03.478436 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:03.478398    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/477be61a-e59f-4190-b987-3f5d23690fcd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q2bp9\" (UID: \"477be61a-e59f-4190-b987-3f5d23690fcd\") " pod="openshift-insights/insights-runtime-extractor-q2bp9"
Jul 02 19:16:03.478576 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:03.478490    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/477be61a-e59f-4190-b987-3f5d23690fcd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q2bp9\" (UID: \"477be61a-e59f-4190-b987-3f5d23690fcd\") " pod="openshift-insights/insights-runtime-extractor-q2bp9"
Jul 02 19:16:03.478576 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:16:03.478539    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 19:16:03.478650 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:16:03.478584    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 19:16:03.478650 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:16:03.478600    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/477be61a-e59f-4190-b987-3f5d23690fcd-insights-runtime-extractor-tls podName:477be61a-e59f-4190-b987-3f5d23690fcd nodeName:}" failed. No retries permitted until 2026-07-02 19:16:04.478585141 +0000 UTC m=+260.842655035 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/477be61a-e59f-4190-b987-3f5d23690fcd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-q2bp9" (UID: "477be61a-e59f-4190-b987-3f5d23690fcd") : secret "insights-runtime-extractor-tls" not found
Jul 02 19:16:03.478650 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:16:03.478629    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/477be61a-e59f-4190-b987-3f5d23690fcd-kube-rbac-proxy-cm podName:477be61a-e59f-4190-b987-3f5d23690fcd nodeName:}" failed. No retries permitted until 2026-07-02 19:16:04.478618499 +0000 UTC m=+260.842688390 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/477be61a-e59f-4190-b987-3f5d23690fcd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-q2bp9" (UID: "477be61a-e59f-4190-b987-3f5d23690fcd") : configmap "kube-rbac-proxy" not found
Jul 02 19:16:03.523717 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:03.523686    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:03.794483 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:03.794453    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:03.894646 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:03.894612    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:04.412141 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:04.412109    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-7n6qk"]
Jul 02 19:16:04.415021 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:04.415003    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-7n6qk"
Jul 02 19:16:04.419086 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:04.419061    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 02 19:16:04.419086 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:04.419075    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-7gf9l\""
Jul 02 19:16:04.419278 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:04.419107    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 02 19:16:04.422994 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:04.422975    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-7n6qk"]
Jul 02 19:16:04.455137 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:04.455107    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:04.484455 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:04.484430    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/477be61a-e59f-4190-b987-3f5d23690fcd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q2bp9\" (UID: \"477be61a-e59f-4190-b987-3f5d23690fcd\") " pod="openshift-insights/insights-runtime-extractor-q2bp9"
Jul 02 19:16:04.484597 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:04.484490    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/477be61a-e59f-4190-b987-3f5d23690fcd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q2bp9\" (UID: \"477be61a-e59f-4190-b987-3f5d23690fcd\") " pod="openshift-insights/insights-runtime-extractor-q2bp9"
Jul 02 19:16:04.484597 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:16:04.484561    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 19:16:04.484597 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:16:04.484570    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 19:16:04.484712 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:16:04.484609    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/477be61a-e59f-4190-b987-3f5d23690fcd-kube-rbac-proxy-cm podName:477be61a-e59f-4190-b987-3f5d23690fcd nodeName:}" failed. No retries permitted until 2026-07-02 19:16:06.484596859 +0000 UTC m=+262.848666760 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/477be61a-e59f-4190-b987-3f5d23690fcd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-q2bp9" (UID: "477be61a-e59f-4190-b987-3f5d23690fcd") : configmap "kube-rbac-proxy" not found
Jul 02 19:16:04.484712 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:16:04.484621    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/477be61a-e59f-4190-b987-3f5d23690fcd-insights-runtime-extractor-tls podName:477be61a-e59f-4190-b987-3f5d23690fcd nodeName:}" failed. No retries permitted until 2026-07-02 19:16:06.484615298 +0000 UTC m=+262.848685189 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/477be61a-e59f-4190-b987-3f5d23690fcd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-q2bp9" (UID: "477be61a-e59f-4190-b987-3f5d23690fcd") : secret "insights-runtime-extractor-tls" not found
Jul 02 19:16:04.556235 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:04.556203    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:04.585347 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:04.585318    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnwk6\" (UniqueName: \"kubernetes.io/projected/fc445393-c33c-40c3-8b18-8e103f1229a5-kube-api-access-lnwk6\") pod \"migrator-d57d58cc9-7n6qk\" (UID: \"fc445393-c33c-40c3-8b18-8e103f1229a5\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-7n6qk"
Jul 02 19:16:04.685712 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:04.685602    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:04.685712 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:04.685682    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnwk6\" (UniqueName: \"kubernetes.io/projected/fc445393-c33c-40c3-8b18-8e103f1229a5-kube-api-access-lnwk6\") pod \"migrator-d57d58cc9-7n6qk\" (UID: \"fc445393-c33c-40c3-8b18-8e103f1229a5\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-7n6qk"
Jul 02 19:16:04.694622 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:04.694592    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnwk6\" (UniqueName: \"kubernetes.io/projected/fc445393-c33c-40c3-8b18-8e103f1229a5-kube-api-access-lnwk6\") pod \"migrator-d57d58cc9-7n6qk\" (UID: \"fc445393-c33c-40c3-8b18-8e103f1229a5\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-7n6qk"
Jul 02 19:16:04.701972 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:04.701954    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9mhh9_d7c935ff-227d-4302-879d-c1a1f01755a9/dns-node-resolver/0.log"
Jul 02 19:16:04.724256 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:04.724232    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-7n6qk"
Jul 02 19:16:04.786731 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:04.786654    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:04.848326 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:04.848306    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-7n6qk"]
Jul 02 19:16:04.850354 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:16:04.850329    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc445393_c33c_40c3_8b18_8e103f1229a5.slice/crio-140d84e5bde82ab68f3b85614534e3895d1522a44fce2c980d562253056c37be WatchSource:0}: Error finding container 140d84e5bde82ab68f3b85614534e3895d1522a44fce2c980d562253056c37be: Status 404 returned error can't find the container with id 140d84e5bde82ab68f3b85614534e3895d1522a44fce2c980d562253056c37be
Jul 02 19:16:04.881762 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:04.881727    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-7n6qk" event={"ID":"fc445393-c33c-40c3-8b18-8e103f1229a5","Type":"ContainerStarted","Data":"140d84e5bde82ab68f3b85614534e3895d1522a44fce2c980d562253056c37be"}
Jul 02 19:16:05.289383 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:05.289334    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9df21515-928e-4ce4-a97f-b90af84dbd02-metrics-certs\") pod \"router-default-7b6dc76c65-jtd7c\" (UID: \"9df21515-928e-4ce4-a97f-b90af84dbd02\") " pod="openshift-ingress/router-default-7b6dc76c65-jtd7c"
Jul 02 19:16:05.289561 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:05.289421    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9df21515-928e-4ce4-a97f-b90af84dbd02-service-ca-bundle\") pod \"router-default-7b6dc76c65-jtd7c\" (UID: \"9df21515-928e-4ce4-a97f-b90af84dbd02\") " pod="openshift-ingress/router-default-7b6dc76c65-jtd7c"
Jul 02 19:16:05.289561 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:05.289447    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/acf32f4f-6cfd-40a3-8579-d62ea69d5cb6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-vfd6h\" (UID: \"acf32f4f-6cfd-40a3-8579-d62ea69d5cb6\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vfd6h"
Jul 02 19:16:05.289561 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:16:05.289506    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 02 19:16:05.289561 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:16:05.289548    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 02 19:16:05.289691 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:16:05.289588    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9df21515-928e-4ce4-a97f-b90af84dbd02-metrics-certs podName:9df21515-928e-4ce4-a97f-b90af84dbd02 nodeName:}" failed. No retries permitted until 2026-07-02 19:16:13.289566859 +0000 UTC m=+269.653636750 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9df21515-928e-4ce4-a97f-b90af84dbd02-metrics-certs") pod "router-default-7b6dc76c65-jtd7c" (UID: "9df21515-928e-4ce4-a97f-b90af84dbd02") : secret "router-metrics-certs-default" not found
Jul 02 19:16:05.289691 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:16:05.289604    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9df21515-928e-4ce4-a97f-b90af84dbd02-service-ca-bundle podName:9df21515-928e-4ce4-a97f-b90af84dbd02 nodeName:}" failed. No retries permitted until 2026-07-02 19:16:13.289596342 +0000 UTC m=+269.653666232 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9df21515-928e-4ce4-a97f-b90af84dbd02-service-ca-bundle") pod "router-default-7b6dc76c65-jtd7c" (UID: "9df21515-928e-4ce4-a97f-b90af84dbd02") : configmap references non-existent config key: service-ca.crt
Jul 02 19:16:05.289691 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:16:05.289615    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acf32f4f-6cfd-40a3-8579-d62ea69d5cb6-cluster-monitoring-operator-tls podName:acf32f4f-6cfd-40a3-8579-d62ea69d5cb6 nodeName:}" failed. No retries permitted until 2026-07-02 19:16:13.289608375 +0000 UTC m=+269.653678267 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/acf32f4f-6cfd-40a3-8579-d62ea69d5cb6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-vfd6h" (UID: "acf32f4f-6cfd-40a3-8579-d62ea69d5cb6") : secret "cluster-monitoring-operator-tls" not found
Jul 02 19:16:05.503060 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:05.503029    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6rmk4_21bc43fc-481b-4b52-a8e3-5ae352981994/node-ca/0.log"
Jul 02 19:16:05.504927 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:05.504886    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:05.605983 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:05.605887    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:06.482064 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:06.482021    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:06.498131 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:06.498098    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/477be61a-e59f-4190-b987-3f5d23690fcd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q2bp9\" (UID: \"477be61a-e59f-4190-b987-3f5d23690fcd\") " pod="openshift-insights/insights-runtime-extractor-q2bp9"
Jul 02 19:16:06.498276 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:06.498187    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/477be61a-e59f-4190-b987-3f5d23690fcd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q2bp9\" (UID: \"477be61a-e59f-4190-b987-3f5d23690fcd\") " pod="openshift-insights/insights-runtime-extractor-q2bp9"
Jul 02 19:16:06.498276 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:16:06.498214    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 19:16:06.498276 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:16:06.498270    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/477be61a-e59f-4190-b987-3f5d23690fcd-kube-rbac-proxy-cm podName:477be61a-e59f-4190-b987-3f5d23690fcd nodeName:}" failed. No retries permitted until 2026-07-02 19:16:10.498255521 +0000 UTC m=+266.862325411 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/477be61a-e59f-4190-b987-3f5d23690fcd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-q2bp9" (UID: "477be61a-e59f-4190-b987-3f5d23690fcd") : configmap "kube-rbac-proxy" not found
Jul 02 19:16:06.498434 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:16:06.498327    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 19:16:06.498434 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:16:06.498387    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/477be61a-e59f-4190-b987-3f5d23690fcd-insights-runtime-extractor-tls podName:477be61a-e59f-4190-b987-3f5d23690fcd nodeName:}" failed. No retries permitted until 2026-07-02 19:16:10.498369615 +0000 UTC m=+266.862439511 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/477be61a-e59f-4190-b987-3f5d23690fcd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-q2bp9" (UID: "477be61a-e59f-4190-b987-3f5d23690fcd") : secret "insights-runtime-extractor-tls" not found
Jul 02 19:16:06.707535 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:06.707506    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pl552_186d4a7b-65a2-4613-92bf-5bbeee5f6a56/serve-healthcheck-canary/0.log"
Jul 02 19:16:06.889845 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:06.889770    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-7n6qk" event={"ID":"fc445393-c33c-40c3-8b18-8e103f1229a5","Type":"ContainerStarted","Data":"b9e80e249c1dd921f4b856ef9d124d65508e7c87009110689318fc614234ae6d"}
Jul 02 19:16:06.889845 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:06.889819    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-7n6qk" event={"ID":"fc445393-c33c-40c3-8b18-8e103f1229a5","Type":"ContainerStarted","Data":"6be85bace2f76c3d9defbf2dce9b8cf62efbc1cd238b9c7896a6b53139639a0a"}
Jul 02 19:16:06.913487 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:06.913437    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-7n6qk" podStartSLOduration=1.6431114180000002 podStartE2EDuration="2.913422111s" totalImagesPullingTime="1.270310693s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:16:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:16:06.913187193 +0000 UTC m=+263.277257107" watchObservedRunningTime="2026-07-02 19:16:06.913422111 +0000 UTC m=+263.277492023"
Jul 02 19:16:08.677131 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:08.677095    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:09.080503 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:09.080454    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:09.199466 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:09.199427    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:09.296881 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:09.296851    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:09.467792 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:09.467758    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:09.540260 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:09.540240    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:10.473046 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:10.473018    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:10.533215 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:10.533146    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/477be61a-e59f-4190-b987-3f5d23690fcd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q2bp9\" (UID: \"477be61a-e59f-4190-b987-3f5d23690fcd\") " pod="openshift-insights/insights-runtime-extractor-q2bp9"
Jul 02 19:16:10.533413 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:16:10.533262    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 19:16:10.533413 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:10.533275    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/477be61a-e59f-4190-b987-3f5d23690fcd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q2bp9\" (UID: \"477be61a-e59f-4190-b987-3f5d23690fcd\") " pod="openshift-insights/insights-runtime-extractor-q2bp9"
Jul 02 19:16:10.533413 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:16:10.533316    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/477be61a-e59f-4190-b987-3f5d23690fcd-kube-rbac-proxy-cm podName:477be61a-e59f-4190-b987-3f5d23690fcd nodeName:}" failed. No retries permitted until 2026-07-02 19:16:18.533302265 +0000 UTC m=+274.897372155 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/477be61a-e59f-4190-b987-3f5d23690fcd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-q2bp9" (UID: "477be61a-e59f-4190-b987-3f5d23690fcd") : configmap "kube-rbac-proxy" not found
Jul 02 19:16:10.533413 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:16:10.533376    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 19:16:10.533569 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:16:10.533431    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/477be61a-e59f-4190-b987-3f5d23690fcd-insights-runtime-extractor-tls podName:477be61a-e59f-4190-b987-3f5d23690fcd nodeName:}" failed. No retries permitted until 2026-07-02 19:16:18.53341568 +0000 UTC m=+274.897485571 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/477be61a-e59f-4190-b987-3f5d23690fcd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-q2bp9" (UID: "477be61a-e59f-4190-b987-3f5d23690fcd") : secret "insights-runtime-extractor-tls" not found
Jul 02 19:16:10.665495 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:10.665463    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:11.070925 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:11.070875    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:11.261834 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:11.261798    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:11.664550 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:11.664521    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:12.383234 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:12.383188    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:12.486379 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:12.486350    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:12.587175 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:12.587147    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:12.863046 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:12.863016    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:13.069050 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:13.069018    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:13.258617 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:13.258586    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:13.357243 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:13.357212    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9df21515-928e-4ce4-a97f-b90af84dbd02-service-ca-bundle\") pod \"router-default-7b6dc76c65-jtd7c\" (UID: \"9df21515-928e-4ce4-a97f-b90af84dbd02\") " pod="openshift-ingress/router-default-7b6dc76c65-jtd7c"
Jul 02 19:16:13.357447 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:13.357249    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/acf32f4f-6cfd-40a3-8579-d62ea69d5cb6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-vfd6h\" (UID: \"acf32f4f-6cfd-40a3-8579-d62ea69d5cb6\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vfd6h"
Jul 02 19:16:13.357447 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:13.357290    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9df21515-928e-4ce4-a97f-b90af84dbd02-metrics-certs\") pod \"router-default-7b6dc76c65-jtd7c\" (UID: \"9df21515-928e-4ce4-a97f-b90af84dbd02\") " pod="openshift-ingress/router-default-7b6dc76c65-jtd7c"
Jul 02 19:16:13.357447 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:16:13.357392    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9df21515-928e-4ce4-a97f-b90af84dbd02-service-ca-bundle podName:9df21515-928e-4ce4-a97f-b90af84dbd02 nodeName:}" failed. No retries permitted until 2026-07-02 19:16:29.357375259 +0000 UTC m=+285.721445169 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9df21515-928e-4ce4-a97f-b90af84dbd02-service-ca-bundle") pod "router-default-7b6dc76c65-jtd7c" (UID: "9df21515-928e-4ce4-a97f-b90af84dbd02") : configmap references non-existent config key: service-ca.crt
Jul 02 19:16:13.357447 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:16:13.357399    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 02 19:16:13.357447 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:16:13.357409    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 02 19:16:13.357447 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:16:13.357439    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9df21515-928e-4ce4-a97f-b90af84dbd02-metrics-certs podName:9df21515-928e-4ce4-a97f-b90af84dbd02 nodeName:}" failed. No retries permitted until 2026-07-02 19:16:29.357428573 +0000 UTC m=+285.721498463 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9df21515-928e-4ce4-a97f-b90af84dbd02-metrics-certs") pod "router-default-7b6dc76c65-jtd7c" (UID: "9df21515-928e-4ce4-a97f-b90af84dbd02") : secret "router-metrics-certs-default" not found
Jul 02 19:16:13.357641 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:16:13.357461    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acf32f4f-6cfd-40a3-8579-d62ea69d5cb6-cluster-monitoring-operator-tls podName:acf32f4f-6cfd-40a3-8579-d62ea69d5cb6 nodeName:}" failed. No retries permitted until 2026-07-02 19:16:29.357444846 +0000 UTC m=+285.721514744 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/acf32f4f-6cfd-40a3-8579-d62ea69d5cb6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-vfd6h" (UID: "acf32f4f-6cfd-40a3-8579-d62ea69d5cb6") : secret "cluster-monitoring-operator-tls" not found
Jul 02 19:16:13.467454 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:13.467416    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:14.263458 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:14.263424    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:14.667245 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:14.667157    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:15.061163 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:15.061131    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:15.191831 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:15.191799    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:15.467337 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:15.467313    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:15.660621 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:15.660586    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:15.969178 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:15.969115    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:16.295592 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:16.295513    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:16.861203 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:16.861165    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:17.070165 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:17.070132    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:17.269663 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:17.269632    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:17.465902 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:17.465871    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:17.935605 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:17.935576    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:18.460147 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:18.460118    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:18.593608 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:18.593576    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/477be61a-e59f-4190-b987-3f5d23690fcd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q2bp9\" (UID: \"477be61a-e59f-4190-b987-3f5d23690fcd\") " pod="openshift-insights/insights-runtime-extractor-q2bp9"
Jul 02 19:16:18.593750 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:18.593651    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/477be61a-e59f-4190-b987-3f5d23690fcd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q2bp9\" (UID: \"477be61a-e59f-4190-b987-3f5d23690fcd\") " pod="openshift-insights/insights-runtime-extractor-q2bp9"
Jul 02 19:16:18.594230 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:18.594205    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/477be61a-e59f-4190-b987-3f5d23690fcd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q2bp9\" (UID: \"477be61a-e59f-4190-b987-3f5d23690fcd\") " pod="openshift-insights/insights-runtime-extractor-q2bp9"
Jul 02 19:16:18.596063 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:18.596042    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/477be61a-e59f-4190-b987-3f5d23690fcd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q2bp9\" (UID: \"477be61a-e59f-4190-b987-3f5d23690fcd\") " pod="openshift-insights/insights-runtime-extractor-q2bp9"
Jul 02 19:16:18.647848 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:18.647811    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-q2bp9"
Jul 02 19:16:18.773072 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:18.773045    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-q2bp9"]
Jul 02 19:16:18.776335 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:16:18.776301    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod477be61a_e59f_4190_b987_3f5d23690fcd.slice/crio-df8cb5f1202661c802f9f0f882339ba9feefd6e3bceda8af4795b8379e6db1a2 WatchSource:0}: Error finding container df8cb5f1202661c802f9f0f882339ba9feefd6e3bceda8af4795b8379e6db1a2: Status 404 returned error can't find the container with id df8cb5f1202661c802f9f0f882339ba9feefd6e3bceda8af4795b8379e6db1a2
Jul 02 19:16:18.859719 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:18.859676    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:18.924098 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:18.924069    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q2bp9" event={"ID":"477be61a-e59f-4190-b987-3f5d23690fcd","Type":"ContainerStarted","Data":"df8cb5f1202661c802f9f0f882339ba9feefd6e3bceda8af4795b8379e6db1a2"}
Jul 02 19:16:19.061320 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:19.061241    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:19.263081 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:19.263047    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:19.477546 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:19.477429    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:22.938241 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:22.938201    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q2bp9" event={"ID":"477be61a-e59f-4190-b987-3f5d23690fcd","Type":"ContainerStarted","Data":"0af2cef5d44cc429681418a3495d87a13855db994416454ca583c185ff1cbfda"}
Jul 02 19:16:23.381319 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:23.381290    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:23.443607 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:23.443533    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:23.943402 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:23.943362    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q2bp9" event={"ID":"477be61a-e59f-4190-b987-3f5d23690fcd","Type":"ContainerStarted","Data":"dabc20b0a2c263f9276153e9578d9c7e78ae5ea6cedbc58f9edfcc07e9b2a16b"}
Jul 02 19:16:25.600689 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:16:25.600650    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-bdfpb" podUID="f923f505-7d21-406b-ae68-e3cb0606b23c"
Jul 02 19:16:25.952201 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:25.952110    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q2bp9" event={"ID":"477be61a-e59f-4190-b987-3f5d23690fcd","Type":"ContainerStarted","Data":"cdf92982a4f5bb813b79d97be4b91b6b92a9865cac2e22d4f76442f28e7c9a59"}
Jul 02 19:16:25.952201 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:25.952133    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bdfpb"
Jul 02 19:16:25.971856 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:25.971811    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-q2bp9" podStartSLOduration=17.125029704 podStartE2EDuration="23.971798521s" totalImagesPullingTime="6.846768817s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:16:02 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:16:25.971039362 +0000 UTC m=+282.335109276" watchObservedRunningTime="2026-07-02 19:16:25.971798521 +0000 UTC m=+282.335868434"
Jul 02 19:16:27.581268 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:27.581236    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:27.693033 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:27.692999    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:28.971361 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:28.971325    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f923f505-7d21-406b-ae68-e3cb0606b23c-metrics-tls\") pod \"dns-default-bdfpb\" (UID: \"f923f505-7d21-406b-ae68-e3cb0606b23c\") " pod="openshift-dns/dns-default-bdfpb"
Jul 02 19:16:28.973688 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:28.973670    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f923f505-7d21-406b-ae68-e3cb0606b23c-metrics-tls\") pod \"dns-default-bdfpb\" (UID: \"f923f505-7d21-406b-ae68-e3cb0606b23c\") " pod="openshift-dns/dns-default-bdfpb"
Jul 02 19:16:29.256226 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:29.256136    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9snh5\""
Jul 02 19:16:29.263590 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:29.263570    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bdfpb"
Jul 02 19:16:29.374699 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:29.374672    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9df21515-928e-4ce4-a97f-b90af84dbd02-service-ca-bundle\") pod \"router-default-7b6dc76c65-jtd7c\" (UID: \"9df21515-928e-4ce4-a97f-b90af84dbd02\") " pod="openshift-ingress/router-default-7b6dc76c65-jtd7c"
Jul 02 19:16:29.374841 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:29.374711    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/acf32f4f-6cfd-40a3-8579-d62ea69d5cb6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-vfd6h\" (UID: \"acf32f4f-6cfd-40a3-8579-d62ea69d5cb6\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vfd6h"
Jul 02 19:16:29.374881 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:29.374834    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9df21515-928e-4ce4-a97f-b90af84dbd02-metrics-certs\") pod \"router-default-7b6dc76c65-jtd7c\" (UID: \"9df21515-928e-4ce4-a97f-b90af84dbd02\") " pod="openshift-ingress/router-default-7b6dc76c65-jtd7c"
Jul 02 19:16:29.375349 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:29.375326    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9df21515-928e-4ce4-a97f-b90af84dbd02-service-ca-bundle\") pod \"router-default-7b6dc76c65-jtd7c\" (UID: \"9df21515-928e-4ce4-a97f-b90af84dbd02\") " pod="openshift-ingress/router-default-7b6dc76c65-jtd7c"
Jul 02 19:16:29.377150 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:29.377124    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9df21515-928e-4ce4-a97f-b90af84dbd02-metrics-certs\") pod \"router-default-7b6dc76c65-jtd7c\" (UID: \"9df21515-928e-4ce4-a97f-b90af84dbd02\") " pod="openshift-ingress/router-default-7b6dc76c65-jtd7c"
Jul 02 19:16:29.377462 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:29.377443    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/acf32f4f-6cfd-40a3-8579-d62ea69d5cb6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-vfd6h\" (UID: \"acf32f4f-6cfd-40a3-8579-d62ea69d5cb6\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vfd6h"
Jul 02 19:16:29.389662 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:29.389636    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bdfpb"]
Jul 02 19:16:29.392179 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:16:29.392153    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf923f505_7d21_406b_ae68_e3cb0606b23c.slice/crio-b41fab33eec4de61a082e801fba59103db1bb2953cee961985de61c00c9bb926 WatchSource:0}: Error finding container b41fab33eec4de61a082e801fba59103db1bb2953cee961985de61c00c9bb926: Status 404 returned error can't find the container with id b41fab33eec4de61a082e801fba59103db1bb2953cee961985de61c00c9bb926
Jul 02 19:16:29.659834 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:29.659758    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vfd6h"
Jul 02 19:16:29.671307 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:29.671284    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7b6dc76c65-jtd7c"
Jul 02 19:16:29.792746 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:29.792691    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vfd6h"]
Jul 02 19:16:29.794723 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:16:29.794699    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacf32f4f_6cfd_40a3_8579_d62ea69d5cb6.slice/crio-64846b88c207237a615c99eeba00219e9dc35e544705d23a9bb5464ffbbe65a3 WatchSource:0}: Error finding container 64846b88c207237a615c99eeba00219e9dc35e544705d23a9bb5464ffbbe65a3: Status 404 returned error can't find the container with id 64846b88c207237a615c99eeba00219e9dc35e544705d23a9bb5464ffbbe65a3
Jul 02 19:16:29.815551 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:29.815490    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7b6dc76c65-jtd7c"]
Jul 02 19:16:29.817301 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:16:29.817275    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9df21515_928e_4ce4_a97f_b90af84dbd02.slice/crio-63fe0d9b8de373c062c0d0c162d594475043e59c155ecb79d4257e8c81a6c7a6 WatchSource:0}: Error finding container 63fe0d9b8de373c062c0d0c162d594475043e59c155ecb79d4257e8c81a6c7a6: Status 404 returned error can't find the container with id 63fe0d9b8de373c062c0d0c162d594475043e59c155ecb79d4257e8c81a6c7a6
Jul 02 19:16:29.964878 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:29.964843    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vfd6h" event={"ID":"acf32f4f-6cfd-40a3-8579-d62ea69d5cb6","Type":"ContainerStarted","Data":"64846b88c207237a615c99eeba00219e9dc35e544705d23a9bb5464ffbbe65a3"}
Jul 02 19:16:29.966009 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:29.965986    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bdfpb" event={"ID":"f923f505-7d21-406b-ae68-e3cb0606b23c","Type":"ContainerStarted","Data":"b41fab33eec4de61a082e801fba59103db1bb2953cee961985de61c00c9bb926"}
Jul 02 19:16:29.967244 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:29.967223    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7b6dc76c65-jtd7c" event={"ID":"9df21515-928e-4ce4-a97f-b90af84dbd02","Type":"ContainerStarted","Data":"0a97b9240e386ca6c34c10761287bafaaf5e8b5b322e695377cb83af48912348"}
Jul 02 19:16:29.967330 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:29.967262    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7b6dc76c65-jtd7c" event={"ID":"9df21515-928e-4ce4-a97f-b90af84dbd02","Type":"ContainerStarted","Data":"63fe0d9b8de373c062c0d0c162d594475043e59c155ecb79d4257e8c81a6c7a6"}
Jul 02 19:16:29.987839 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:29.987798    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7b6dc76c65-jtd7c" podStartSLOduration=32.987784058 podStartE2EDuration="32.987784058s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:15:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:16:29.986846013 +0000 UTC m=+286.350915928" watchObservedRunningTime="2026-07-02 19:16:29.987784058 +0000 UTC m=+286.351853971"
Jul 02 19:16:30.672037 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:30.672000    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7b6dc76c65-jtd7c"
Jul 02 19:16:30.675150 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:30.675128    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7b6dc76c65-jtd7c"
Jul 02 19:16:30.970808 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:30.970759    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7b6dc76c65-jtd7c"
Jul 02 19:16:30.972204 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:30.972178    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7b6dc76c65-jtd7c"
Jul 02 19:16:31.976703 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:31.976663    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bdfpb" event={"ID":"f923f505-7d21-406b-ae68-e3cb0606b23c","Type":"ContainerStarted","Data":"ef33aeb4da1f526df4cb5bc85c1001a125e67778d9d8f2c2cb79c668f7fd8fa1"}
Jul 02 19:16:31.977158 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:31.976734    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bdfpb" event={"ID":"f923f505-7d21-406b-ae68-e3cb0606b23c","Type":"ContainerStarted","Data":"9c07502cb78ccc07035946d403607364247cde0634d423ce9e0366eb829e727b"}
Jul 02 19:16:31.996930 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:31.996865    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-bdfpb" podStartSLOduration=252.233526587 podStartE2EDuration="4m13.996844522s" totalImagesPullingTime="1.763317935s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:12:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:16:31.995479385 +0000 UTC m=+288.359549298" watchObservedRunningTime="2026-07-02 19:16:31.996844522 +0000 UTC m=+288.360914437"
Jul 02 19:16:32.420361 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:32.420288    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:32.981770 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:32.981735    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vfd6h" event={"ID":"acf32f4f-6cfd-40a3-8579-d62ea69d5cb6","Type":"ContainerStarted","Data":"2dec23f5d2f57f0718cfee0d8acef75c318afc7269b6742629fcc4481e3e5efa"}
Jul 02 19:16:32.982206 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:32.981935    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-bdfpb"
Jul 02 19:16:33.000277 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:33.000222    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vfd6h" podStartSLOduration=33.692034264 podStartE2EDuration="36.000207594s" totalImagesPullingTime="2.30817333s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:15:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:16:32.999591519 +0000 UTC m=+289.363661431" watchObservedRunningTime="2026-07-02 19:16:33.000207594 +0000 UTC m=+289.364277517"
Jul 02 19:16:33.566211 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:33.566176    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:35.611012 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:35.610980    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:35.689338 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:35.689305    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:35.875736 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:35.875656    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:36.192883 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:36.192804    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:36.266483 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:36.266453    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:36.537213 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:36.537178    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:36.637933 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:36.637892    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:37.114465 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:16:37.114432    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-2b9th" podUID="d0e53e82-59ae-4430-9470-2648eb4eafb4"
Jul 02 19:16:37.990240 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:37.990208    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:39.495305 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:39.495276    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:39.557265 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:39.557240    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:39.750066 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:39.749999    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:39.960528 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:39.960495    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:39.980127 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:39.980097    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-878hv"]
Jul 02 19:16:39.984688 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:39.984669    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-878hv"
Jul 02 19:16:39.988069 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:39.988043    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 02 19:16:39.988069 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:39.988052    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 02 19:16:39.988319 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:39.988163    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-jkmfw\""
Jul 02 19:16:39.989474 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:39.989460    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 02 19:16:39.996346 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:39.996326    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-878hv"]
Jul 02 19:16:40.033525 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:40.033454    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-br7gk"]
Jul 02 19:16:40.037489 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:40.037473    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-br7gk"
Jul 02 19:16:40.041266 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:40.041245    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 02 19:16:40.041514 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:40.041498    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 02 19:16:40.041587 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:40.041554    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-hhr7x\""
Jul 02 19:16:40.041781 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:40.041759    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 02 19:16:40.054327 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:40.054305    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z94xz\" (UniqueName: \"kubernetes.io/projected/5e6701a0-1b56-4a92-a3c9-cd4d7db150c2-kube-api-access-z94xz\") pod \"openshift-state-metrics-54cf96dfcf-878hv\" (UID: \"5e6701a0-1b56-4a92-a3c9-cd4d7db150c2\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-878hv"
Jul 02 19:16:40.054426 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:40.054344    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e6701a0-1b56-4a92-a3c9-cd4d7db150c2-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-878hv\" (UID: \"5e6701a0-1b56-4a92-a3c9-cd4d7db150c2\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-878hv"
Jul 02 19:16:40.054426 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:40.054366    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5e6701a0-1b56-4a92-a3c9-cd4d7db150c2-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-878hv\" (UID: \"5e6701a0-1b56-4a92-a3c9-cd4d7db150c2\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-878hv"
Jul 02 19:16:40.054492 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:40.054442    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5e6701a0-1b56-4a92-a3c9-cd4d7db150c2-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-878hv\" (UID: \"5e6701a0-1b56-4a92-a3c9-cd4d7db150c2\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-878hv"
Jul 02 19:16:40.067114 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:40.067087    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:40.154787 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:40.154749    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5e6701a0-1b56-4a92-a3c9-cd4d7db150c2-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-878hv\" (UID: \"5e6701a0-1b56-4a92-a3c9-cd4d7db150c2\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-878hv"
Jul 02 19:16:40.154787 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:40.154787    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8a069263-cccc-4c90-a48d-19fdf10b52c1-node-exporter-wtmp\") pod \"node-exporter-br7gk\" (UID: \"8a069263-cccc-4c90-a48d-19fdf10b52c1\") " pod="openshift-monitoring/node-exporter-br7gk"
Jul 02 19:16:40.155010 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:40.154811    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8a069263-cccc-4c90-a48d-19fdf10b52c1-node-exporter-accelerators-collector-config\") pod \"node-exporter-br7gk\" (UID: \"8a069263-cccc-4c90-a48d-19fdf10b52c1\") " pod="openshift-monitoring/node-exporter-br7gk"
Jul 02 19:16:40.155010 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:40.154844    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8a069263-cccc-4c90-a48d-19fdf10b52c1-sys\") pod \"node-exporter-br7gk\" (UID: \"8a069263-cccc-4c90-a48d-19fdf10b52c1\") " pod="openshift-monitoring/node-exporter-br7gk"
Jul 02 19:16:40.155010 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:40.154904    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z94xz\" (UniqueName: \"kubernetes.io/projected/5e6701a0-1b56-4a92-a3c9-cd4d7db150c2-kube-api-access-z94xz\") pod \"openshift-state-metrics-54cf96dfcf-878hv\" (UID: \"5e6701a0-1b56-4a92-a3c9-cd4d7db150c2\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-878hv"
Jul 02 19:16:40.155010 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:40.154966    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8a069263-cccc-4c90-a48d-19fdf10b52c1-metrics-client-ca\") pod \"node-exporter-br7gk\" (UID: \"8a069263-cccc-4c90-a48d-19fdf10b52c1\") " pod="openshift-monitoring/node-exporter-br7gk"
Jul 02 19:16:40.155010 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:40.154986    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8a069263-cccc-4c90-a48d-19fdf10b52c1-node-exporter-textfile\") pod \"node-exporter-br7gk\" (UID: \"8a069263-cccc-4c90-a48d-19fdf10b52c1\") " pod="openshift-monitoring/node-exporter-br7gk"
Jul 02 19:16:40.155010 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:40.155005    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8a069263-cccc-4c90-a48d-19fdf10b52c1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-br7gk\" (UID: \"8a069263-cccc-4c90-a48d-19fdf10b52c1\") " pod="openshift-monitoring/node-exporter-br7gk"
Jul 02 19:16:40.155238 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:40.155048    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e6701a0-1b56-4a92-a3c9-cd4d7db150c2-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-878hv\" (UID: \"5e6701a0-1b56-4a92-a3c9-cd4d7db150c2\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-878hv"
Jul 02 19:16:40.155238 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:40.155082    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5e6701a0-1b56-4a92-a3c9-cd4d7db150c2-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-878hv\" (UID: \"5e6701a0-1b56-4a92-a3c9-cd4d7db150c2\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-878hv"
Jul 02 19:16:40.155238 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:40.155102    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8a069263-cccc-4c90-a48d-19fdf10b52c1-node-exporter-tls\") pod \"node-exporter-br7gk\" (UID: \"8a069263-cccc-4c90-a48d-19fdf10b52c1\") " pod="openshift-monitoring/node-exporter-br7gk"
Jul 02 19:16:40.155238 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:40.155119    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znsbf\" (UniqueName: \"kubernetes.io/projected/8a069263-cccc-4c90-a48d-19fdf10b52c1-kube-api-access-znsbf\") pod \"node-exporter-br7gk\" (UID: \"8a069263-cccc-4c90-a48d-19fdf10b52c1\") " pod="openshift-monitoring/node-exporter-br7gk"
Jul 02 19:16:40.155238 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:40.155162    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8a069263-cccc-4c90-a48d-19fdf10b52c1-root\") pod \"node-exporter-br7gk\" (UID: \"8a069263-cccc-4c90-a48d-19fdf10b52c1\") " pod="openshift-monitoring/node-exporter-br7gk"
Jul 02 19:16:40.155680 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:40.155662    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e6701a0-1b56-4a92-a3c9-cd4d7db150c2-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-878hv\" (UID: \"5e6701a0-1b56-4a92-a3c9-cd4d7db150c2\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-878hv"
Jul 02 19:16:40.157402 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:40.157378    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5e6701a0-1b56-4a92-a3c9-cd4d7db150c2-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-878hv\" (UID: \"5e6701a0-1b56-4a92-a3c9-cd4d7db150c2\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-878hv"
Jul 02 19:16:40.157402 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:40.157401    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5e6701a0-1b56-4a92-a3c9-cd4d7db150c2-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-878hv\" (UID: \"5e6701a0-1b56-4a92-a3c9-cd4d7db150c2\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-878hv"
Jul 02 19:16:40.158340 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:40.158321    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:40.166102 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:40.166085    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z94xz\" (UniqueName: \"kubernetes.io/projected/5e6701a0-1b56-4a92-a3c9-cd4d7db150c2-kube-api-access-z94xz\") pod \"openshift-state-metrics-54cf96dfcf-878hv\" (UID: \"5e6701a0-1b56-4a92-a3c9-cd4d7db150c2\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-878hv"
Jul 02 19:16:40.255847 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:40.255813    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8a069263-cccc-4c90-a48d-19fdf10b52c1-metrics-client-ca\") pod \"node-exporter-br7gk\" (UID: \"8a069263-cccc-4c90-a48d-19fdf10b52c1\") " pod="openshift-monitoring/node-exporter-br7gk"
Jul 02 19:16:40.256072 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:40.255855    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8a069263-cccc-4c90-a48d-19fdf10b52c1-node-exporter-textfile\") pod \"node-exporter-br7gk\" (UID: \"8a069263-cccc-4c90-a48d-19fdf10b52c1\") " pod="openshift-monitoring/node-exporter-br7gk"
Jul 02 19:16:40.256072 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:40.255885    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8a069263-cccc-4c90-a48d-19fdf10b52c1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-br7gk\" (UID: \"8a069263-cccc-4c90-a48d-19fdf10b52c1\") " pod="openshift-monitoring/node-exporter-br7gk"
Jul 02 19:16:40.256072 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:40.255966    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8a069263-cccc-4c90-a48d-19fdf10b52c1-node-exporter-tls\") pod \"node-exporter-br7gk\" (UID: \"8a069263-cccc-4c90-a48d-19fdf10b52c1\") " pod="openshift-monitoring/node-exporter-br7gk"
Jul 02 19:16:40.256072 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:40.255991    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znsbf\" (UniqueName: \"kubernetes.io/projected/8a069263-cccc-4c90-a48d-19fdf10b52c1-kube-api-access-znsbf\") pod \"node-exporter-br7gk\" (UID: \"8a069263-cccc-4c90-a48d-19fdf10b52c1\") " pod="openshift-monitoring/node-exporter-br7gk"
Jul 02 19:16:40.256270 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:16:40.256111    2562 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 02 19:16:40.256270 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:16:40.256167    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a069263-cccc-4c90-a48d-19fdf10b52c1-node-exporter-tls podName:8a069263-cccc-4c90-a48d-19fdf10b52c1 nodeName:}" failed. No retries permitted until 2026-07-02 19:16:40.756149548 +0000 UTC m=+297.120219439 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/8a069263-cccc-4c90-a48d-19fdf10b52c1-node-exporter-tls") pod "node-exporter-br7gk" (UID: "8a069263-cccc-4c90-a48d-19fdf10b52c1") : secret "node-exporter-tls" not found
Jul 02 19:16:40.256270 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:40.256218    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8a069263-cccc-4c90-a48d-19fdf10b52c1-root\") pod \"node-exporter-br7gk\" (UID: \"8a069263-cccc-4c90-a48d-19fdf10b52c1\") " pod="openshift-monitoring/node-exporter-br7gk"
Jul 02 19:16:40.256433 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:40.256277    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8a069263-cccc-4c90-a48d-19fdf10b52c1-node-exporter-wtmp\") pod \"node-exporter-br7gk\" (UID: \"8a069263-cccc-4c90-a48d-19fdf10b52c1\") " pod="openshift-monitoring/node-exporter-br7gk"
Jul 02 19:16:40.256433 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:40.256301    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8a069263-cccc-4c90-a48d-19fdf10b52c1-node-exporter-accelerators-collector-config\") pod \"node-exporter-br7gk\" (UID: \"8a069263-cccc-4c90-a48d-19fdf10b52c1\") " pod="openshift-monitoring/node-exporter-br7gk"
Jul 02 19:16:40.256433 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:40.256339    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8a069263-cccc-4c90-a48d-19fdf10b52c1-sys\") pod \"node-exporter-br7gk\" (UID: \"8a069263-cccc-4c90-a48d-19fdf10b52c1\") " pod="openshift-monitoring/node-exporter-br7gk"
Jul 02 19:16:40.256433 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:40.256377    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8a069263-cccc-4c90-a48d-19fdf10b52c1-node-exporter-textfile\") pod \"node-exporter-br7gk\" (UID: \"8a069263-cccc-4c90-a48d-19fdf10b52c1\") " pod="openshift-monitoring/node-exporter-br7gk"
Jul 02 19:16:40.256433 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:40.256393    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8a069263-cccc-4c90-a48d-19fdf10b52c1-root\") pod \"node-exporter-br7gk\" (UID: \"8a069263-cccc-4c90-a48d-19fdf10b52c1\") " pod="openshift-monitoring/node-exporter-br7gk"
Jul 02 19:16:40.256433 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:40.256408    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8a069263-cccc-4c90-a48d-19fdf10b52c1-sys\") pod \"node-exporter-br7gk\" (UID: \"8a069263-cccc-4c90-a48d-19fdf10b52c1\") " pod="openshift-monitoring/node-exporter-br7gk"
Jul 02 19:16:40.256433 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:40.256424    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8a069263-cccc-4c90-a48d-19fdf10b52c1-metrics-client-ca\") pod \"node-exporter-br7gk\" (UID: \"8a069263-cccc-4c90-a48d-19fdf10b52c1\") " pod="openshift-monitoring/node-exporter-br7gk"
Jul 02 19:16:40.256700 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:40.256527    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8a069263-cccc-4c90-a48d-19fdf10b52c1-node-exporter-wtmp\") pod \"node-exporter-br7gk\" (UID: \"8a069263-cccc-4c90-a48d-19fdf10b52c1\") " pod="openshift-monitoring/node-exporter-br7gk"
Jul 02 19:16:40.256768 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:40.256752    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8a069263-cccc-4c90-a48d-19fdf10b52c1-node-exporter-accelerators-collector-config\") pod \"node-exporter-br7gk\" (UID: \"8a069263-cccc-4c90-a48d-19fdf10b52c1\") " pod="openshift-monitoring/node-exporter-br7gk"
Jul 02 19:16:40.258397 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:40.258380    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8a069263-cccc-4c90-a48d-19fdf10b52c1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-br7gk\" (UID: \"8a069263-cccc-4c90-a48d-19fdf10b52c1\") " pod="openshift-monitoring/node-exporter-br7gk"
Jul 02 19:16:40.260567 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:40.260541    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:40.265284 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:40.265259    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-znsbf\" (UniqueName: \"kubernetes.io/projected/8a069263-cccc-4c90-a48d-19fdf10b52c1-kube-api-access-znsbf\") pod \"node-exporter-br7gk\" (UID: \"8a069263-cccc-4c90-a48d-19fdf10b52c1\") " pod="openshift-monitoring/node-exporter-br7gk"
Jul 02 19:16:40.293633 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:40.293565    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-878hv"
Jul 02 19:16:40.360029 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:40.359997    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:40.421038 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:40.421015    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-878hv"]
Jul 02 19:16:40.423018 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:16:40.422990    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e6701a0_1b56_4a92_a3c9_cd4d7db150c2.slice/crio-f414a6c3008244ffef674d78145dbdba3ca5821df84442cff919221c7b97b6f7 WatchSource:0}: Error finding container f414a6c3008244ffef674d78145dbdba3ca5821df84442cff919221c7b97b6f7: Status 404 returned error can't find the container with id f414a6c3008244ffef674d78145dbdba3ca5821df84442cff919221c7b97b6f7
Jul 02 19:16:40.424576 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:40.424465    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:40.507358 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:40.507325    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:40.759516 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:40.759484    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8a069263-cccc-4c90-a48d-19fdf10b52c1-node-exporter-tls\") pod \"node-exporter-br7gk\" (UID: \"8a069263-cccc-4c90-a48d-19fdf10b52c1\") " pod="openshift-monitoring/node-exporter-br7gk"
Jul 02 19:16:40.761949 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:40.761907    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8a069263-cccc-4c90-a48d-19fdf10b52c1-node-exporter-tls\") pod \"node-exporter-br7gk\" (UID: \"8a069263-cccc-4c90-a48d-19fdf10b52c1\") " pod="openshift-monitoring/node-exporter-br7gk"
Jul 02 19:16:40.946447 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:40.946365    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-br7gk"
Jul 02 19:16:40.958055 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:16:40.958025    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a069263_cccc_4c90_a48d_19fdf10b52c1.slice/crio-17eb8ce0f032be3e0c1b8bf153fddfe83cd65717c5c9d5ba41cb5bb62b7763a8 WatchSource:0}: Error finding container 17eb8ce0f032be3e0c1b8bf153fddfe83cd65717c5c9d5ba41cb5bb62b7763a8: Status 404 returned error can't find the container with id 17eb8ce0f032be3e0c1b8bf153fddfe83cd65717c5c9d5ba41cb5bb62b7763a8
Jul 02 19:16:41.009472 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:41.009436    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-br7gk" event={"ID":"8a069263-cccc-4c90-a48d-19fdf10b52c1","Type":"ContainerStarted","Data":"17eb8ce0f032be3e0c1b8bf153fddfe83cd65717c5c9d5ba41cb5bb62b7763a8"}
Jul 02 19:16:41.011094 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:41.011069    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-878hv" event={"ID":"5e6701a0-1b56-4a92-a3c9-cd4d7db150c2","Type":"ContainerStarted","Data":"ef57b65e94e52a27c49222f8f922199a361e68d12fa8696ea750d13034b1359f"}
Jul 02 19:16:41.011207 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:41.011116    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-878hv" event={"ID":"5e6701a0-1b56-4a92-a3c9-cd4d7db150c2","Type":"ContainerStarted","Data":"eab7a4b6b854af8e98ba375ecff9c8f9a11ff6444dce73ba4c4ed14063669ba7"}
Jul 02 19:16:41.011207 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:41.011135    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-878hv" event={"ID":"5e6701a0-1b56-4a92-a3c9-cd4d7db150c2","Type":"ContainerStarted","Data":"f414a6c3008244ffef674d78145dbdba3ca5821df84442cff919221c7b97b6f7"}
Jul 02 19:16:41.034070 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:41.034031    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:41.122746 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:41.122701    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:41.236335 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:41.236301    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:42.987614 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:42.987590    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-bdfpb"
Jul 02 19:16:42.997750 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:42.997722    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:43.020162 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:43.019568    2562 generic.go:356] "Generic (PLEG): container finished" podID="8a069263-cccc-4c90-a48d-19fdf10b52c1" containerID="94a15c770a40bc5a82a01d78d18c055db7c0d9a69a537f608efdbecb2ec8a066" exitCode=0
Jul 02 19:16:43.020162 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:43.019682    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-br7gk" event={"ID":"8a069263-cccc-4c90-a48d-19fdf10b52c1","Type":"ContainerDied","Data":"94a15c770a40bc5a82a01d78d18c055db7c0d9a69a537f608efdbecb2ec8a066"}
Jul 02 19:16:43.022751 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:43.022710    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-878hv" event={"ID":"5e6701a0-1b56-4a92-a3c9-cd4d7db150c2","Type":"ContainerStarted","Data":"93c80b94e594a85e7650d92f1b60c2944de5f441c5812e1093df90d2c8d5d406"}
Jul 02 19:16:43.079716 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:43.079668    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-878hv" podStartSLOduration=2.60205722 podStartE2EDuration="4.079651568s" totalImagesPullingTime="1.477594348s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:16:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:16:43.078794756 +0000 UTC m=+299.442864673" watchObservedRunningTime="2026-07-02 19:16:43.079651568 +0000 UTC m=+299.443721481"
Jul 02 19:16:43.106281 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:43.106253    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:43.524764 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:43.524735    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:43.875208 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:43.875107    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:43.964059 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:43.964031    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lgt7t_38beee50-e2c9-489e-91cb-f1bfad99fabf/ovn-acl-logging/0.log"
Jul 02 19:16:43.964198 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:43.964118    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lgt7t_38beee50-e2c9-489e-91cb-f1bfad99fabf/ovn-acl-logging/0.log"
Jul 02 19:16:43.967955 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:43.967934    2562 kubelet.go:1648] "Image garbage collection succeeded"
Jul 02 19:16:44.028546 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:44.028498    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-br7gk" event={"ID":"8a069263-cccc-4c90-a48d-19fdf10b52c1","Type":"ContainerStarted","Data":"615efd35718bc46c3796c3a68194963fdedfbe67f0f1dbb8425045bff1b073ae"}
Jul 02 19:16:44.028980 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:44.028563    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-br7gk" event={"ID":"8a069263-cccc-4c90-a48d-19fdf10b52c1","Type":"ContainerStarted","Data":"bb00193552f2a19c36ccdbe7270dae600cffb09b2467a76cfea85c388dd2929a"}
Jul 02 19:16:44.060318 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:44.060265    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-br7gk" podStartSLOduration=2.922972245 podStartE2EDuration="4.060248532s" totalImagesPullingTime="1.063367437s" totalInitContainerRuntime="73.90885ms" isStatefulPod=true podCreationTimestamp="2026-07-02 19:16:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:16:44.057828311 +0000 UTC m=+300.421898252" watchObservedRunningTime="2026-07-02 19:16:44.060248532 +0000 UTC m=+300.424318444"
Jul 02 19:16:44.215102 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:44.215075    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:44.320136 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:44.320103    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:44.392890 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:44.392856    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-775789cf48-d69j6"]
Jul 02 19:16:44.395662 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:44.395645    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-775789cf48-d69j6"
Jul 02 19:16:44.399238 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:44.399205    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 02 19:16:44.399342 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:44.399205    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 02 19:16:44.399516 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:44.399499    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 02 19:16:44.400564 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:44.400543    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-9rb6ecvo3jo06\""
Jul 02 19:16:44.400653 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:44.400633    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 02 19:16:44.400780 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:44.400764    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-lsnsm\""
Jul 02 19:16:44.408340 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:44.408319    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-775789cf48-d69j6"]
Jul 02 19:16:44.491573 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:44.491484    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/fecf4dfd-9dec-486a-96a8-7bbf7abb8a2b-audit-log\") pod \"metrics-server-775789cf48-d69j6\" (UID: \"fecf4dfd-9dec-486a-96a8-7bbf7abb8a2b\") " pod="openshift-monitoring/metrics-server-775789cf48-d69j6"
Jul 02 19:16:44.491573 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:44.491536    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/fecf4dfd-9dec-486a-96a8-7bbf7abb8a2b-metrics-server-audit-profiles\") pod \"metrics-server-775789cf48-d69j6\" (UID: \"fecf4dfd-9dec-486a-96a8-7bbf7abb8a2b\") " pod="openshift-monitoring/metrics-server-775789cf48-d69j6"
Jul 02 19:16:44.491573 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:44.491560    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/fecf4dfd-9dec-486a-96a8-7bbf7abb8a2b-secret-metrics-server-client-certs\") pod \"metrics-server-775789cf48-d69j6\" (UID: \"fecf4dfd-9dec-486a-96a8-7bbf7abb8a2b\") " pod="openshift-monitoring/metrics-server-775789cf48-d69j6"
Jul 02 19:16:44.491773 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:44.491606    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgrgl\" (UniqueName: \"kubernetes.io/projected/fecf4dfd-9dec-486a-96a8-7bbf7abb8a2b-kube-api-access-rgrgl\") pod \"metrics-server-775789cf48-d69j6\" (UID: \"fecf4dfd-9dec-486a-96a8-7bbf7abb8a2b\") " pod="openshift-monitoring/metrics-server-775789cf48-d69j6"
Jul 02 19:16:44.491773 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:44.491627    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/fecf4dfd-9dec-486a-96a8-7bbf7abb8a2b-secret-metrics-server-tls\") pod \"metrics-server-775789cf48-d69j6\" (UID: \"fecf4dfd-9dec-486a-96a8-7bbf7abb8a2b\") " pod="openshift-monitoring/metrics-server-775789cf48-d69j6"
Jul 02 19:16:44.491773 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:44.491646    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fecf4dfd-9dec-486a-96a8-7bbf7abb8a2b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-775789cf48-d69j6\" (UID: \"fecf4dfd-9dec-486a-96a8-7bbf7abb8a2b\") " pod="openshift-monitoring/metrics-server-775789cf48-d69j6"
Jul 02 19:16:44.491773 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:44.491662    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fecf4dfd-9dec-486a-96a8-7bbf7abb8a2b-client-ca-bundle\") pod \"metrics-server-775789cf48-d69j6\" (UID: \"fecf4dfd-9dec-486a-96a8-7bbf7abb8a2b\") " pod="openshift-monitoring/metrics-server-775789cf48-d69j6"
Jul 02 19:16:44.514463 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:44.514440    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:44.592284 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:44.592245    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgrgl\" (UniqueName: \"kubernetes.io/projected/fecf4dfd-9dec-486a-96a8-7bbf7abb8a2b-kube-api-access-rgrgl\") pod \"metrics-server-775789cf48-d69j6\" (UID: \"fecf4dfd-9dec-486a-96a8-7bbf7abb8a2b\") " pod="openshift-monitoring/metrics-server-775789cf48-d69j6"
Jul 02 19:16:44.592284 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:44.592287    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/fecf4dfd-9dec-486a-96a8-7bbf7abb8a2b-secret-metrics-server-tls\") pod \"metrics-server-775789cf48-d69j6\" (UID: \"fecf4dfd-9dec-486a-96a8-7bbf7abb8a2b\") " pod="openshift-monitoring/metrics-server-775789cf48-d69j6"
Jul 02 19:16:44.592511 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:44.592311    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fecf4dfd-9dec-486a-96a8-7bbf7abb8a2b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-775789cf48-d69j6\" (UID: \"fecf4dfd-9dec-486a-96a8-7bbf7abb8a2b\") " pod="openshift-monitoring/metrics-server-775789cf48-d69j6"
Jul 02 19:16:44.592511 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:44.592434    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fecf4dfd-9dec-486a-96a8-7bbf7abb8a2b-client-ca-bundle\") pod \"metrics-server-775789cf48-d69j6\" (UID: \"fecf4dfd-9dec-486a-96a8-7bbf7abb8a2b\") " pod="openshift-monitoring/metrics-server-775789cf48-d69j6"
Jul 02 19:16:44.592511 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:44.592477    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/fecf4dfd-9dec-486a-96a8-7bbf7abb8a2b-audit-log\") pod \"metrics-server-775789cf48-d69j6\" (UID: \"fecf4dfd-9dec-486a-96a8-7bbf7abb8a2b\") " pod="openshift-monitoring/metrics-server-775789cf48-d69j6"
Jul 02 19:16:44.592641 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:44.592531    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/fecf4dfd-9dec-486a-96a8-7bbf7abb8a2b-metrics-server-audit-profiles\") pod \"metrics-server-775789cf48-d69j6\" (UID: \"fecf4dfd-9dec-486a-96a8-7bbf7abb8a2b\") " pod="openshift-monitoring/metrics-server-775789cf48-d69j6"
Jul 02 19:16:44.592641 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:44.592568    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/fecf4dfd-9dec-486a-96a8-7bbf7abb8a2b-secret-metrics-server-client-certs\") pod \"metrics-server-775789cf48-d69j6\" (UID: \"fecf4dfd-9dec-486a-96a8-7bbf7abb8a2b\") " pod="openshift-monitoring/metrics-server-775789cf48-d69j6"
Jul 02 19:16:44.593004 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:44.592980    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/fecf4dfd-9dec-486a-96a8-7bbf7abb8a2b-audit-log\") pod \"metrics-server-775789cf48-d69j6\" (UID: \"fecf4dfd-9dec-486a-96a8-7bbf7abb8a2b\") " pod="openshift-monitoring/metrics-server-775789cf48-d69j6"
Jul 02 19:16:44.593146 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:44.593052    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fecf4dfd-9dec-486a-96a8-7bbf7abb8a2b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-775789cf48-d69j6\" (UID: \"fecf4dfd-9dec-486a-96a8-7bbf7abb8a2b\") " pod="openshift-monitoring/metrics-server-775789cf48-d69j6"
Jul 02 19:16:44.593477 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:44.593452    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/fecf4dfd-9dec-486a-96a8-7bbf7abb8a2b-metrics-server-audit-profiles\") pod \"metrics-server-775789cf48-d69j6\" (UID: \"fecf4dfd-9dec-486a-96a8-7bbf7abb8a2b\") " pod="openshift-monitoring/metrics-server-775789cf48-d69j6"
Jul 02 19:16:44.594875 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:44.594853    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fecf4dfd-9dec-486a-96a8-7bbf7abb8a2b-client-ca-bundle\") pod \"metrics-server-775789cf48-d69j6\" (UID: \"fecf4dfd-9dec-486a-96a8-7bbf7abb8a2b\") " pod="openshift-monitoring/metrics-server-775789cf48-d69j6"
Jul 02 19:16:44.594977 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:44.594944    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/fecf4dfd-9dec-486a-96a8-7bbf7abb8a2b-secret-metrics-server-tls\") pod \"metrics-server-775789cf48-d69j6\" (UID: \"fecf4dfd-9dec-486a-96a8-7bbf7abb8a2b\") " pod="openshift-monitoring/metrics-server-775789cf48-d69j6"
Jul 02 19:16:44.595097 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:44.595077    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/fecf4dfd-9dec-486a-96a8-7bbf7abb8a2b-secret-metrics-server-client-certs\") pod \"metrics-server-775789cf48-d69j6\" (UID: \"fecf4dfd-9dec-486a-96a8-7bbf7abb8a2b\") " pod="openshift-monitoring/metrics-server-775789cf48-d69j6"
Jul 02 19:16:44.602349 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:44.602332    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgrgl\" (UniqueName: \"kubernetes.io/projected/fecf4dfd-9dec-486a-96a8-7bbf7abb8a2b-kube-api-access-rgrgl\") pod \"metrics-server-775789cf48-d69j6\" (UID: \"fecf4dfd-9dec-486a-96a8-7bbf7abb8a2b\") " pod="openshift-monitoring/metrics-server-775789cf48-d69j6"
Jul 02 19:16:44.704740 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:44.704705    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-775789cf48-d69j6"
Jul 02 19:16:44.777967 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:44.777938    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:44.842044 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:44.842013    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-775789cf48-d69j6"]
Jul 02 19:16:44.845059 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:16:44.845033    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfecf4dfd_9dec_486a_96a8_7bbf7abb8a2b.slice/crio-532250cefb5224c0d30171946f8430583d84557a3a6390b6a47dd29695335bfa WatchSource:0}: Error finding container 532250cefb5224c0d30171946f8430583d84557a3a6390b6a47dd29695335bfa: Status 404 returned error can't find the container with id 532250cefb5224c0d30171946f8430583d84557a3a6390b6a47dd29695335bfa
Jul 02 19:16:44.880233 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:44.880200    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:44.978147 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:44.978120    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:45.033469 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:45.033391    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-775789cf48-d69j6" event={"ID":"fecf4dfd-9dec-486a-96a8-7bbf7abb8a2b","Type":"ContainerStarted","Data":"532250cefb5224c0d30171946f8430583d84557a3a6390b6a47dd29695335bfa"}
Jul 02 19:16:45.258836 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:45.258804    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:45.361527 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:45.361453    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:45.663833 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:45.663739    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:45.763982 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:45.763943    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:46.142175 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.142126    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:46.336059 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.336021    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:46.342583 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.342560    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 02 19:16:46.346402 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.346383    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:16:46.349640 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.349481    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 02 19:16:46.349640 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.349516    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-e2prar2vaadi7\""
Jul 02 19:16:46.349640 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.349516    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 02 19:16:46.349640 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.349518    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 02 19:16:46.350060 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.350040    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 02 19:16:46.350151 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.350115    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 02 19:16:46.350256 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.350236    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 02 19:16:46.351112 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.351093    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 02 19:16:46.351214 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.351101    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 02 19:16:46.351313 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.351297    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 02 19:16:46.351611 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.351568    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 02 19:16:46.351706 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.351631    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 02 19:16:46.351706 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.351636    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-xbrg9\""
Jul 02 19:16:46.352450 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.352410    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 02 19:16:46.356020 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.355979    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 02 19:16:46.357346 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.357328    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 02 19:16:46.365991 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.365960    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 02 19:16:46.407645 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.407568    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a888795d-1afa-48a3-981f-8db2cdf26174-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a888795d-1afa-48a3-981f-8db2cdf26174\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:16:46.407873 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.407833    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a888795d-1afa-48a3-981f-8db2cdf26174-web-config\") pod \"prometheus-k8s-0\" (UID: \"a888795d-1afa-48a3-981f-8db2cdf26174\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:16:46.408008 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.407882    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a888795d-1afa-48a3-981f-8db2cdf26174-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a888795d-1afa-48a3-981f-8db2cdf26174\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:16:46.408008 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.407938    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a888795d-1afa-48a3-981f-8db2cdf26174-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a888795d-1afa-48a3-981f-8db2cdf26174\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:16:46.408008 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.407957    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a888795d-1afa-48a3-981f-8db2cdf26174-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a888795d-1afa-48a3-981f-8db2cdf26174\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:16:46.408170 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.408001    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a888795d-1afa-48a3-981f-8db2cdf26174-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a888795d-1afa-48a3-981f-8db2cdf26174\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:16:46.408170 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.408043    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a888795d-1afa-48a3-981f-8db2cdf26174-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a888795d-1afa-48a3-981f-8db2cdf26174\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:16:46.408170 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.408083    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a888795d-1afa-48a3-981f-8db2cdf26174-config-out\") pod \"prometheus-k8s-0\" (UID: \"a888795d-1afa-48a3-981f-8db2cdf26174\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:16:46.408170 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.408107    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a888795d-1afa-48a3-981f-8db2cdf26174-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a888795d-1afa-48a3-981f-8db2cdf26174\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:16:46.408170 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.408128    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a888795d-1afa-48a3-981f-8db2cdf26174-config\") pod \"prometheus-k8s-0\" (UID: \"a888795d-1afa-48a3-981f-8db2cdf26174\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:16:46.408170 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.408153    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a888795d-1afa-48a3-981f-8db2cdf26174-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a888795d-1afa-48a3-981f-8db2cdf26174\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:16:46.408623 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.408208    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a888795d-1afa-48a3-981f-8db2cdf26174-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a888795d-1afa-48a3-981f-8db2cdf26174\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:16:46.408623 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.408237    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a888795d-1afa-48a3-981f-8db2cdf26174-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a888795d-1afa-48a3-981f-8db2cdf26174\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:16:46.408623 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.408269    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-949xk\" (UniqueName: \"kubernetes.io/projected/a888795d-1afa-48a3-981f-8db2cdf26174-kube-api-access-949xk\") pod \"prometheus-k8s-0\" (UID: \"a888795d-1afa-48a3-981f-8db2cdf26174\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:16:46.408623 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.408290    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a888795d-1afa-48a3-981f-8db2cdf26174-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a888795d-1afa-48a3-981f-8db2cdf26174\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:16:46.408623 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.408321    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a888795d-1afa-48a3-981f-8db2cdf26174-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a888795d-1afa-48a3-981f-8db2cdf26174\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:16:46.408623 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.408341    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a888795d-1afa-48a3-981f-8db2cdf26174-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a888795d-1afa-48a3-981f-8db2cdf26174\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:16:46.408623 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.408367    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a888795d-1afa-48a3-981f-8db2cdf26174-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a888795d-1afa-48a3-981f-8db2cdf26174\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:16:46.408623 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.408398    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a888795d-1afa-48a3-981f-8db2cdf26174-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a888795d-1afa-48a3-981f-8db2cdf26174\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:16:46.408623 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.408452    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a888795d-1afa-48a3-981f-8db2cdf26174-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a888795d-1afa-48a3-981f-8db2cdf26174\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:16:46.491018 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.490977    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:46.509700 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.509663    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a888795d-1afa-48a3-981f-8db2cdf26174-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a888795d-1afa-48a3-981f-8db2cdf26174\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:16:46.509881 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.509705    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a888795d-1afa-48a3-981f-8db2cdf26174-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a888795d-1afa-48a3-981f-8db2cdf26174\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:16:46.509881 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.509756    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a888795d-1afa-48a3-981f-8db2cdf26174-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a888795d-1afa-48a3-981f-8db2cdf26174\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:16:46.509881 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.509777    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a888795d-1afa-48a3-981f-8db2cdf26174-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a888795d-1afa-48a3-981f-8db2cdf26174\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:16:46.509881 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.509800    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a888795d-1afa-48a3-981f-8db2cdf26174-web-config\") pod \"prometheus-k8s-0\" (UID: \"a888795d-1afa-48a3-981f-8db2cdf26174\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:16:46.509881 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.509835    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a888795d-1afa-48a3-981f-8db2cdf26174-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a888795d-1afa-48a3-981f-8db2cdf26174\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:16:46.509881 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.509867    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a888795d-1afa-48a3-981f-8db2cdf26174-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a888795d-1afa-48a3-981f-8db2cdf26174\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:16:46.510216 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.509893    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a888795d-1afa-48a3-981f-8db2cdf26174-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a888795d-1afa-48a3-981f-8db2cdf26174\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:16:46.510216 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.509937    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a888795d-1afa-48a3-981f-8db2cdf26174-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a888795d-1afa-48a3-981f-8db2cdf26174\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:16:46.510216 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.509967    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a888795d-1afa-48a3-981f-8db2cdf26174-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a888795d-1afa-48a3-981f-8db2cdf26174\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:16:46.510216 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.510001    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a888795d-1afa-48a3-981f-8db2cdf26174-config-out\") pod \"prometheus-k8s-0\" (UID: \"a888795d-1afa-48a3-981f-8db2cdf26174\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:16:46.510216 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.510023    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a888795d-1afa-48a3-981f-8db2cdf26174-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a888795d-1afa-48a3-981f-8db2cdf26174\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:16:46.510216 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.510044    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a888795d-1afa-48a3-981f-8db2cdf26174-config\") pod \"prometheus-k8s-0\" (UID: \"a888795d-1afa-48a3-981f-8db2cdf26174\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:16:46.510216 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.510066    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a888795d-1afa-48a3-981f-8db2cdf26174-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a888795d-1afa-48a3-981f-8db2cdf26174\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:16:46.510216 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.510099    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a888795d-1afa-48a3-981f-8db2cdf26174-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a888795d-1afa-48a3-981f-8db2cdf26174\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:16:46.510216 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.510120    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a888795d-1afa-48a3-981f-8db2cdf26174-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a888795d-1afa-48a3-981f-8db2cdf26174\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:16:46.510216 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.510156    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-949xk\" (UniqueName: \"kubernetes.io/projected/a888795d-1afa-48a3-981f-8db2cdf26174-kube-api-access-949xk\") pod \"prometheus-k8s-0\" (UID: \"a888795d-1afa-48a3-981f-8db2cdf26174\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:16:46.510216 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.510182    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a888795d-1afa-48a3-981f-8db2cdf26174-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a888795d-1afa-48a3-981f-8db2cdf26174\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:16:46.510702 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.510220    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a888795d-1afa-48a3-981f-8db2cdf26174-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a888795d-1afa-48a3-981f-8db2cdf26174\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:16:46.510702 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.510244    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a888795d-1afa-48a3-981f-8db2cdf26174-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a888795d-1afa-48a3-981f-8db2cdf26174\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:16:46.510702 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.510540    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a888795d-1afa-48a3-981f-8db2cdf26174-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a888795d-1afa-48a3-981f-8db2cdf26174\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:16:46.511227 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.511191    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a888795d-1afa-48a3-981f-8db2cdf26174-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a888795d-1afa-48a3-981f-8db2cdf26174\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:16:46.511326 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.511264    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a888795d-1afa-48a3-981f-8db2cdf26174-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a888795d-1afa-48a3-981f-8db2cdf26174\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:16:46.511847 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.511824    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a888795d-1afa-48a3-981f-8db2cdf26174-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a888795d-1afa-48a3-981f-8db2cdf26174\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:16:46.513716 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.513227    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a888795d-1afa-48a3-981f-8db2cdf26174-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a888795d-1afa-48a3-981f-8db2cdf26174\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:16:46.513716 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.513310    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a888795d-1afa-48a3-981f-8db2cdf26174-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a888795d-1afa-48a3-981f-8db2cdf26174\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:16:46.513716 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.513533    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/a888795d-1afa-48a3-981f-8db2cdf26174-config\") pod \"prometheus-k8s-0\" (UID: \"a888795d-1afa-48a3-981f-8db2cdf26174\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:16:46.514114 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.514046    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a888795d-1afa-48a3-981f-8db2cdf26174-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a888795d-1afa-48a3-981f-8db2cdf26174\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:16:46.514114 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.514057    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a888795d-1afa-48a3-981f-8db2cdf26174-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a888795d-1afa-48a3-981f-8db2cdf26174\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:16:46.514275 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.514203    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a888795d-1afa-48a3-981f-8db2cdf26174-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a888795d-1afa-48a3-981f-8db2cdf26174\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:16:46.514805 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.514778    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a888795d-1afa-48a3-981f-8db2cdf26174-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a888795d-1afa-48a3-981f-8db2cdf26174\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:16:46.515378 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.515329    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a888795d-1afa-48a3-981f-8db2cdf26174-web-config\") pod \"prometheus-k8s-0\" (UID: \"a888795d-1afa-48a3-981f-8db2cdf26174\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:16:46.516468 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.516444    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a888795d-1afa-48a3-981f-8db2cdf26174-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a888795d-1afa-48a3-981f-8db2cdf26174\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:16:46.516584 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.516544    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a888795d-1afa-48a3-981f-8db2cdf26174-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a888795d-1afa-48a3-981f-8db2cdf26174\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:16:46.516584 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.516575    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a888795d-1afa-48a3-981f-8db2cdf26174-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a888795d-1afa-48a3-981f-8db2cdf26174\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:16:46.517000 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.516978    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a888795d-1afa-48a3-981f-8db2cdf26174-config-out\") pod \"prometheus-k8s-0\" (UID: \"a888795d-1afa-48a3-981f-8db2cdf26174\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:16:46.517231 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.517201    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a888795d-1afa-48a3-981f-8db2cdf26174-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a888795d-1afa-48a3-981f-8db2cdf26174\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:16:46.517685 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.517665    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a888795d-1afa-48a3-981f-8db2cdf26174-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a888795d-1afa-48a3-981f-8db2cdf26174\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:16:46.517944 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.517871    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a888795d-1afa-48a3-981f-8db2cdf26174-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a888795d-1afa-48a3-981f-8db2cdf26174\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:16:46.523479 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.523452    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-949xk\" (UniqueName: \"kubernetes.io/projected/a888795d-1afa-48a3-981f-8db2cdf26174-kube-api-access-949xk\") pod \"prometheus-k8s-0\" (UID: \"a888795d-1afa-48a3-981f-8db2cdf26174\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:16:46.659238 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.658961    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:16:46.810112 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.810078    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 02 19:16:46.814358 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:16:46.814333    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda888795d_1afa_48a3_981f_8db2cdf26174.slice/crio-d91871955f77d6f4fe85e1af8c1e14fa1c67b372faeec9f6ca8edb21127dda77 WatchSource:0}: Error finding container d91871955f77d6f4fe85e1af8c1e14fa1c67b372faeec9f6ca8edb21127dda77: Status 404 returned error can't find the container with id d91871955f77d6f4fe85e1af8c1e14fa1c67b372faeec9f6ca8edb21127dda77
Jul 02 19:16:46.816812 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:46.816798    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 19:16:47.041811 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:47.041756    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-775789cf48-d69j6" event={"ID":"fecf4dfd-9dec-486a-96a8-7bbf7abb8a2b","Type":"ContainerStarted","Data":"022d22693d32b6f91d8b02cfa296ac09d3f6de5efc6c3ddc24e405f3220d8914"}
Jul 02 19:16:47.043188 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:47.043157    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a888795d-1afa-48a3-981f-8db2cdf26174","Type":"ContainerStarted","Data":"d91871955f77d6f4fe85e1af8c1e14fa1c67b372faeec9f6ca8edb21127dda77"}
Jul 02 19:16:47.064167 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:47.064115    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-775789cf48-d69j6" podStartSLOduration=1.292713414 podStartE2EDuration="3.064099532s" totalImagesPullingTime="1.771386118s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:16:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:16:47.063412489 +0000 UTC m=+303.427482404" watchObservedRunningTime="2026-07-02 19:16:47.064099532 +0000 UTC m=+303.428169444"
Jul 02 19:16:47.090050 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:47.090009    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:48.048347 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:48.048311    2562 generic.go:356] "Generic (PLEG): container finished" podID="a888795d-1afa-48a3-981f-8db2cdf26174" containerID="acbc5cc6255dd8fe692e774c71757c65208c4074bd6d40e04689179444db47f3" exitCode=0
Jul 02 19:16:48.048721 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:48.048406    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a888795d-1afa-48a3-981f-8db2cdf26174","Type":"ContainerDied","Data":"acbc5cc6255dd8fe692e774c71757c65208c4074bd6d40e04689179444db47f3"}
Jul 02 19:16:48.643968 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:48.643903    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:48.709969 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:48.709936    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:50.196695 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:50.196659    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:50.268175 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:50.268136    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:51.112328 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:51.112293    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2b9th"
Jul 02 19:16:51.167498 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:51.167458    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:51.269804 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:51.269774    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:52.069312 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:52.069274    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a888795d-1afa-48a3-981f-8db2cdf26174","Type":"ContainerStarted","Data":"1dff8f5d40df7e58529107464828ef3259a3a80f26e7f1ebb9ee678ce1cf1146"}
Jul 02 19:16:52.069501 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:52.069358    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a888795d-1afa-48a3-981f-8db2cdf26174","Type":"ContainerStarted","Data":"60b896a919a877d28db28714fa509c3d6fd8c5af2b3016616db26f75ef118274"}
Jul 02 19:16:53.397158 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:53.397111    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:53.463859 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:53.463826    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:55.083557 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:55.083523    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a888795d-1afa-48a3-981f-8db2cdf26174","Type":"ContainerStarted","Data":"d383229db39baf44723ed7959a4bd7329bf945342fa4bc8b9db9492e8cc38f90"}
Jul 02 19:16:55.083939 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:55.083618    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a888795d-1afa-48a3-981f-8db2cdf26174","Type":"ContainerStarted","Data":"ede80c051463233a62c8474e08a25bd127e60768ef272dc50bdae65dbad2e054"}
Jul 02 19:16:55.083939 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:55.083647    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a888795d-1afa-48a3-981f-8db2cdf26174","Type":"ContainerStarted","Data":"f09f0a7074f10220a6c259be57831dbc9943c0d7377102e708547b31d4259259"}
Jul 02 19:16:55.083939 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:55.083671    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a888795d-1afa-48a3-981f-8db2cdf26174","Type":"ContainerStarted","Data":"55274ba1e04ee3991077575d13b5b52ef0f95e0cac393c2b8d870476771addd6"}
Jul 02 19:16:55.115837 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:55.115783    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.935929574 podStartE2EDuration="9.115767914s" totalImagesPullingTime="7.161812441s" totalInitContainerRuntime="18.025899ms" isStatefulPod=false podCreationTimestamp="2026-07-02 19:16:46 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:16:55.113884635 +0000 UTC m=+311.477954561" watchObservedRunningTime="2026-07-02 19:16:55.115767914 +0000 UTC m=+311.479837826"
Jul 02 19:16:56.660419 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:56.660379    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:16:59.089467 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:59.089433    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:16:59.157533 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:16:59.157506    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:17:00.143039 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:17:00.143011    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:17:00.240792 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:17:00.240757    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:17:02.491868 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:17:02.491836    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:17:04.704997 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:17:04.704968    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-775789cf48-d69j6"
Jul 02 19:17:04.705355 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:17:04.705026    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-775789cf48-d69j6"
Jul 02 19:17:08.395278 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:17:08.395247    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:17:08.491968 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:17:08.491934    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:17:08.593188 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:17:08.593155    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:17:12.724681 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:17:12.724648    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:17:12.788582 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:17:12.788551    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:17:17.857808 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:17:17.857779    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7b6dc76c65-jtd7c_9df21515-928e-4ce4-a97f-b90af84dbd02/router/0.log"
Jul 02 19:17:17.880000 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:17:17.879967    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pl552_186d4a7b-65a2-4613-92bf-5bbeee5f6a56/serve-healthcheck-canary/0.log"
Jul 02 19:17:23.184079 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:17:23.184046    2562 generic.go:356] "Generic (PLEG): container finished" podID="3639ebc4-c5e8-4a3d-9576-c34de3fb40e4" containerID="adf427182a2f637d618f1e55f71fa5425becce9a0d6720a29d6df1a20debfe7e" exitCode=0
Jul 02 19:17:23.184485 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:17:23.184100    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-kc8ht" event={"ID":"3639ebc4-c5e8-4a3d-9576-c34de3fb40e4","Type":"ContainerDied","Data":"adf427182a2f637d618f1e55f71fa5425becce9a0d6720a29d6df1a20debfe7e"}
Jul 02 19:17:23.184485 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:17:23.184399    2562 scope.go:117] "RemoveContainer" containerID="adf427182a2f637d618f1e55f71fa5425becce9a0d6720a29d6df1a20debfe7e"
Jul 02 19:17:23.413141 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:17:23.413094    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:17:23.513969 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:17:23.513935    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:17:24.190077 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:17:24.190046    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-kc8ht" event={"ID":"3639ebc4-c5e8-4a3d-9576-c34de3fb40e4","Type":"ContainerStarted","Data":"355575b3424982e9d768f16e3b1383876399178c700aca9d5296ca624934689e"}
Jul 02 19:17:24.711223 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:17:24.711190    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-775789cf48-d69j6"
Jul 02 19:17:24.715770 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:17:24.715746    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-775789cf48-d69j6"
Jul 02 19:17:30.176340 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:17:30.176310    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:17:30.277075 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:17:30.277032    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:17:30.334369 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:17:30.334266    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:17:44.435960 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:17:44.435867    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:17:44.527769 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:17:44.527739    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:17:46.659985 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:17:46.659944    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:17:46.675700 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:17:46.675674    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:17:47.291032 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:17:47.291005    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:17:57.825207 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:17:57.825166    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0e53e82-59ae-4430-9470-2648eb4eafb4-metrics-certs\") pod \"network-metrics-daemon-2b9th\" (UID: \"d0e53e82-59ae-4430-9470-2648eb4eafb4\") " pod="openshift-multus/network-metrics-daemon-2b9th"
Jul 02 19:17:57.827525 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:17:57.827506    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0e53e82-59ae-4430-9470-2648eb4eafb4-metrics-certs\") pod \"network-metrics-daemon-2b9th\" (UID: \"d0e53e82-59ae-4430-9470-2648eb4eafb4\") " pod="openshift-multus/network-metrics-daemon-2b9th"
Jul 02 19:17:58.016043 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:17:58.016012    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-shdtl\""
Jul 02 19:17:58.023304 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:17:58.023283    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2b9th"
Jul 02 19:17:58.152715 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:17:58.152693    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2b9th"]
Jul 02 19:17:58.154723 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:17:58.154700    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0e53e82_59ae_4430_9470_2648eb4eafb4.slice/crio-c5f860210928c63da55abf47f9bd52a9b78ae6c21428c6ca489d03c3b70351c9 WatchSource:0}: Error finding container c5f860210928c63da55abf47f9bd52a9b78ae6c21428c6ca489d03c3b70351c9: Status 404 returned error can't find the container with id c5f860210928c63da55abf47f9bd52a9b78ae6c21428c6ca489d03c3b70351c9
Jul 02 19:17:58.313724 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:17:58.313687    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2b9th" event={"ID":"d0e53e82-59ae-4430-9470-2648eb4eafb4","Type":"ContainerStarted","Data":"c5f860210928c63da55abf47f9bd52a9b78ae6c21428c6ca489d03c3b70351c9"}
Jul 02 19:17:58.567293 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:17:58.567261    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:17:58.627404 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:17:58.627368    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:17:59.282907 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:17:59.282828    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:17:59.318465 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:17:59.318432    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2b9th" event={"ID":"d0e53e82-59ae-4430-9470-2648eb4eafb4","Type":"ContainerStarted","Data":"70b2fdd6432e5b71b56ce991ca2f496ca8a3ec245d330ac925392e85d42e213a"}
Jul 02 19:17:59.318644 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:17:59.318479    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2b9th" event={"ID":"d0e53e82-59ae-4430-9470-2648eb4eafb4","Type":"ContainerStarted","Data":"0b8688d3678d3ea3a1c8cebeeaf9230f5199f26608813c5f653265b86c455879"}
Jul 02 19:17:59.340404 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:17:59.340360    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-2b9th" podStartSLOduration=374.529336771 podStartE2EDuration="6m15.340345787s" totalImagesPullingTime="811.009016ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:11:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:17:59.338204869 +0000 UTC m=+375.702274782" watchObservedRunningTime="2026-07-02 19:17:59.340345787 +0000 UTC m=+375.704415700"
Jul 02 19:17:59.483881 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:17:59.483848    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:17:59.583442 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:17:59.583361    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:17:59.693815 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:17:59.693787    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:18:04.665043 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:04.665009    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 02 19:18:04.665584 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:04.665277    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a888795d-1afa-48a3-981f-8db2cdf26174" containerName="prometheus" containerID="cri-o://60b896a919a877d28db28714fa509c3d6fd8c5af2b3016616db26f75ef118274" gracePeriod=600
Jul 02 19:18:04.665584 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:04.665301    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a888795d-1afa-48a3-981f-8db2cdf26174" containerName="kube-rbac-proxy" containerID="cri-o://ede80c051463233a62c8474e08a25bd127e60768ef272dc50bdae65dbad2e054" gracePeriod=600
Jul 02 19:18:04.665584 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:04.665352    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a888795d-1afa-48a3-981f-8db2cdf26174" containerName="config-reloader" containerID="cri-o://1dff8f5d40df7e58529107464828ef3259a3a80f26e7f1ebb9ee678ce1cf1146" gracePeriod=600
Jul 02 19:18:04.665584 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:04.665307    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a888795d-1afa-48a3-981f-8db2cdf26174" containerName="thanos-sidecar" containerID="cri-o://55274ba1e04ee3991077575d13b5b52ef0f95e0cac393c2b8d870476771addd6" gracePeriod=600
Jul 02 19:18:04.665584 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:04.665430    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a888795d-1afa-48a3-981f-8db2cdf26174" containerName="kube-rbac-proxy-web" containerID="cri-o://f09f0a7074f10220a6c259be57831dbc9943c0d7377102e708547b31d4259259" gracePeriod=600
Jul 02 19:18:04.665584 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:04.665480    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a888795d-1afa-48a3-981f-8db2cdf26174" containerName="kube-rbac-proxy-thanos" containerID="cri-o://d383229db39baf44723ed7959a4bd7329bf945342fa4bc8b9db9492e8cc38f90" gracePeriod=600
Jul 02 19:18:04.920757 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:04.920691    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:18:04.984234 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:04.984195    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a888795d-1afa-48a3-981f-8db2cdf26174-prometheus-k8s-db\") pod \"a888795d-1afa-48a3-981f-8db2cdf26174\" (UID: \"a888795d-1afa-48a3-981f-8db2cdf26174\") "
Jul 02 19:18:04.984234 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:04.984239    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a888795d-1afa-48a3-981f-8db2cdf26174-configmap-serving-certs-ca-bundle\") pod \"a888795d-1afa-48a3-981f-8db2cdf26174\" (UID: \"a888795d-1afa-48a3-981f-8db2cdf26174\") "
Jul 02 19:18:04.984465 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:04.984277    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a888795d-1afa-48a3-981f-8db2cdf26174-thanos-prometheus-http-client-file\") pod \"a888795d-1afa-48a3-981f-8db2cdf26174\" (UID: \"a888795d-1afa-48a3-981f-8db2cdf26174\") "
Jul 02 19:18:04.984465 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:04.984301    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a888795d-1afa-48a3-981f-8db2cdf26174-config\") pod \"a888795d-1afa-48a3-981f-8db2cdf26174\" (UID: \"a888795d-1afa-48a3-981f-8db2cdf26174\") "
Jul 02 19:18:04.984465 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:04.984321    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a888795d-1afa-48a3-981f-8db2cdf26174-prometheus-k8s-rulefiles-1\") pod \"a888795d-1afa-48a3-981f-8db2cdf26174\" (UID: \"a888795d-1afa-48a3-981f-8db2cdf26174\") "
Jul 02 19:18:04.984465 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:04.984348    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a888795d-1afa-48a3-981f-8db2cdf26174-configmap-metrics-client-ca\") pod \"a888795d-1afa-48a3-981f-8db2cdf26174\" (UID: \"a888795d-1afa-48a3-981f-8db2cdf26174\") "
Jul 02 19:18:04.984465 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:04.984375    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a888795d-1afa-48a3-981f-8db2cdf26174-configmap-kubelet-serving-ca-bundle\") pod \"a888795d-1afa-48a3-981f-8db2cdf26174\" (UID: \"a888795d-1afa-48a3-981f-8db2cdf26174\") "
Jul 02 19:18:04.984465 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:04.984395    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a888795d-1afa-48a3-981f-8db2cdf26174-tls-assets\") pod \"a888795d-1afa-48a3-981f-8db2cdf26174\" (UID: \"a888795d-1afa-48a3-981f-8db2cdf26174\") "
Jul 02 19:18:04.984465 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:04.984431    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a888795d-1afa-48a3-981f-8db2cdf26174-secret-metrics-client-certs\") pod \"a888795d-1afa-48a3-981f-8db2cdf26174\" (UID: \"a888795d-1afa-48a3-981f-8db2cdf26174\") "
Jul 02 19:18:04.984465 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:04.984462    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a888795d-1afa-48a3-981f-8db2cdf26174-secret-grpc-tls\") pod \"a888795d-1afa-48a3-981f-8db2cdf26174\" (UID: \"a888795d-1afa-48a3-981f-8db2cdf26174\") "
Jul 02 19:18:04.984849 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:04.984500    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-949xk\" (UniqueName: \"kubernetes.io/projected/a888795d-1afa-48a3-981f-8db2cdf26174-kube-api-access-949xk\") pod \"a888795d-1afa-48a3-981f-8db2cdf26174\" (UID: \"a888795d-1afa-48a3-981f-8db2cdf26174\") "
Jul 02 19:18:04.984849 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:04.984526    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a888795d-1afa-48a3-981f-8db2cdf26174-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"a888795d-1afa-48a3-981f-8db2cdf26174\" (UID: \"a888795d-1afa-48a3-981f-8db2cdf26174\") "
Jul 02 19:18:04.984849 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:04.984572    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a888795d-1afa-48a3-981f-8db2cdf26174-prometheus-k8s-rulefiles-2\") pod \"a888795d-1afa-48a3-981f-8db2cdf26174\" (UID: \"a888795d-1afa-48a3-981f-8db2cdf26174\") "
Jul 02 19:18:04.984849 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:04.984599    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a888795d-1afa-48a3-981f-8db2cdf26174-prometheus-trusted-ca-bundle\") pod \"a888795d-1afa-48a3-981f-8db2cdf26174\" (UID: \"a888795d-1afa-48a3-981f-8db2cdf26174\") "
Jul 02 19:18:04.984849 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:04.984628    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a888795d-1afa-48a3-981f-8db2cdf26174-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"a888795d-1afa-48a3-981f-8db2cdf26174\" (UID: \"a888795d-1afa-48a3-981f-8db2cdf26174\") "
Jul 02 19:18:04.984849 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:04.984669    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a888795d-1afa-48a3-981f-8db2cdf26174-secret-prometheus-k8s-tls\") pod \"a888795d-1afa-48a3-981f-8db2cdf26174\" (UID: \"a888795d-1afa-48a3-981f-8db2cdf26174\") "
Jul 02 19:18:04.984849 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:04.984701    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a888795d-1afa-48a3-981f-8db2cdf26174-secret-kube-rbac-proxy\") pod \"a888795d-1afa-48a3-981f-8db2cdf26174\" (UID: \"a888795d-1afa-48a3-981f-8db2cdf26174\") "
Jul 02 19:18:04.984849 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:04.984738    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a888795d-1afa-48a3-981f-8db2cdf26174-prometheus-k8s-rulefiles-0\") pod \"a888795d-1afa-48a3-981f-8db2cdf26174\" (UID: \"a888795d-1afa-48a3-981f-8db2cdf26174\") "
Jul 02 19:18:04.984849 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:04.984782    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a888795d-1afa-48a3-981f-8db2cdf26174-config-out\") pod \"a888795d-1afa-48a3-981f-8db2cdf26174\" (UID: \"a888795d-1afa-48a3-981f-8db2cdf26174\") "
Jul 02 19:18:04.984849 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:04.984810    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a888795d-1afa-48a3-981f-8db2cdf26174-web-config\") pod \"a888795d-1afa-48a3-981f-8db2cdf26174\" (UID: \"a888795d-1afa-48a3-981f-8db2cdf26174\") "
Jul 02 19:18:04.985341 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:04.985153    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a888795d-1afa-48a3-981f-8db2cdf26174-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "a888795d-1afa-48a3-981f-8db2cdf26174" (UID: "a888795d-1afa-48a3-981f-8db2cdf26174"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:18:04.987250 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:04.987215    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a888795d-1afa-48a3-981f-8db2cdf26174-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "a888795d-1afa-48a3-981f-8db2cdf26174" (UID: "a888795d-1afa-48a3-981f-8db2cdf26174"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:18:04.987595 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:04.987569    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a888795d-1afa-48a3-981f-8db2cdf26174-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "a888795d-1afa-48a3-981f-8db2cdf26174" (UID: "a888795d-1afa-48a3-981f-8db2cdf26174"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:18:04.987966 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:04.987941    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a888795d-1afa-48a3-981f-8db2cdf26174-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "a888795d-1afa-48a3-981f-8db2cdf26174" (UID: "a888795d-1afa-48a3-981f-8db2cdf26174"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:18:04.988038 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:04.987977    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a888795d-1afa-48a3-981f-8db2cdf26174-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "a888795d-1afa-48a3-981f-8db2cdf26174" (UID: "a888795d-1afa-48a3-981f-8db2cdf26174"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:18:04.988177 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:04.988148    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a888795d-1afa-48a3-981f-8db2cdf26174-config" (OuterVolumeSpecName: "config") pod "a888795d-1afa-48a3-981f-8db2cdf26174" (UID: "a888795d-1afa-48a3-981f-8db2cdf26174"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:18:04.988436 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:04.988410    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a888795d-1afa-48a3-981f-8db2cdf26174-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "a888795d-1afa-48a3-981f-8db2cdf26174" (UID: "a888795d-1afa-48a3-981f-8db2cdf26174"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:18:04.988775 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:04.988751    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a888795d-1afa-48a3-981f-8db2cdf26174-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "a888795d-1afa-48a3-981f-8db2cdf26174" (UID: "a888795d-1afa-48a3-981f-8db2cdf26174"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:18:04.988864 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:04.988831    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a888795d-1afa-48a3-981f-8db2cdf26174-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "a888795d-1afa-48a3-981f-8db2cdf26174" (UID: "a888795d-1afa-48a3-981f-8db2cdf26174"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:18:04.989150 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:04.989119    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a888795d-1afa-48a3-981f-8db2cdf26174-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "a888795d-1afa-48a3-981f-8db2cdf26174" (UID: "a888795d-1afa-48a3-981f-8db2cdf26174"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:18:04.989541 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:04.989480    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a888795d-1afa-48a3-981f-8db2cdf26174-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "a888795d-1afa-48a3-981f-8db2cdf26174" (UID: "a888795d-1afa-48a3-981f-8db2cdf26174"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:18:04.989698 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:04.989653    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a888795d-1afa-48a3-981f-8db2cdf26174-kube-api-access-949xk" (OuterVolumeSpecName: "kube-api-access-949xk") pod "a888795d-1afa-48a3-981f-8db2cdf26174" (UID: "a888795d-1afa-48a3-981f-8db2cdf26174"). InnerVolumeSpecName "kube-api-access-949xk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:18:04.990132 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:04.990105    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a888795d-1afa-48a3-981f-8db2cdf26174-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "a888795d-1afa-48a3-981f-8db2cdf26174" (UID: "a888795d-1afa-48a3-981f-8db2cdf26174"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:18:04.990288 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:04.990250    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a888795d-1afa-48a3-981f-8db2cdf26174-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "a888795d-1afa-48a3-981f-8db2cdf26174" (UID: "a888795d-1afa-48a3-981f-8db2cdf26174"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:18:04.990778 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:04.990742    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a888795d-1afa-48a3-981f-8db2cdf26174-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "a888795d-1afa-48a3-981f-8db2cdf26174" (UID: "a888795d-1afa-48a3-981f-8db2cdf26174"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:18:04.990876 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:04.990827    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a888795d-1afa-48a3-981f-8db2cdf26174-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "a888795d-1afa-48a3-981f-8db2cdf26174" (UID: "a888795d-1afa-48a3-981f-8db2cdf26174"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:18:04.990974 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:04.990873    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a888795d-1afa-48a3-981f-8db2cdf26174-config-out" (OuterVolumeSpecName: "config-out") pod "a888795d-1afa-48a3-981f-8db2cdf26174" (UID: "a888795d-1afa-48a3-981f-8db2cdf26174"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:18:04.991018 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:04.990974    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a888795d-1afa-48a3-981f-8db2cdf26174-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "a888795d-1afa-48a3-981f-8db2cdf26174" (UID: "a888795d-1afa-48a3-981f-8db2cdf26174"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:18:04.991356 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:04.991330    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a888795d-1afa-48a3-981f-8db2cdf26174-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "a888795d-1afa-48a3-981f-8db2cdf26174" (UID: "a888795d-1afa-48a3-981f-8db2cdf26174"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:18:04.999933 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:04.999888    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a888795d-1afa-48a3-981f-8db2cdf26174-web-config" (OuterVolumeSpecName: "web-config") pod "a888795d-1afa-48a3-981f-8db2cdf26174" (UID: "a888795d-1afa-48a3-981f-8db2cdf26174"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:18:05.085419 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.085385    2562 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a888795d-1afa-48a3-981f-8db2cdf26174-secret-grpc-tls\") on node \"ip-10-0-143-38.ec2.internal\" DevicePath \"\""
Jul 02 19:18:05.085419 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.085414    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-949xk\" (UniqueName: \"kubernetes.io/projected/a888795d-1afa-48a3-981f-8db2cdf26174-kube-api-access-949xk\") on node \"ip-10-0-143-38.ec2.internal\" DevicePath \"\""
Jul 02 19:18:05.085613 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.085450    2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a888795d-1afa-48a3-981f-8db2cdf26174-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-143-38.ec2.internal\" DevicePath \"\""
Jul 02 19:18:05.085613 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.085461    2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a888795d-1afa-48a3-981f-8db2cdf26174-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-143-38.ec2.internal\" DevicePath \"\""
Jul 02 19:18:05.085613 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.085469    2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a888795d-1afa-48a3-981f-8db2cdf26174-prometheus-trusted-ca-bundle\") on node \"ip-10-0-143-38.ec2.internal\" DevicePath \"\""
Jul 02 19:18:05.085613 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.085478    2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a888795d-1afa-48a3-981f-8db2cdf26174-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-143-38.ec2.internal\" DevicePath \"\""
Jul 02 19:18:05.085613 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.085486    2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a888795d-1afa-48a3-981f-8db2cdf26174-secret-prometheus-k8s-tls\") on node \"ip-10-0-143-38.ec2.internal\" DevicePath \"\""
Jul 02 19:18:05.085613 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.085494    2562 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a888795d-1afa-48a3-981f-8db2cdf26174-secret-kube-rbac-proxy\") on node \"ip-10-0-143-38.ec2.internal\" DevicePath \"\""
Jul 02 19:18:05.085613 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.085502    2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a888795d-1afa-48a3-981f-8db2cdf26174-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-143-38.ec2.internal\" DevicePath \"\""
Jul 02 19:18:05.085613 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.085510    2562 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a888795d-1afa-48a3-981f-8db2cdf26174-config-out\") on node \"ip-10-0-143-38.ec2.internal\" DevicePath \"\""
Jul 02 19:18:05.085613 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.085518    2562 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a888795d-1afa-48a3-981f-8db2cdf26174-web-config\") on node \"ip-10-0-143-38.ec2.internal\" DevicePath \"\""
Jul 02 19:18:05.085613 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.085525    2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a888795d-1afa-48a3-981f-8db2cdf26174-prometheus-k8s-db\") on node \"ip-10-0-143-38.ec2.internal\" DevicePath \"\""
Jul 02 19:18:05.085613 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.085533    2562 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a888795d-1afa-48a3-981f-8db2cdf26174-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-143-38.ec2.internal\" DevicePath \"\""
Jul 02 19:18:05.085613 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.085541    2562 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a888795d-1afa-48a3-981f-8db2cdf26174-thanos-prometheus-http-client-file\") on node \"ip-10-0-143-38.ec2.internal\" DevicePath \"\""
Jul 02 19:18:05.085613 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.085548    2562 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/a888795d-1afa-48a3-981f-8db2cdf26174-config\") on node \"ip-10-0-143-38.ec2.internal\" DevicePath \"\""
Jul 02 19:18:05.085613 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.085556    2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a888795d-1afa-48a3-981f-8db2cdf26174-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-143-38.ec2.internal\" DevicePath \"\""
Jul 02 19:18:05.085613 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.085566    2562 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a888795d-1afa-48a3-981f-8db2cdf26174-configmap-metrics-client-ca\") on node \"ip-10-0-143-38.ec2.internal\" DevicePath \"\""
Jul 02 19:18:05.085613 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.085573    2562 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a888795d-1afa-48a3-981f-8db2cdf26174-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-143-38.ec2.internal\" DevicePath \"\""
Jul 02 19:18:05.085613 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.085583    2562 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a888795d-1afa-48a3-981f-8db2cdf26174-tls-assets\") on node \"ip-10-0-143-38.ec2.internal\" DevicePath \"\""
Jul 02 19:18:05.085613 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.085591    2562 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a888795d-1afa-48a3-981f-8db2cdf26174-secret-metrics-client-certs\") on node \"ip-10-0-143-38.ec2.internal\" DevicePath \"\""
Jul 02 19:18:05.346183 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.346149    2562 generic.go:356] "Generic (PLEG): container finished" podID="a888795d-1afa-48a3-981f-8db2cdf26174" containerID="d383229db39baf44723ed7959a4bd7329bf945342fa4bc8b9db9492e8cc38f90" exitCode=0
Jul 02 19:18:05.346183 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.346179    2562 generic.go:356] "Generic (PLEG): container finished" podID="a888795d-1afa-48a3-981f-8db2cdf26174" containerID="ede80c051463233a62c8474e08a25bd127e60768ef272dc50bdae65dbad2e054" exitCode=0
Jul 02 19:18:05.346183 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.346191    2562 generic.go:356] "Generic (PLEG): container finished" podID="a888795d-1afa-48a3-981f-8db2cdf26174" containerID="f09f0a7074f10220a6c259be57831dbc9943c0d7377102e708547b31d4259259" exitCode=0
Jul 02 19:18:05.346426 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.346200    2562 generic.go:356] "Generic (PLEG): container finished" podID="a888795d-1afa-48a3-981f-8db2cdf26174" containerID="55274ba1e04ee3991077575d13b5b52ef0f95e0cac393c2b8d870476771addd6" exitCode=0
Jul 02 19:18:05.346426 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.346208    2562 generic.go:356] "Generic (PLEG): container finished" podID="a888795d-1afa-48a3-981f-8db2cdf26174" containerID="1dff8f5d40df7e58529107464828ef3259a3a80f26e7f1ebb9ee678ce1cf1146" exitCode=0
Jul 02 19:18:05.346426 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.346215    2562 generic.go:356] "Generic (PLEG): container finished" podID="a888795d-1afa-48a3-981f-8db2cdf26174" containerID="60b896a919a877d28db28714fa509c3d6fd8c5af2b3016616db26f75ef118274" exitCode=0
Jul 02 19:18:05.346426 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.346225    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a888795d-1afa-48a3-981f-8db2cdf26174","Type":"ContainerDied","Data":"d383229db39baf44723ed7959a4bd7329bf945342fa4bc8b9db9492e8cc38f90"}
Jul 02 19:18:05.346426 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.346242    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:18:05.346426 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.346320    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a888795d-1afa-48a3-981f-8db2cdf26174","Type":"ContainerDied","Data":"ede80c051463233a62c8474e08a25bd127e60768ef272dc50bdae65dbad2e054"}
Jul 02 19:18:05.346426 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.346351    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a888795d-1afa-48a3-981f-8db2cdf26174","Type":"ContainerDied","Data":"f09f0a7074f10220a6c259be57831dbc9943c0d7377102e708547b31d4259259"}
Jul 02 19:18:05.346426 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.346376    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a888795d-1afa-48a3-981f-8db2cdf26174","Type":"ContainerDied","Data":"55274ba1e04ee3991077575d13b5b52ef0f95e0cac393c2b8d870476771addd6"}
Jul 02 19:18:05.346426 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.346393    2562 scope.go:117] "RemoveContainer" containerID="d383229db39baf44723ed7959a4bd7329bf945342fa4bc8b9db9492e8cc38f90"
Jul 02 19:18:05.346426 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.346405    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a888795d-1afa-48a3-981f-8db2cdf26174","Type":"ContainerDied","Data":"1dff8f5d40df7e58529107464828ef3259a3a80f26e7f1ebb9ee678ce1cf1146"}
Jul 02 19:18:05.346426 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.346431    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a888795d-1afa-48a3-981f-8db2cdf26174","Type":"ContainerDied","Data":"60b896a919a877d28db28714fa509c3d6fd8c5af2b3016616db26f75ef118274"}
Jul 02 19:18:05.346845 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.346456    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a888795d-1afa-48a3-981f-8db2cdf26174","Type":"ContainerDied","Data":"d91871955f77d6f4fe85e1af8c1e14fa1c67b372faeec9f6ca8edb21127dda77"}
Jul 02 19:18:05.354999 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.354976    2562 scope.go:117] "RemoveContainer" containerID="ede80c051463233a62c8474e08a25bd127e60768ef272dc50bdae65dbad2e054"
Jul 02 19:18:05.363158 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.363138    2562 scope.go:117] "RemoveContainer" containerID="f09f0a7074f10220a6c259be57831dbc9943c0d7377102e708547b31d4259259"
Jul 02 19:18:05.371054 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.371035    2562 scope.go:117] "RemoveContainer" containerID="55274ba1e04ee3991077575d13b5b52ef0f95e0cac393c2b8d870476771addd6"
Jul 02 19:18:05.371602 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.371578    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 02 19:18:05.379229 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.379063    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 02 19:18:05.379315 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.379257    2562 scope.go:117] "RemoveContainer" containerID="1dff8f5d40df7e58529107464828ef3259a3a80f26e7f1ebb9ee678ce1cf1146"
Jul 02 19:18:05.386419 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.386400    2562 scope.go:117] "RemoveContainer" containerID="60b896a919a877d28db28714fa509c3d6fd8c5af2b3016616db26f75ef118274"
Jul 02 19:18:05.393362 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.393344    2562 scope.go:117] "RemoveContainer" containerID="acbc5cc6255dd8fe692e774c71757c65208c4074bd6d40e04689179444db47f3"
Jul 02 19:18:05.400268 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.400253    2562 scope.go:117] "RemoveContainer" containerID="d383229db39baf44723ed7959a4bd7329bf945342fa4bc8b9db9492e8cc38f90"
Jul 02 19:18:05.400549 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:18:05.400529    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d383229db39baf44723ed7959a4bd7329bf945342fa4bc8b9db9492e8cc38f90\": container with ID starting with d383229db39baf44723ed7959a4bd7329bf945342fa4bc8b9db9492e8cc38f90 not found: ID does not exist" containerID="d383229db39baf44723ed7959a4bd7329bf945342fa4bc8b9db9492e8cc38f90"
Jul 02 19:18:05.400609 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.400557    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d383229db39baf44723ed7959a4bd7329bf945342fa4bc8b9db9492e8cc38f90"} err="failed to get container status \"d383229db39baf44723ed7959a4bd7329bf945342fa4bc8b9db9492e8cc38f90\": rpc error: code = NotFound desc = could not find container \"d383229db39baf44723ed7959a4bd7329bf945342fa4bc8b9db9492e8cc38f90\": container with ID starting with d383229db39baf44723ed7959a4bd7329bf945342fa4bc8b9db9492e8cc38f90 not found: ID does not exist"
Jul 02 19:18:05.400609 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.400589    2562 scope.go:117] "RemoveContainer" containerID="ede80c051463233a62c8474e08a25bd127e60768ef272dc50bdae65dbad2e054"
Jul 02 19:18:05.400809 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:18:05.400794    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ede80c051463233a62c8474e08a25bd127e60768ef272dc50bdae65dbad2e054\": container with ID starting with ede80c051463233a62c8474e08a25bd127e60768ef272dc50bdae65dbad2e054 not found: ID does not exist" containerID="ede80c051463233a62c8474e08a25bd127e60768ef272dc50bdae65dbad2e054"
Jul 02 19:18:05.400847 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.400812    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ede80c051463233a62c8474e08a25bd127e60768ef272dc50bdae65dbad2e054"} err="failed to get container status \"ede80c051463233a62c8474e08a25bd127e60768ef272dc50bdae65dbad2e054\": rpc error: code = NotFound desc = could not find container \"ede80c051463233a62c8474e08a25bd127e60768ef272dc50bdae65dbad2e054\": container with ID starting with ede80c051463233a62c8474e08a25bd127e60768ef272dc50bdae65dbad2e054 not found: ID does not exist"
Jul 02 19:18:05.400847 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.400826    2562 scope.go:117] "RemoveContainer" containerID="f09f0a7074f10220a6c259be57831dbc9943c0d7377102e708547b31d4259259"
Jul 02 19:18:05.401064 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:18:05.401048    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f09f0a7074f10220a6c259be57831dbc9943c0d7377102e708547b31d4259259\": container with ID starting with f09f0a7074f10220a6c259be57831dbc9943c0d7377102e708547b31d4259259 not found: ID does not exist" containerID="f09f0a7074f10220a6c259be57831dbc9943c0d7377102e708547b31d4259259"
Jul 02 19:18:05.401117 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.401072    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f09f0a7074f10220a6c259be57831dbc9943c0d7377102e708547b31d4259259"} err="failed to get container status \"f09f0a7074f10220a6c259be57831dbc9943c0d7377102e708547b31d4259259\": rpc error: code = NotFound desc = could not find container \"f09f0a7074f10220a6c259be57831dbc9943c0d7377102e708547b31d4259259\": container with ID starting with f09f0a7074f10220a6c259be57831dbc9943c0d7377102e708547b31d4259259 not found: ID does not exist"
Jul 02 19:18:05.401117 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.401094    2562 scope.go:117] "RemoveContainer" containerID="55274ba1e04ee3991077575d13b5b52ef0f95e0cac393c2b8d870476771addd6"
Jul 02 19:18:05.401292 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:18:05.401277    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55274ba1e04ee3991077575d13b5b52ef0f95e0cac393c2b8d870476771addd6\": container with ID starting with 55274ba1e04ee3991077575d13b5b52ef0f95e0cac393c2b8d870476771addd6 not found: ID does not exist" containerID="55274ba1e04ee3991077575d13b5b52ef0f95e0cac393c2b8d870476771addd6"
Jul 02 19:18:05.401328 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.401294    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55274ba1e04ee3991077575d13b5b52ef0f95e0cac393c2b8d870476771addd6"} err="failed to get container status \"55274ba1e04ee3991077575d13b5b52ef0f95e0cac393c2b8d870476771addd6\": rpc error: code = NotFound desc = could not find container \"55274ba1e04ee3991077575d13b5b52ef0f95e0cac393c2b8d870476771addd6\": container with ID starting with 55274ba1e04ee3991077575d13b5b52ef0f95e0cac393c2b8d870476771addd6 not found: ID does not exist"
Jul 02 19:18:05.401328 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.401308    2562 scope.go:117] "RemoveContainer" containerID="1dff8f5d40df7e58529107464828ef3259a3a80f26e7f1ebb9ee678ce1cf1146"
Jul 02 19:18:05.401530 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:18:05.401513    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1dff8f5d40df7e58529107464828ef3259a3a80f26e7f1ebb9ee678ce1cf1146\": container with ID starting with 1dff8f5d40df7e58529107464828ef3259a3a80f26e7f1ebb9ee678ce1cf1146 not found: ID does not exist" containerID="1dff8f5d40df7e58529107464828ef3259a3a80f26e7f1ebb9ee678ce1cf1146"
Jul 02 19:18:05.401577 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.401532    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1dff8f5d40df7e58529107464828ef3259a3a80f26e7f1ebb9ee678ce1cf1146"} err="failed to get container status \"1dff8f5d40df7e58529107464828ef3259a3a80f26e7f1ebb9ee678ce1cf1146\": rpc error: code = NotFound desc = could not find container \"1dff8f5d40df7e58529107464828ef3259a3a80f26e7f1ebb9ee678ce1cf1146\": container with ID starting with 1dff8f5d40df7e58529107464828ef3259a3a80f26e7f1ebb9ee678ce1cf1146 not found: ID does not exist"
Jul 02 19:18:05.401577 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.401543    2562 scope.go:117] "RemoveContainer" containerID="60b896a919a877d28db28714fa509c3d6fd8c5af2b3016616db26f75ef118274"
Jul 02 19:18:05.401719 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:18:05.401704    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60b896a919a877d28db28714fa509c3d6fd8c5af2b3016616db26f75ef118274\": container with ID starting with 60b896a919a877d28db28714fa509c3d6fd8c5af2b3016616db26f75ef118274 not found: ID does not exist" containerID="60b896a919a877d28db28714fa509c3d6fd8c5af2b3016616db26f75ef118274"
Jul 02 19:18:05.401758 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.401721    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60b896a919a877d28db28714fa509c3d6fd8c5af2b3016616db26f75ef118274"} err="failed to get container status \"60b896a919a877d28db28714fa509c3d6fd8c5af2b3016616db26f75ef118274\": rpc error: code = NotFound desc = could not find container \"60b896a919a877d28db28714fa509c3d6fd8c5af2b3016616db26f75ef118274\": container with ID starting with 60b896a919a877d28db28714fa509c3d6fd8c5af2b3016616db26f75ef118274 not found: ID does not exist"
Jul 02 19:18:05.401758 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.401732    2562 scope.go:117] "RemoveContainer" containerID="acbc5cc6255dd8fe692e774c71757c65208c4074bd6d40e04689179444db47f3"
Jul 02 19:18:05.401949 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:18:05.401904    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"acbc5cc6255dd8fe692e774c71757c65208c4074bd6d40e04689179444db47f3\": container with ID starting with acbc5cc6255dd8fe692e774c71757c65208c4074bd6d40e04689179444db47f3 not found: ID does not exist" containerID="acbc5cc6255dd8fe692e774c71757c65208c4074bd6d40e04689179444db47f3"
Jul 02 19:18:05.402049 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.401953    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"acbc5cc6255dd8fe692e774c71757c65208c4074bd6d40e04689179444db47f3"} err="failed to get container status \"acbc5cc6255dd8fe692e774c71757c65208c4074bd6d40e04689179444db47f3\": rpc error: code = NotFound desc = could not find container \"acbc5cc6255dd8fe692e774c71757c65208c4074bd6d40e04689179444db47f3\": container with ID starting with acbc5cc6255dd8fe692e774c71757c65208c4074bd6d40e04689179444db47f3 not found: ID does not exist"
Jul 02 19:18:05.402049 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.401971    2562 scope.go:117] "RemoveContainer" containerID="d383229db39baf44723ed7959a4bd7329bf945342fa4bc8b9db9492e8cc38f90"
Jul 02 19:18:05.402211 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.402194    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d383229db39baf44723ed7959a4bd7329bf945342fa4bc8b9db9492e8cc38f90"} err="failed to get container status \"d383229db39baf44723ed7959a4bd7329bf945342fa4bc8b9db9492e8cc38f90\": rpc error: code = NotFound desc = could not find container \"d383229db39baf44723ed7959a4bd7329bf945342fa4bc8b9db9492e8cc38f90\": container with ID starting with d383229db39baf44723ed7959a4bd7329bf945342fa4bc8b9db9492e8cc38f90 not found: ID does not exist"
Jul 02 19:18:05.402256 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.402211    2562 scope.go:117] "RemoveContainer" containerID="ede80c051463233a62c8474e08a25bd127e60768ef272dc50bdae65dbad2e054"
Jul 02 19:18:05.402453 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.402435    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ede80c051463233a62c8474e08a25bd127e60768ef272dc50bdae65dbad2e054"} err="failed to get container status \"ede80c051463233a62c8474e08a25bd127e60768ef272dc50bdae65dbad2e054\": rpc error: code = NotFound desc = could not find container \"ede80c051463233a62c8474e08a25bd127e60768ef272dc50bdae65dbad2e054\": container with ID starting with ede80c051463233a62c8474e08a25bd127e60768ef272dc50bdae65dbad2e054 not found: ID does not exist"
Jul 02 19:18:05.402517 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.402455    2562 scope.go:117] "RemoveContainer" containerID="f09f0a7074f10220a6c259be57831dbc9943c0d7377102e708547b31d4259259"
Jul 02 19:18:05.402660 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.402638    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f09f0a7074f10220a6c259be57831dbc9943c0d7377102e708547b31d4259259"} err="failed to get container status \"f09f0a7074f10220a6c259be57831dbc9943c0d7377102e708547b31d4259259\": rpc error: code = NotFound desc = could not find container \"f09f0a7074f10220a6c259be57831dbc9943c0d7377102e708547b31d4259259\": container with ID starting with f09f0a7074f10220a6c259be57831dbc9943c0d7377102e708547b31d4259259 not found: ID does not exist"
Jul 02 19:18:05.402702 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.402661    2562 scope.go:117] "RemoveContainer" containerID="55274ba1e04ee3991077575d13b5b52ef0f95e0cac393c2b8d870476771addd6"
Jul 02 19:18:05.402893 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.402876    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55274ba1e04ee3991077575d13b5b52ef0f95e0cac393c2b8d870476771addd6"} err="failed to get container status \"55274ba1e04ee3991077575d13b5b52ef0f95e0cac393c2b8d870476771addd6\": rpc error: code = NotFound desc = could not find container \"55274ba1e04ee3991077575d13b5b52ef0f95e0cac393c2b8d870476771addd6\": container with ID starting with 55274ba1e04ee3991077575d13b5b52ef0f95e0cac393c2b8d870476771addd6 not found: ID does not exist"
Jul 02 19:18:05.402994 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.402894    2562 scope.go:117] "RemoveContainer" containerID="1dff8f5d40df7e58529107464828ef3259a3a80f26e7f1ebb9ee678ce1cf1146"
Jul 02 19:18:05.403147 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.403119    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1dff8f5d40df7e58529107464828ef3259a3a80f26e7f1ebb9ee678ce1cf1146"} err="failed to get container status \"1dff8f5d40df7e58529107464828ef3259a3a80f26e7f1ebb9ee678ce1cf1146\": rpc error: code = NotFound desc = could not find container \"1dff8f5d40df7e58529107464828ef3259a3a80f26e7f1ebb9ee678ce1cf1146\": container with ID starting with 1dff8f5d40df7e58529107464828ef3259a3a80f26e7f1ebb9ee678ce1cf1146 not found: ID does not exist"
Jul 02 19:18:05.403147 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.403137    2562 scope.go:117] "RemoveContainer" containerID="60b896a919a877d28db28714fa509c3d6fd8c5af2b3016616db26f75ef118274"
Jul 02 19:18:05.403380 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.403362    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60b896a919a877d28db28714fa509c3d6fd8c5af2b3016616db26f75ef118274"} err="failed to get container status \"60b896a919a877d28db28714fa509c3d6fd8c5af2b3016616db26f75ef118274\": rpc error: code = NotFound desc = could not find container \"60b896a919a877d28db28714fa509c3d6fd8c5af2b3016616db26f75ef118274\": container with ID starting with 60b896a919a877d28db28714fa509c3d6fd8c5af2b3016616db26f75ef118274 not found: ID does not exist"
Jul 02 19:18:05.403419 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.403381    2562 scope.go:117] "RemoveContainer" containerID="acbc5cc6255dd8fe692e774c71757c65208c4074bd6d40e04689179444db47f3"
Jul 02 19:18:05.403588 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.403571    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"acbc5cc6255dd8fe692e774c71757c65208c4074bd6d40e04689179444db47f3"} err="failed to get container status \"acbc5cc6255dd8fe692e774c71757c65208c4074bd6d40e04689179444db47f3\": rpc error: code = NotFound desc = could not find container \"acbc5cc6255dd8fe692e774c71757c65208c4074bd6d40e04689179444db47f3\": container with ID starting with acbc5cc6255dd8fe692e774c71757c65208c4074bd6d40e04689179444db47f3 not found: ID does not exist"
Jul 02 19:18:05.403628 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.403589    2562 scope.go:117] "RemoveContainer" containerID="d383229db39baf44723ed7959a4bd7329bf945342fa4bc8b9db9492e8cc38f90"
Jul 02 19:18:05.403773 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.403755    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d383229db39baf44723ed7959a4bd7329bf945342fa4bc8b9db9492e8cc38f90"} err="failed to get container status \"d383229db39baf44723ed7959a4bd7329bf945342fa4bc8b9db9492e8cc38f90\": rpc error: code = NotFound desc = could not find container \"d383229db39baf44723ed7959a4bd7329bf945342fa4bc8b9db9492e8cc38f90\": container with ID starting with d383229db39baf44723ed7959a4bd7329bf945342fa4bc8b9db9492e8cc38f90 not found: ID does not exist"
Jul 02 19:18:05.403812 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.403773    2562 scope.go:117] "RemoveContainer" containerID="ede80c051463233a62c8474e08a25bd127e60768ef272dc50bdae65dbad2e054"
Jul 02 19:18:05.404005 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.403989    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ede80c051463233a62c8474e08a25bd127e60768ef272dc50bdae65dbad2e054"} err="failed to get container status \"ede80c051463233a62c8474e08a25bd127e60768ef272dc50bdae65dbad2e054\": rpc error: code = NotFound desc = could not find container \"ede80c051463233a62c8474e08a25bd127e60768ef272dc50bdae65dbad2e054\": container with ID starting with ede80c051463233a62c8474e08a25bd127e60768ef272dc50bdae65dbad2e054 not found: ID does not exist"
Jul 02 19:18:05.404058 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.404006    2562 scope.go:117] "RemoveContainer" containerID="f09f0a7074f10220a6c259be57831dbc9943c0d7377102e708547b31d4259259"
Jul 02 19:18:05.404188 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.404169    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f09f0a7074f10220a6c259be57831dbc9943c0d7377102e708547b31d4259259"} err="failed to get container status \"f09f0a7074f10220a6c259be57831dbc9943c0d7377102e708547b31d4259259\": rpc error: code = NotFound desc = could not find container \"f09f0a7074f10220a6c259be57831dbc9943c0d7377102e708547b31d4259259\": container with ID starting with f09f0a7074f10220a6c259be57831dbc9943c0d7377102e708547b31d4259259 not found: ID does not exist"
Jul 02 19:18:05.404188 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.404185    2562 scope.go:117] "RemoveContainer" containerID="55274ba1e04ee3991077575d13b5b52ef0f95e0cac393c2b8d870476771addd6"
Jul 02 19:18:05.404352 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.404332    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55274ba1e04ee3991077575d13b5b52ef0f95e0cac393c2b8d870476771addd6"} err="failed to get container status \"55274ba1e04ee3991077575d13b5b52ef0f95e0cac393c2b8d870476771addd6\": rpc error: code = NotFound desc = could not find container \"55274ba1e04ee3991077575d13b5b52ef0f95e0cac393c2b8d870476771addd6\": container with ID starting with 55274ba1e04ee3991077575d13b5b52ef0f95e0cac393c2b8d870476771addd6 not found: ID does not exist"
Jul 02 19:18:05.404422 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.404354    2562 scope.go:117] "RemoveContainer" containerID="1dff8f5d40df7e58529107464828ef3259a3a80f26e7f1ebb9ee678ce1cf1146"
Jul 02 19:18:05.404551 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.404534    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1dff8f5d40df7e58529107464828ef3259a3a80f26e7f1ebb9ee678ce1cf1146"} err="failed to get container status \"1dff8f5d40df7e58529107464828ef3259a3a80f26e7f1ebb9ee678ce1cf1146\": rpc error: code = NotFound desc = could not find container \"1dff8f5d40df7e58529107464828ef3259a3a80f26e7f1ebb9ee678ce1cf1146\": container with ID starting with 1dff8f5d40df7e58529107464828ef3259a3a80f26e7f1ebb9ee678ce1cf1146 not found: ID does not exist"
Jul 02 19:18:05.404598 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.404552    2562 scope.go:117] "RemoveContainer" containerID="60b896a919a877d28db28714fa509c3d6fd8c5af2b3016616db26f75ef118274"
Jul 02 19:18:05.404749 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.404730    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60b896a919a877d28db28714fa509c3d6fd8c5af2b3016616db26f75ef118274"} err="failed to get container status \"60b896a919a877d28db28714fa509c3d6fd8c5af2b3016616db26f75ef118274\": rpc error: code = NotFound desc = could not find container \"60b896a919a877d28db28714fa509c3d6fd8c5af2b3016616db26f75ef118274\": container with ID starting with 60b896a919a877d28db28714fa509c3d6fd8c5af2b3016616db26f75ef118274 not found: ID does not exist"
Jul 02 19:18:05.404816 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.404751    2562 scope.go:117] "RemoveContainer" containerID="acbc5cc6255dd8fe692e774c71757c65208c4074bd6d40e04689179444db47f3"
Jul 02 19:18:05.404990 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.404968    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"acbc5cc6255dd8fe692e774c71757c65208c4074bd6d40e04689179444db47f3"} err="failed to get container status \"acbc5cc6255dd8fe692e774c71757c65208c4074bd6d40e04689179444db47f3\": rpc error: code = NotFound desc = could not find container \"acbc5cc6255dd8fe692e774c71757c65208c4074bd6d40e04689179444db47f3\": container with ID starting with acbc5cc6255dd8fe692e774c71757c65208c4074bd6d40e04689179444db47f3 not found: ID does not exist"
Jul 02 19:18:05.404990 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.404989    2562 scope.go:117] "RemoveContainer" containerID="d383229db39baf44723ed7959a4bd7329bf945342fa4bc8b9db9492e8cc38f90"
Jul 02 19:18:05.405247 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.405213    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d383229db39baf44723ed7959a4bd7329bf945342fa4bc8b9db9492e8cc38f90"} err="failed to get container status \"d383229db39baf44723ed7959a4bd7329bf945342fa4bc8b9db9492e8cc38f90\": rpc error: code = NotFound desc = could not find container \"d383229db39baf44723ed7959a4bd7329bf945342fa4bc8b9db9492e8cc38f90\": container with ID starting with d383229db39baf44723ed7959a4bd7329bf945342fa4bc8b9db9492e8cc38f90 not found: ID does not exist"
Jul 02 19:18:05.405247 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.405245    2562 scope.go:117] "RemoveContainer" containerID="ede80c051463233a62c8474e08a25bd127e60768ef272dc50bdae65dbad2e054"
Jul 02 19:18:05.405447 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.405432    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ede80c051463233a62c8474e08a25bd127e60768ef272dc50bdae65dbad2e054"} err="failed to get container status \"ede80c051463233a62c8474e08a25bd127e60768ef272dc50bdae65dbad2e054\": rpc error: code = NotFound desc = could not find container \"ede80c051463233a62c8474e08a25bd127e60768ef272dc50bdae65dbad2e054\": container with ID starting with ede80c051463233a62c8474e08a25bd127e60768ef272dc50bdae65dbad2e054 not found: ID does not exist"
Jul 02 19:18:05.405503 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.405448    2562 scope.go:117] "RemoveContainer" containerID="f09f0a7074f10220a6c259be57831dbc9943c0d7377102e708547b31d4259259"
Jul 02 19:18:05.405650 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.405632    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f09f0a7074f10220a6c259be57831dbc9943c0d7377102e708547b31d4259259"} err="failed to get container status \"f09f0a7074f10220a6c259be57831dbc9943c0d7377102e708547b31d4259259\": rpc error: code = NotFound desc = could not find container \"f09f0a7074f10220a6c259be57831dbc9943c0d7377102e708547b31d4259259\": container with ID starting with f09f0a7074f10220a6c259be57831dbc9943c0d7377102e708547b31d4259259 not found: ID does not exist"
Jul 02 19:18:05.405690 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.405650    2562 scope.go:117] "RemoveContainer" containerID="55274ba1e04ee3991077575d13b5b52ef0f95e0cac393c2b8d870476771addd6"
Jul 02 19:18:05.405853 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.405838    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55274ba1e04ee3991077575d13b5b52ef0f95e0cac393c2b8d870476771addd6"} err="failed to get container status \"55274ba1e04ee3991077575d13b5b52ef0f95e0cac393c2b8d870476771addd6\": rpc error: code = NotFound desc = could not find container \"55274ba1e04ee3991077575d13b5b52ef0f95e0cac393c2b8d870476771addd6\": container with ID starting with 55274ba1e04ee3991077575d13b5b52ef0f95e0cac393c2b8d870476771addd6 not found: ID does not exist"
Jul 02 19:18:05.405906 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.405853    2562 scope.go:117] "RemoveContainer" containerID="1dff8f5d40df7e58529107464828ef3259a3a80f26e7f1ebb9ee678ce1cf1146"
Jul 02 19:18:05.406200 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.406170    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1dff8f5d40df7e58529107464828ef3259a3a80f26e7f1ebb9ee678ce1cf1146"} err="failed to get container status \"1dff8f5d40df7e58529107464828ef3259a3a80f26e7f1ebb9ee678ce1cf1146\": rpc error: code = NotFound desc = could not find container \"1dff8f5d40df7e58529107464828ef3259a3a80f26e7f1ebb9ee678ce1cf1146\": container with ID starting with 1dff8f5d40df7e58529107464828ef3259a3a80f26e7f1ebb9ee678ce1cf1146 not found: ID does not exist"
Jul 02 19:18:05.406299 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.406200    2562 scope.go:117] "RemoveContainer" containerID="60b896a919a877d28db28714fa509c3d6fd8c5af2b3016616db26f75ef118274"
Jul 02 19:18:05.406475 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.406445    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60b896a919a877d28db28714fa509c3d6fd8c5af2b3016616db26f75ef118274"} err="failed to get container status \"60b896a919a877d28db28714fa509c3d6fd8c5af2b3016616db26f75ef118274\": rpc error: code = NotFound desc = could not find container \"60b896a919a877d28db28714fa509c3d6fd8c5af2b3016616db26f75ef118274\": container with ID starting with 60b896a919a877d28db28714fa509c3d6fd8c5af2b3016616db26f75ef118274 not found: ID does not exist"
Jul 02 19:18:05.406475 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.406469    2562 scope.go:117] "RemoveContainer" containerID="acbc5cc6255dd8fe692e774c71757c65208c4074bd6d40e04689179444db47f3"
Jul 02 19:18:05.406752 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.406726    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"acbc5cc6255dd8fe692e774c71757c65208c4074bd6d40e04689179444db47f3"} err="failed to get container status \"acbc5cc6255dd8fe692e774c71757c65208c4074bd6d40e04689179444db47f3\": rpc error: code = NotFound desc = could not find container \"acbc5cc6255dd8fe692e774c71757c65208c4074bd6d40e04689179444db47f3\": container with ID starting with acbc5cc6255dd8fe692e774c71757c65208c4074bd6d40e04689179444db47f3 not found: ID does not exist"
Jul 02 19:18:05.406752 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.406755    2562 scope.go:117] "RemoveContainer" containerID="d383229db39baf44723ed7959a4bd7329bf945342fa4bc8b9db9492e8cc38f90"
Jul 02 19:18:05.407056 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.407035    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d383229db39baf44723ed7959a4bd7329bf945342fa4bc8b9db9492e8cc38f90"} err="failed to get container status \"d383229db39baf44723ed7959a4bd7329bf945342fa4bc8b9db9492e8cc38f90\": rpc error: code = NotFound desc = could not find container \"d383229db39baf44723ed7959a4bd7329bf945342fa4bc8b9db9492e8cc38f90\": container with ID starting with d383229db39baf44723ed7959a4bd7329bf945342fa4bc8b9db9492e8cc38f90 not found: ID does not exist"
Jul 02 19:18:05.407135 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.407058    2562 scope.go:117] "RemoveContainer" containerID="ede80c051463233a62c8474e08a25bd127e60768ef272dc50bdae65dbad2e054"
Jul 02 19:18:05.407436 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.407398    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ede80c051463233a62c8474e08a25bd127e60768ef272dc50bdae65dbad2e054"} err="failed to get container status \"ede80c051463233a62c8474e08a25bd127e60768ef272dc50bdae65dbad2e054\": rpc error: code = NotFound desc = could not find container \"ede80c051463233a62c8474e08a25bd127e60768ef272dc50bdae65dbad2e054\": container with ID starting with ede80c051463233a62c8474e08a25bd127e60768ef272dc50bdae65dbad2e054 not found: ID does not exist"
Jul 02 19:18:05.407541 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.407437    2562 scope.go:117] "RemoveContainer" containerID="f09f0a7074f10220a6c259be57831dbc9943c0d7377102e708547b31d4259259"
Jul 02 19:18:05.407716 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.407687    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f09f0a7074f10220a6c259be57831dbc9943c0d7377102e708547b31d4259259"} err="failed to get container status \"f09f0a7074f10220a6c259be57831dbc9943c0d7377102e708547b31d4259259\": rpc error: code = NotFound desc = could not find container \"f09f0a7074f10220a6c259be57831dbc9943c0d7377102e708547b31d4259259\": container with ID starting with f09f0a7074f10220a6c259be57831dbc9943c0d7377102e708547b31d4259259 not found: ID does not exist"
Jul 02 19:18:05.407716 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.407706    2562 scope.go:117] "RemoveContainer" containerID="55274ba1e04ee3991077575d13b5b52ef0f95e0cac393c2b8d870476771addd6"
Jul 02 19:18:05.407931 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.407894    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55274ba1e04ee3991077575d13b5b52ef0f95e0cac393c2b8d870476771addd6"} err="failed to get container status \"55274ba1e04ee3991077575d13b5b52ef0f95e0cac393c2b8d870476771addd6\": rpc error: code = NotFound desc = could not find container \"55274ba1e04ee3991077575d13b5b52ef0f95e0cac393c2b8d870476771addd6\": container with ID starting with 55274ba1e04ee3991077575d13b5b52ef0f95e0cac393c2b8d870476771addd6 not found: ID does not exist"
Jul 02 19:18:05.407985 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.407929    2562 scope.go:117] "RemoveContainer" containerID="1dff8f5d40df7e58529107464828ef3259a3a80f26e7f1ebb9ee678ce1cf1146"
Jul 02 19:18:05.408124 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.408109    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 02 19:18:05.408180 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.408129    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1dff8f5d40df7e58529107464828ef3259a3a80f26e7f1ebb9ee678ce1cf1146"} err="failed to get container status \"1dff8f5d40df7e58529107464828ef3259a3a80f26e7f1ebb9ee678ce1cf1146\": rpc error: code = NotFound desc = could not find container \"1dff8f5d40df7e58529107464828ef3259a3a80f26e7f1ebb9ee678ce1cf1146\": container with ID starting with 1dff8f5d40df7e58529107464828ef3259a3a80f26e7f1ebb9ee678ce1cf1146 not found: ID does not exist"
Jul 02 19:18:05.408180 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.408143    2562 scope.go:117] "RemoveContainer" containerID="60b896a919a877d28db28714fa509c3d6fd8c5af2b3016616db26f75ef118274"
Jul 02 19:18:05.408355 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.408336    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60b896a919a877d28db28714fa509c3d6fd8c5af2b3016616db26f75ef118274"} err="failed to get container status \"60b896a919a877d28db28714fa509c3d6fd8c5af2b3016616db26f75ef118274\": rpc error: code = NotFound desc = could not find container \"60b896a919a877d28db28714fa509c3d6fd8c5af2b3016616db26f75ef118274\": container with ID starting with 60b896a919a877d28db28714fa509c3d6fd8c5af2b3016616db26f75ef118274 not found: ID does not exist"
Jul 02 19:18:05.408424 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.408356    2562 scope.go:117] "RemoveContainer" containerID="acbc5cc6255dd8fe692e774c71757c65208c4074bd6d40e04689179444db47f3"
Jul 02 19:18:05.408424 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.408366    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a888795d-1afa-48a3-981f-8db2cdf26174" containerName="prometheus"
Jul 02 19:18:05.408424 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.408377    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a888795d-1afa-48a3-981f-8db2cdf26174" containerName="prometheus"
Jul 02 19:18:05.408424 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.408386    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a888795d-1afa-48a3-981f-8db2cdf26174" containerName="init-config-reloader"
Jul 02 19:18:05.408424 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.408392    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a888795d-1afa-48a3-981f-8db2cdf26174" containerName="init-config-reloader"
Jul 02 19:18:05.408424 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.408403    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a888795d-1afa-48a3-981f-8db2cdf26174" containerName="thanos-sidecar"
Jul 02 19:18:05.408424 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.408409    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a888795d-1afa-48a3-981f-8db2cdf26174" containerName="thanos-sidecar"
Jul 02 19:18:05.408424 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.408415    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a888795d-1afa-48a3-981f-8db2cdf26174" containerName="kube-rbac-proxy"
Jul 02 19:18:05.408424 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.408422    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a888795d-1afa-48a3-981f-8db2cdf26174" containerName="kube-rbac-proxy"
Jul 02 19:18:05.408759 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.408442    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a888795d-1afa-48a3-981f-8db2cdf26174" containerName="kube-rbac-proxy-web"
Jul 02 19:18:05.408759 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.408450    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a888795d-1afa-48a3-981f-8db2cdf26174" containerName="kube-rbac-proxy-web"
Jul 02 19:18:05.408759 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.408461    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a888795d-1afa-48a3-981f-8db2cdf26174" containerName="config-reloader"
Jul 02 19:18:05.408759 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.408469    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a888795d-1afa-48a3-981f-8db2cdf26174" containerName="config-reloader"
Jul 02 19:18:05.408759 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.408480    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a888795d-1afa-48a3-981f-8db2cdf26174" containerName="kube-rbac-proxy-thanos"
Jul 02 19:18:05.408759 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.408488    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a888795d-1afa-48a3-981f-8db2cdf26174" containerName="kube-rbac-proxy-thanos"
Jul 02 19:18:05.408759 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.408549    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a888795d-1afa-48a3-981f-8db2cdf26174" containerName="prometheus"
Jul 02 19:18:05.408759 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.408560    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a888795d-1afa-48a3-981f-8db2cdf26174" containerName="config-reloader"
Jul 02 19:18:05.408759 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.408569    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a888795d-1afa-48a3-981f-8db2cdf26174" containerName="thanos-sidecar"
Jul 02 19:18:05.408759 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.408573    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a888795d-1afa-48a3-981f-8db2cdf26174" containerName="kube-rbac-proxy-web"
Jul 02 19:18:05.408759 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.408578    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a888795d-1afa-48a3-981f-8db2cdf26174" containerName="kube-rbac-proxy"
Jul 02 19:18:05.408759 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.408584    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a888795d-1afa-48a3-981f-8db2cdf26174" containerName="kube-rbac-proxy-thanos"
Jul 02 19:18:05.408759 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.408599    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"acbc5cc6255dd8fe692e774c71757c65208c4074bd6d40e04689179444db47f3"} err="failed to get container status \"acbc5cc6255dd8fe692e774c71757c65208c4074bd6d40e04689179444db47f3\": rpc error: code = NotFound desc = could not find container \"acbc5cc6255dd8fe692e774c71757c65208c4074bd6d40e04689179444db47f3\": container with ID starting with acbc5cc6255dd8fe692e774c71757c65208c4074bd6d40e04689179444db47f3 not found: ID does not exist"
Jul 02 19:18:05.408759 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.408619    2562 scope.go:117] "RemoveContainer" containerID="d383229db39baf44723ed7959a4bd7329bf945342fa4bc8b9db9492e8cc38f90"
Jul 02 19:18:05.409427 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.408812    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d383229db39baf44723ed7959a4bd7329bf945342fa4bc8b9db9492e8cc38f90"} err="failed to get container status \"d383229db39baf44723ed7959a4bd7329bf945342fa4bc8b9db9492e8cc38f90\": rpc error: code = NotFound desc = could not find container \"d383229db39baf44723ed7959a4bd7329bf945342fa4bc8b9db9492e8cc38f90\": container with ID starting with d383229db39baf44723ed7959a4bd7329bf945342fa4bc8b9db9492e8cc38f90 not found: ID does not exist"
Jul 02 19:18:05.409427 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.408831    2562 scope.go:117] "RemoveContainer" containerID="ede80c051463233a62c8474e08a25bd127e60768ef272dc50bdae65dbad2e054"
Jul 02 19:18:05.409427 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.409078    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ede80c051463233a62c8474e08a25bd127e60768ef272dc50bdae65dbad2e054"} err="failed to get container status \"ede80c051463233a62c8474e08a25bd127e60768ef272dc50bdae65dbad2e054\": rpc error: code = NotFound desc = could not find container \"ede80c051463233a62c8474e08a25bd127e60768ef272dc50bdae65dbad2e054\": container with ID starting with ede80c051463233a62c8474e08a25bd127e60768ef272dc50bdae65dbad2e054 not found: ID does not exist"
Jul 02 19:18:05.409427 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.409096    2562 scope.go:117] "RemoveContainer" containerID="f09f0a7074f10220a6c259be57831dbc9943c0d7377102e708547b31d4259259"
Jul 02 19:18:05.409427 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.409294    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f09f0a7074f10220a6c259be57831dbc9943c0d7377102e708547b31d4259259"} err="failed to get container status \"f09f0a7074f10220a6c259be57831dbc9943c0d7377102e708547b31d4259259\": rpc error: code = NotFound desc = could not find container \"f09f0a7074f10220a6c259be57831dbc9943c0d7377102e708547b31d4259259\": container with ID starting with f09f0a7074f10220a6c259be57831dbc9943c0d7377102e708547b31d4259259 not found: ID does not exist"
Jul 02 19:18:05.409427 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.409312    2562 scope.go:117] "RemoveContainer" containerID="55274ba1e04ee3991077575d13b5b52ef0f95e0cac393c2b8d870476771addd6"
Jul 02 19:18:05.409645 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.409504    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55274ba1e04ee3991077575d13b5b52ef0f95e0cac393c2b8d870476771addd6"} err="failed to get container status \"55274ba1e04ee3991077575d13b5b52ef0f95e0cac393c2b8d870476771addd6\": rpc error: code = NotFound desc = could not find container \"55274ba1e04ee3991077575d13b5b52ef0f95e0cac393c2b8d870476771addd6\": container with ID starting with 55274ba1e04ee3991077575d13b5b52ef0f95e0cac393c2b8d870476771addd6 not found: ID does not exist"
Jul 02 19:18:05.409645 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.409517    2562 scope.go:117] "RemoveContainer" containerID="1dff8f5d40df7e58529107464828ef3259a3a80f26e7f1ebb9ee678ce1cf1146"
Jul 02 19:18:05.409732 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.409707    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1dff8f5d40df7e58529107464828ef3259a3a80f26e7f1ebb9ee678ce1cf1146"} err="failed to get container status \"1dff8f5d40df7e58529107464828ef3259a3a80f26e7f1ebb9ee678ce1cf1146\": rpc error: code = NotFound desc = could not find container \"1dff8f5d40df7e58529107464828ef3259a3a80f26e7f1ebb9ee678ce1cf1146\": container with ID starting with 1dff8f5d40df7e58529107464828ef3259a3a80f26e7f1ebb9ee678ce1cf1146 not found: ID does not exist"
Jul 02 19:18:05.409732 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.409719    2562 scope.go:117] "RemoveContainer" containerID="60b896a919a877d28db28714fa509c3d6fd8c5af2b3016616db26f75ef118274"
Jul 02 19:18:05.409955 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.409936    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60b896a919a877d28db28714fa509c3d6fd8c5af2b3016616db26f75ef118274"} err="failed to get container status \"60b896a919a877d28db28714fa509c3d6fd8c5af2b3016616db26f75ef118274\": rpc error: code = NotFound desc = could not find container \"60b896a919a877d28db28714fa509c3d6fd8c5af2b3016616db26f75ef118274\": container with ID starting with 60b896a919a877d28db28714fa509c3d6fd8c5af2b3016616db26f75ef118274 not found: ID does not exist"
Jul 02 19:18:05.409955 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.409955    2562 scope.go:117] "RemoveContainer" containerID="acbc5cc6255dd8fe692e774c71757c65208c4074bd6d40e04689179444db47f3"
Jul 02 19:18:05.410182 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.410166    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"acbc5cc6255dd8fe692e774c71757c65208c4074bd6d40e04689179444db47f3"} err="failed to get container status \"acbc5cc6255dd8fe692e774c71757c65208c4074bd6d40e04689179444db47f3\": rpc error: code = NotFound desc = could not find container \"acbc5cc6255dd8fe692e774c71757c65208c4074bd6d40e04689179444db47f3\": container with ID starting with acbc5cc6255dd8fe692e774c71757c65208c4074bd6d40e04689179444db47f3 not found: ID does not exist"
Jul 02 19:18:05.413519 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.413504    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:18:05.416407 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.416390    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 02 19:18:05.416634 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.416610    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 02 19:18:05.416709 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.416649    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 02 19:18:05.416765 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.416711    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 02 19:18:05.416902 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.416882    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 02 19:18:05.417060 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.417029    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-xbrg9\""
Jul 02 19:18:05.417060 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.417057    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 02 19:18:05.417241 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.417073    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-e2prar2vaadi7\""
Jul 02 19:18:05.417241 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.417037    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 02 19:18:05.417241 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.417029    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 02 19:18:05.417241 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.417057    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 02 19:18:05.417686 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.417673    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 02 19:18:05.418434 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.418416    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 02 19:18:05.418558 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.418434    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 02 19:18:05.420675 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.420657    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 02 19:18:05.422822 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.422806    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 02 19:18:05.430459 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.430435    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 02 19:18:05.488889 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.488856    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4f935b0c-72d3-4c82-85d1-89b5eb356167-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4f935b0c-72d3-4c82-85d1-89b5eb356167\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:18:05.488889 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.488890    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkk77\" (UniqueName: \"kubernetes.io/projected/4f935b0c-72d3-4c82-85d1-89b5eb356167-kube-api-access-kkk77\") pod \"prometheus-k8s-0\" (UID: \"4f935b0c-72d3-4c82-85d1-89b5eb356167\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:18:05.489104 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.488931    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4f935b0c-72d3-4c82-85d1-89b5eb356167-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4f935b0c-72d3-4c82-85d1-89b5eb356167\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:18:05.489104 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.488972    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4f935b0c-72d3-4c82-85d1-89b5eb356167-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4f935b0c-72d3-4c82-85d1-89b5eb356167\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:18:05.489104 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.488989    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4f935b0c-72d3-4c82-85d1-89b5eb356167-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4f935b0c-72d3-4c82-85d1-89b5eb356167\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:18:05.489104 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.489010    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4f935b0c-72d3-4c82-85d1-89b5eb356167-config\") pod \"prometheus-k8s-0\" (UID: \"4f935b0c-72d3-4c82-85d1-89b5eb356167\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:18:05.489104 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.489035    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4f935b0c-72d3-4c82-85d1-89b5eb356167-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4f935b0c-72d3-4c82-85d1-89b5eb356167\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:18:05.489104 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.489071    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f935b0c-72d3-4c82-85d1-89b5eb356167-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4f935b0c-72d3-4c82-85d1-89b5eb356167\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:18:05.489104 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.489085    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4f935b0c-72d3-4c82-85d1-89b5eb356167-web-config\") pod \"prometheus-k8s-0\" (UID: \"4f935b0c-72d3-4c82-85d1-89b5eb356167\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:18:05.489307 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.489108    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4f935b0c-72d3-4c82-85d1-89b5eb356167-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4f935b0c-72d3-4c82-85d1-89b5eb356167\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:18:05.489307 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.489138    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4f935b0c-72d3-4c82-85d1-89b5eb356167-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4f935b0c-72d3-4c82-85d1-89b5eb356167\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:18:05.489307 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.489152    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4f935b0c-72d3-4c82-85d1-89b5eb356167-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4f935b0c-72d3-4c82-85d1-89b5eb356167\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:18:05.489307 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.489172    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4f935b0c-72d3-4c82-85d1-89b5eb356167-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4f935b0c-72d3-4c82-85d1-89b5eb356167\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:18:05.489307 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.489199    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f935b0c-72d3-4c82-85d1-89b5eb356167-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4f935b0c-72d3-4c82-85d1-89b5eb356167\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:18:05.489307 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.489251    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4f935b0c-72d3-4c82-85d1-89b5eb356167-config-out\") pod \"prometheus-k8s-0\" (UID: \"4f935b0c-72d3-4c82-85d1-89b5eb356167\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:18:05.489307 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.489274    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4f935b0c-72d3-4c82-85d1-89b5eb356167-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4f935b0c-72d3-4c82-85d1-89b5eb356167\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:18:05.489307 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.489300    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f935b0c-72d3-4c82-85d1-89b5eb356167-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4f935b0c-72d3-4c82-85d1-89b5eb356167\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:18:05.489536 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.489322    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4f935b0c-72d3-4c82-85d1-89b5eb356167-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4f935b0c-72d3-4c82-85d1-89b5eb356167\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:18:05.489536 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.489340    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4f935b0c-72d3-4c82-85d1-89b5eb356167-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4f935b0c-72d3-4c82-85d1-89b5eb356167\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:18:05.489536 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.489366    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f935b0c-72d3-4c82-85d1-89b5eb356167-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4f935b0c-72d3-4c82-85d1-89b5eb356167\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:18:05.589974 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.589904    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f935b0c-72d3-4c82-85d1-89b5eb356167-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4f935b0c-72d3-4c82-85d1-89b5eb356167\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:18:05.589974 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.589972    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4f935b0c-72d3-4c82-85d1-89b5eb356167-config-out\") pod \"prometheus-k8s-0\" (UID: \"4f935b0c-72d3-4c82-85d1-89b5eb356167\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:18:05.590205 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.589994    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4f935b0c-72d3-4c82-85d1-89b5eb356167-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4f935b0c-72d3-4c82-85d1-89b5eb356167\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:18:05.590205 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.590013    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f935b0c-72d3-4c82-85d1-89b5eb356167-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4f935b0c-72d3-4c82-85d1-89b5eb356167\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:18:05.590205 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.590029    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4f935b0c-72d3-4c82-85d1-89b5eb356167-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4f935b0c-72d3-4c82-85d1-89b5eb356167\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:18:05.590205 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.590046    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4f935b0c-72d3-4c82-85d1-89b5eb356167-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4f935b0c-72d3-4c82-85d1-89b5eb356167\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:18:05.590205 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.590073    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f935b0c-72d3-4c82-85d1-89b5eb356167-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4f935b0c-72d3-4c82-85d1-89b5eb356167\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:18:05.590205 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.590114    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4f935b0c-72d3-4c82-85d1-89b5eb356167-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4f935b0c-72d3-4c82-85d1-89b5eb356167\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:18:05.590205 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.590145    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkk77\" (UniqueName: \"kubernetes.io/projected/4f935b0c-72d3-4c82-85d1-89b5eb356167-kube-api-access-kkk77\") pod \"prometheus-k8s-0\" (UID: \"4f935b0c-72d3-4c82-85d1-89b5eb356167\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:18:05.590205 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.590174    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4f935b0c-72d3-4c82-85d1-89b5eb356167-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4f935b0c-72d3-4c82-85d1-89b5eb356167\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:18:05.590205 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.590197    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4f935b0c-72d3-4c82-85d1-89b5eb356167-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4f935b0c-72d3-4c82-85d1-89b5eb356167\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:18:05.590613 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.590222    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4f935b0c-72d3-4c82-85d1-89b5eb356167-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4f935b0c-72d3-4c82-85d1-89b5eb356167\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:18:05.590613 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.590248    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4f935b0c-72d3-4c82-85d1-89b5eb356167-config\") pod \"prometheus-k8s-0\" (UID: \"4f935b0c-72d3-4c82-85d1-89b5eb356167\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:18:05.590613 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.590270    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4f935b0c-72d3-4c82-85d1-89b5eb356167-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4f935b0c-72d3-4c82-85d1-89b5eb356167\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:18:05.590613 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.590305    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f935b0c-72d3-4c82-85d1-89b5eb356167-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4f935b0c-72d3-4c82-85d1-89b5eb356167\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:18:05.590613 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.590326    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4f935b0c-72d3-4c82-85d1-89b5eb356167-web-config\") pod \"prometheus-k8s-0\" (UID: \"4f935b0c-72d3-4c82-85d1-89b5eb356167\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:18:05.590613 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.590360    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4f935b0c-72d3-4c82-85d1-89b5eb356167-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4f935b0c-72d3-4c82-85d1-89b5eb356167\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:18:05.590613 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.590395    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4f935b0c-72d3-4c82-85d1-89b5eb356167-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4f935b0c-72d3-4c82-85d1-89b5eb356167\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:18:05.590613 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.590417    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4f935b0c-72d3-4c82-85d1-89b5eb356167-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4f935b0c-72d3-4c82-85d1-89b5eb356167\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:18:05.590613 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.590448    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4f935b0c-72d3-4c82-85d1-89b5eb356167-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4f935b0c-72d3-4c82-85d1-89b5eb356167\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:18:05.591223 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.590687    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f935b0c-72d3-4c82-85d1-89b5eb356167-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4f935b0c-72d3-4c82-85d1-89b5eb356167\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:18:05.591223 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.590838    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f935b0c-72d3-4c82-85d1-89b5eb356167-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4f935b0c-72d3-4c82-85d1-89b5eb356167\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:18:05.592003 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.591977    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f935b0c-72d3-4c82-85d1-89b5eb356167-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4f935b0c-72d3-4c82-85d1-89b5eb356167\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:18:05.593319 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.593292    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4f935b0c-72d3-4c82-85d1-89b5eb356167-config-out\") pod \"prometheus-k8s-0\" (UID: \"4f935b0c-72d3-4c82-85d1-89b5eb356167\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:18:05.593414 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.593367    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4f935b0c-72d3-4c82-85d1-89b5eb356167-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4f935b0c-72d3-4c82-85d1-89b5eb356167\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:18:05.593487 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.593408    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4f935b0c-72d3-4c82-85d1-89b5eb356167-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4f935b0c-72d3-4c82-85d1-89b5eb356167\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:18:05.593487 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.593428    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4f935b0c-72d3-4c82-85d1-89b5eb356167-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4f935b0c-72d3-4c82-85d1-89b5eb356167\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:18:05.593594 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.593531    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/4f935b0c-72d3-4c82-85d1-89b5eb356167-config\") pod \"prometheus-k8s-0\" (UID: \"4f935b0c-72d3-4c82-85d1-89b5eb356167\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:18:05.593653 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.593607    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4f935b0c-72d3-4c82-85d1-89b5eb356167-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4f935b0c-72d3-4c82-85d1-89b5eb356167\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:18:05.593705 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.593650    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4f935b0c-72d3-4c82-85d1-89b5eb356167-web-config\") pod \"prometheus-k8s-0\" (UID: \"4f935b0c-72d3-4c82-85d1-89b5eb356167\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:18:05.594689 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.594269    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4f935b0c-72d3-4c82-85d1-89b5eb356167-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4f935b0c-72d3-4c82-85d1-89b5eb356167\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:18:05.594689 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.594310    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f935b0c-72d3-4c82-85d1-89b5eb356167-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4f935b0c-72d3-4c82-85d1-89b5eb356167\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:18:05.594689 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.594370    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4f935b0c-72d3-4c82-85d1-89b5eb356167-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4f935b0c-72d3-4c82-85d1-89b5eb356167\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:18:05.594689 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.594639    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4f935b0c-72d3-4c82-85d1-89b5eb356167-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4f935b0c-72d3-4c82-85d1-89b5eb356167\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:18:05.594870 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.594724    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4f935b0c-72d3-4c82-85d1-89b5eb356167-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4f935b0c-72d3-4c82-85d1-89b5eb356167\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:18:05.595489 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.595466    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4f935b0c-72d3-4c82-85d1-89b5eb356167-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4f935b0c-72d3-4c82-85d1-89b5eb356167\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:18:05.595902 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.595885    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4f935b0c-72d3-4c82-85d1-89b5eb356167-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4f935b0c-72d3-4c82-85d1-89b5eb356167\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:18:05.596176 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.596159    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4f935b0c-72d3-4c82-85d1-89b5eb356167-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4f935b0c-72d3-4c82-85d1-89b5eb356167\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:18:05.597213 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.597174    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4f935b0c-72d3-4c82-85d1-89b5eb356167-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4f935b0c-72d3-4c82-85d1-89b5eb356167\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:18:05.598605 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.598590    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkk77\" (UniqueName: \"kubernetes.io/projected/4f935b0c-72d3-4c82-85d1-89b5eb356167-kube-api-access-kkk77\") pod \"prometheus-k8s-0\" (UID: \"4f935b0c-72d3-4c82-85d1-89b5eb356167\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:18:05.723560 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.723518    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:18:05.859737 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:05.859585    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 02 19:18:05.862343 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:18:05.862315    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f935b0c_72d3_4c82_85d1_89b5eb356167.slice/crio-096738d40d834bf693cfdad8dad1abf9e965229b31311859b46adcbaff89bbdd WatchSource:0}: Error finding container 096738d40d834bf693cfdad8dad1abf9e965229b31311859b46adcbaff89bbdd: Status 404 returned error can't find the container with id 096738d40d834bf693cfdad8dad1abf9e965229b31311859b46adcbaff89bbdd
Jul 02 19:18:06.117520 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:06.117439    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a888795d-1afa-48a3-981f-8db2cdf26174" path="/var/lib/kubelet/pods/a888795d-1afa-48a3-981f-8db2cdf26174/volumes"
Jul 02 19:18:06.352180 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:06.352153    2562 generic.go:356] "Generic (PLEG): container finished" podID="4f935b0c-72d3-4c82-85d1-89b5eb356167" containerID="fe39283de3b02e34c20dafff352e8f22187252c227260d6bb3239a0ca773d72f" exitCode=0
Jul 02 19:18:06.352331 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:06.352200    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4f935b0c-72d3-4c82-85d1-89b5eb356167","Type":"ContainerDied","Data":"fe39283de3b02e34c20dafff352e8f22187252c227260d6bb3239a0ca773d72f"}
Jul 02 19:18:06.352331 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:06.352250    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4f935b0c-72d3-4c82-85d1-89b5eb356167","Type":"ContainerStarted","Data":"096738d40d834bf693cfdad8dad1abf9e965229b31311859b46adcbaff89bbdd"}
Jul 02 19:18:07.358668 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:07.358629    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4f935b0c-72d3-4c82-85d1-89b5eb356167","Type":"ContainerStarted","Data":"2346ba6e103059c4854d3e2ce700be882f04bfd8d1507fb6c4dd5f5d86a89575"}
Jul 02 19:18:07.359033 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:07.358748    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4f935b0c-72d3-4c82-85d1-89b5eb356167","Type":"ContainerStarted","Data":"53e2002ffebe662aedce1ad68ec030e0be14b771218186d2526f9f3e7c3f5cf5"}
Jul 02 19:18:07.359033 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:07.358789    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4f935b0c-72d3-4c82-85d1-89b5eb356167","Type":"ContainerStarted","Data":"3b86cdc97b2e54b9071f022aa3e8e8b8c2e97c6c52e847d795682a65a8bfb33a"}
Jul 02 19:18:07.359033 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:07.358824    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4f935b0c-72d3-4c82-85d1-89b5eb356167","Type":"ContainerStarted","Data":"c592b065fe81312aec11fdd1ea5b6dd5c39585d6b3fc437dac570dc64de70e40"}
Jul 02 19:18:07.359033 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:07.358857    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4f935b0c-72d3-4c82-85d1-89b5eb356167","Type":"ContainerStarted","Data":"6787e04df45f0719bf16ba28a89f9c55ad7c27901ec1c92b36b0f5b7ea21aa2d"}
Jul 02 19:18:07.359033 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:07.358900    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4f935b0c-72d3-4c82-85d1-89b5eb356167","Type":"ContainerStarted","Data":"4be5ce2ea8eceebf03578ac73397f95059d433ca79783806ffaeaf2f6104bf85"}
Jul 02 19:18:07.390948 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:07.389969    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.36972769 podStartE2EDuration="2.389947526s" totalImagesPullingTime="0s" totalInitContainerRuntime="20.219836ms" isStatefulPod=false podCreationTimestamp="2026-07-02 19:18:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:18:07.387091894 +0000 UTC m=+383.751161830" watchObservedRunningTime="2026-07-02 19:18:07.389947526 +0000 UTC m=+383.754017435"
Jul 02 19:18:08.421414 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:08.421381    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:18:08.622956 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:08.622922    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:18:08.723127 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:08.723095    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:18:09.156491 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:09.156398    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:18:09.204904 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:09.204874    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:18:10.724599 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:10.724552    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:18:18.436925 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:18.436878    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:18:18.491520 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:18.491491    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:18:19.753820 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:19.753784    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:18:19.855389 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:19.855363    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:18:19.910978 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:19.910944    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:18:47.812753 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:47.812718    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:18:47.867858 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:18:47.867825    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:19:05.724471 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:19:05.724386    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:19:05.740087 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:19:05.740063    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:19:06.588224 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:19:06.588199    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:19:14.512061 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:19:14.511997    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:19:14.614514 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:19:14.614484    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:19:21.692656 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:19:21.692618    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:19:21.750111 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:19:21.750084    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:19:26.381782 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:19:26.381753    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:19:26.435285 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:19:26.435254    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:19:32.719158 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:19:32.719118    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:19:32.775165 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:19:32.775130    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:19:32.831292 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:19:32.831230    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:19:38.387256 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:19:38.387217    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:19:38.486545 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:19:38.486494    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:19:47.702880 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:19:47.702843    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:20:46.190758 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:20:46.190685    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:20:46.288401 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:20:46.288370    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:21:07.279250 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:07.279212    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:21:09.343295 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:09.343264    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:21:09.444455 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:09.444423    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:21:12.614404 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:12.614368    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:21:14.036251 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:14.036218    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:21:14.124057 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:14.124014    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:21:16.222965 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:16.222932    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:21:16.323566 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:16.323522    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:21:17.357728 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:17.357686    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:21:17.469424 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:17.469397    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:21:18.381445 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:18.381409    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:21:18.481118 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:18.481088    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:21:20.587042 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:20.586967    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:21:20.802584 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:20.802550    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:21:23.223870 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:23.223838    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:21:23.321132 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:23.321100    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:21:26.865862 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:26.865830    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:21:26.935797 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:26.935765    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:21:28.793054 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:28.793016    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:21:29.274684 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:29.274645    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:21:29.373669 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:29.373619    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:21:36.108954 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:36.108891    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:21:38.200993 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:38.200964    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:21:43.985969 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:43.985938    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lgt7t_38beee50-e2c9-489e-91cb-f1bfad99fabf/ovn-acl-logging/0.log"
Jul 02 19:21:43.986384 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:43.986042    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lgt7t_38beee50-e2c9-489e-91cb-f1bfad99fabf/ovn-acl-logging/0.log"
Jul 02 19:21:50.491702 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:50.491669    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:21:50.526840 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:50.526809    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5d5f586fb-tgb8j"]
Jul 02 19:21:50.529747 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:50.529732    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5d5f586fb-tgb8j"
Jul 02 19:21:50.532736 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:50.532717    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 02 19:21:50.534141 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:50.534107    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-krjss\""
Jul 02 19:21:50.534252 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:50.534179    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 02 19:21:50.534252 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:50.534197    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 02 19:21:50.534366 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:50.534257    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 02 19:21:50.534366 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:50.534321    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 02 19:21:50.543976 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:50.543957    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5d5f586fb-tgb8j"]
Jul 02 19:21:50.583952 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:50.583879    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:21:50.658228 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:50.658193    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4621dadf-d7d2-45fd-b892-c9083827885f-cert\") pod \"lws-controller-manager-5d5f586fb-tgb8j\" (UID: \"4621dadf-d7d2-45fd-b892-c9083827885f\") " pod="openshift-lws-operator/lws-controller-manager-5d5f586fb-tgb8j"
Jul 02 19:21:50.658388 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:50.658236    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4621dadf-d7d2-45fd-b892-c9083827885f-manager-config\") pod \"lws-controller-manager-5d5f586fb-tgb8j\" (UID: \"4621dadf-d7d2-45fd-b892-c9083827885f\") " pod="openshift-lws-operator/lws-controller-manager-5d5f586fb-tgb8j"
Jul 02 19:21:50.658388 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:50.658335    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcpgv\" (UniqueName: \"kubernetes.io/projected/4621dadf-d7d2-45fd-b892-c9083827885f-kube-api-access-qcpgv\") pod \"lws-controller-manager-5d5f586fb-tgb8j\" (UID: \"4621dadf-d7d2-45fd-b892-c9083827885f\") " pod="openshift-lws-operator/lws-controller-manager-5d5f586fb-tgb8j"
Jul 02 19:21:50.658388 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:50.658376    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4621dadf-d7d2-45fd-b892-c9083827885f-metrics-cert\") pod \"lws-controller-manager-5d5f586fb-tgb8j\" (UID: \"4621dadf-d7d2-45fd-b892-c9083827885f\") " pod="openshift-lws-operator/lws-controller-manager-5d5f586fb-tgb8j"
Jul 02 19:21:50.759251 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:50.759168    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcpgv\" (UniqueName: \"kubernetes.io/projected/4621dadf-d7d2-45fd-b892-c9083827885f-kube-api-access-qcpgv\") pod \"lws-controller-manager-5d5f586fb-tgb8j\" (UID: \"4621dadf-d7d2-45fd-b892-c9083827885f\") " pod="openshift-lws-operator/lws-controller-manager-5d5f586fb-tgb8j"
Jul 02 19:21:50.759251 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:50.759224    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4621dadf-d7d2-45fd-b892-c9083827885f-metrics-cert\") pod \"lws-controller-manager-5d5f586fb-tgb8j\" (UID: \"4621dadf-d7d2-45fd-b892-c9083827885f\") " pod="openshift-lws-operator/lws-controller-manager-5d5f586fb-tgb8j"
Jul 02 19:21:50.759420 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:50.759282    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4621dadf-d7d2-45fd-b892-c9083827885f-cert\") pod \"lws-controller-manager-5d5f586fb-tgb8j\" (UID: \"4621dadf-d7d2-45fd-b892-c9083827885f\") " pod="openshift-lws-operator/lws-controller-manager-5d5f586fb-tgb8j"
Jul 02 19:21:50.759420 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:50.759312    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4621dadf-d7d2-45fd-b892-c9083827885f-manager-config\") pod \"lws-controller-manager-5d5f586fb-tgb8j\" (UID: \"4621dadf-d7d2-45fd-b892-c9083827885f\") " pod="openshift-lws-operator/lws-controller-manager-5d5f586fb-tgb8j"
Jul 02 19:21:50.759928 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:50.759893    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4621dadf-d7d2-45fd-b892-c9083827885f-manager-config\") pod \"lws-controller-manager-5d5f586fb-tgb8j\" (UID: \"4621dadf-d7d2-45fd-b892-c9083827885f\") " pod="openshift-lws-operator/lws-controller-manager-5d5f586fb-tgb8j"
Jul 02 19:21:50.761744 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:50.761724    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4621dadf-d7d2-45fd-b892-c9083827885f-cert\") pod \"lws-controller-manager-5d5f586fb-tgb8j\" (UID: \"4621dadf-d7d2-45fd-b892-c9083827885f\") " pod="openshift-lws-operator/lws-controller-manager-5d5f586fb-tgb8j"
Jul 02 19:21:50.761902 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:50.761882    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4621dadf-d7d2-45fd-b892-c9083827885f-metrics-cert\") pod \"lws-controller-manager-5d5f586fb-tgb8j\" (UID: \"4621dadf-d7d2-45fd-b892-c9083827885f\") " pod="openshift-lws-operator/lws-controller-manager-5d5f586fb-tgb8j"
Jul 02 19:21:50.775414 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:50.775384    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcpgv\" (UniqueName: \"kubernetes.io/projected/4621dadf-d7d2-45fd-b892-c9083827885f-kube-api-access-qcpgv\") pod \"lws-controller-manager-5d5f586fb-tgb8j\" (UID: \"4621dadf-d7d2-45fd-b892-c9083827885f\") " pod="openshift-lws-operator/lws-controller-manager-5d5f586fb-tgb8j"
Jul 02 19:21:50.838773 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:50.838745    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5d5f586fb-tgb8j"
Jul 02 19:21:50.928274 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:50.928245    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:21:50.983421 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:50.983394    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5d5f586fb-tgb8j"]
Jul 02 19:21:50.985835 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:21:50.985810    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4621dadf_d7d2_45fd_b892_c9083827885f.slice/crio-005c513bbbd30a44ff2ecbb906253283f781a0e32264d57aba0805d40b4ccb89 WatchSource:0}: Error finding container 005c513bbbd30a44ff2ecbb906253283f781a0e32264d57aba0805d40b4ccb89: Status 404 returned error can't find the container with id 005c513bbbd30a44ff2ecbb906253283f781a0e32264d57aba0805d40b4ccb89
Jul 02 19:21:50.987752 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:50.987737    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 19:21:51.027646 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:51.027565    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:21:51.154475 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:51.154441    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5d5f586fb-tgb8j" event={"ID":"4621dadf-d7d2-45fd-b892-c9083827885f","Type":"ContainerStarted","Data":"005c513bbbd30a44ff2ecbb906253283f781a0e32264d57aba0805d40b4ccb89"}
Jul 02 19:21:51.472266 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:51.472241    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:21:51.772610 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:51.772519    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:21:51.876675 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:51.876646    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:21:51.920606 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:51.920574    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6974d4f959-w4pqq"]
Jul 02 19:21:51.924648 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:51.924623    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6974d4f959-w4pqq"
Jul 02 19:21:51.929021 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:51.928190    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-s29m5\""
Jul 02 19:21:51.929021 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:51.928422    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 02 19:21:51.929021 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:51.928607    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 02 19:21:51.929021 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:51.928892    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 02 19:21:51.929318 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:51.929115    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 02 19:21:51.941444 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:51.941391    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6974d4f959-w4pqq"]
Jul 02 19:21:52.072093 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:52.072008    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c55e7418-d422-4508-acf6-dcbe576431f4-manifests\") pod \"opendatahub-operator-controller-manager-6974d4f959-w4pqq\" (UID: \"c55e7418-d422-4508-acf6-dcbe576431f4\") " pod="opendatahub/opendatahub-operator-controller-manager-6974d4f959-w4pqq"
Jul 02 19:21:52.072093 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:52.072050    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c55e7418-d422-4508-acf6-dcbe576431f4-webhook-cert\") pod \"opendatahub-operator-controller-manager-6974d4f959-w4pqq\" (UID: \"c55e7418-d422-4508-acf6-dcbe576431f4\") " pod="opendatahub/opendatahub-operator-controller-manager-6974d4f959-w4pqq"
Jul 02 19:21:52.072093 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:52.072079    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c55e7418-d422-4508-acf6-dcbe576431f4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6974d4f959-w4pqq\" (UID: \"c55e7418-d422-4508-acf6-dcbe576431f4\") " pod="opendatahub/opendatahub-operator-controller-manager-6974d4f959-w4pqq"
Jul 02 19:21:52.072378 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:52.072203    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c55e7418-d422-4508-acf6-dcbe576431f4-tmp\") pod \"opendatahub-operator-controller-manager-6974d4f959-w4pqq\" (UID: \"c55e7418-d422-4508-acf6-dcbe576431f4\") " pod="opendatahub/opendatahub-operator-controller-manager-6974d4f959-w4pqq"
Jul 02 19:21:52.072378 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:52.072260    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cj76j\" (UniqueName: \"kubernetes.io/projected/c55e7418-d422-4508-acf6-dcbe576431f4-kube-api-access-cj76j\") pod \"opendatahub-operator-controller-manager-6974d4f959-w4pqq\" (UID: \"c55e7418-d422-4508-acf6-dcbe576431f4\") " pod="opendatahub/opendatahub-operator-controller-manager-6974d4f959-w4pqq"
Jul 02 19:21:52.073117 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:52.073086    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:21:52.169118 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:52.169087    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:21:52.173172 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:52.173141    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c55e7418-d422-4508-acf6-dcbe576431f4-manifests\") pod \"opendatahub-operator-controller-manager-6974d4f959-w4pqq\" (UID: \"c55e7418-d422-4508-acf6-dcbe576431f4\") " pod="opendatahub/opendatahub-operator-controller-manager-6974d4f959-w4pqq"
Jul 02 19:21:52.173310 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:52.173179    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c55e7418-d422-4508-acf6-dcbe576431f4-webhook-cert\") pod \"opendatahub-operator-controller-manager-6974d4f959-w4pqq\" (UID: \"c55e7418-d422-4508-acf6-dcbe576431f4\") " pod="opendatahub/opendatahub-operator-controller-manager-6974d4f959-w4pqq"
Jul 02 19:21:52.173310 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:52.173212    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c55e7418-d422-4508-acf6-dcbe576431f4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6974d4f959-w4pqq\" (UID: \"c55e7418-d422-4508-acf6-dcbe576431f4\") " pod="opendatahub/opendatahub-operator-controller-manager-6974d4f959-w4pqq"
Jul 02 19:21:52.173310 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:52.173288    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c55e7418-d422-4508-acf6-dcbe576431f4-tmp\") pod \"opendatahub-operator-controller-manager-6974d4f959-w4pqq\" (UID: \"c55e7418-d422-4508-acf6-dcbe576431f4\") " pod="opendatahub/opendatahub-operator-controller-manager-6974d4f959-w4pqq"
Jul 02 19:21:52.173480 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:52.173336    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cj76j\" (UniqueName: \"kubernetes.io/projected/c55e7418-d422-4508-acf6-dcbe576431f4-kube-api-access-cj76j\") pod \"opendatahub-operator-controller-manager-6974d4f959-w4pqq\" (UID: \"c55e7418-d422-4508-acf6-dcbe576431f4\") " pod="opendatahub/opendatahub-operator-controller-manager-6974d4f959-w4pqq"
Jul 02 19:21:52.173582 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:52.173530    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c55e7418-d422-4508-acf6-dcbe576431f4-manifests\") pod \"opendatahub-operator-controller-manager-6974d4f959-w4pqq\" (UID: \"c55e7418-d422-4508-acf6-dcbe576431f4\") " pod="opendatahub/opendatahub-operator-controller-manager-6974d4f959-w4pqq"
Jul 02 19:21:52.176043 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:52.176019    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c55e7418-d422-4508-acf6-dcbe576431f4-tmp\") pod \"opendatahub-operator-controller-manager-6974d4f959-w4pqq\" (UID: \"c55e7418-d422-4508-acf6-dcbe576431f4\") " pod="opendatahub/opendatahub-operator-controller-manager-6974d4f959-w4pqq"
Jul 02 19:21:52.176235 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:52.176216    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c55e7418-d422-4508-acf6-dcbe576431f4-webhook-cert\") pod \"opendatahub-operator-controller-manager-6974d4f959-w4pqq\" (UID: \"c55e7418-d422-4508-acf6-dcbe576431f4\") " pod="opendatahub/opendatahub-operator-controller-manager-6974d4f959-w4pqq"
Jul 02 19:21:52.176297 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:52.176265    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c55e7418-d422-4508-acf6-dcbe576431f4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6974d4f959-w4pqq\" (UID: \"c55e7418-d422-4508-acf6-dcbe576431f4\") " pod="opendatahub/opendatahub-operator-controller-manager-6974d4f959-w4pqq"
Jul 02 19:21:52.183000 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:52.182974    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cj76j\" (UniqueName: \"kubernetes.io/projected/c55e7418-d422-4508-acf6-dcbe576431f4-kube-api-access-cj76j\") pod \"opendatahub-operator-controller-manager-6974d4f959-w4pqq\" (UID: \"c55e7418-d422-4508-acf6-dcbe576431f4\") " pod="opendatahub/opendatahub-operator-controller-manager-6974d4f959-w4pqq"
Jul 02 19:21:52.241126 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:52.241097    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6974d4f959-w4pqq"
Jul 02 19:21:52.272239 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:52.272215    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:21:52.372312 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:52.372233    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:21:52.477897 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:52.477865    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:21:52.569811 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:52.569775    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:21:53.373790 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:53.373766    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6974d4f959-w4pqq"]
Jul 02 19:21:53.374790 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:21:53.374763    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc55e7418_d422_4508_acf6_dcbe576431f4.slice/crio-be16c22b576885d83536143902ffb64fb4314ad9f24f5839edeaa25ab2b7d064 WatchSource:0}: Error finding container be16c22b576885d83536143902ffb64fb4314ad9f24f5839edeaa25ab2b7d064: Status 404 returned error can't find the container with id be16c22b576885d83536143902ffb64fb4314ad9f24f5839edeaa25ab2b7d064
Jul 02 19:21:54.169130 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:54.169068    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5d5f586fb-tgb8j" event={"ID":"4621dadf-d7d2-45fd-b892-c9083827885f","Type":"ContainerStarted","Data":"acc669b2a966482dbba75431fe8076e6bb73961279468c3dee86248a17cfc7d0"}
Jul 02 19:21:54.169310 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:54.169240    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5d5f586fb-tgb8j"
Jul 02 19:21:54.171050 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:54.171023    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6974d4f959-w4pqq" event={"ID":"c55e7418-d422-4508-acf6-dcbe576431f4","Type":"ContainerStarted","Data":"be16c22b576885d83536143902ffb64fb4314ad9f24f5839edeaa25ab2b7d064"}
Jul 02 19:21:54.189717 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:54.189671    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5d5f586fb-tgb8j" podStartSLOduration=1.87638481 podStartE2EDuration="4.189653305s" totalImagesPullingTime="2.313268495s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:21:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:21:54.186724691 +0000 UTC m=+610.550794607" watchObservedRunningTime="2026-07-02 19:21:54.189653305 +0000 UTC m=+610.553723220"
Jul 02 19:21:57.184319 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:57.184282    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6974d4f959-w4pqq" event={"ID":"c55e7418-d422-4508-acf6-dcbe576431f4","Type":"ContainerStarted","Data":"0a170a4006a8c3164cd3fe8fa6afd36eebe1ff01623085518d252923c44409b1"}
Jul 02 19:21:58.188796 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:58.188763    2562 generic.go:356] "Generic (PLEG): container finished" podID="c55e7418-d422-4508-acf6-dcbe576431f4" containerID="0a170a4006a8c3164cd3fe8fa6afd36eebe1ff01623085518d252923c44409b1" exitCode=0
Jul 02 19:21:58.189199 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:58.188837    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6974d4f959-w4pqq" event={"ID":"c55e7418-d422-4508-acf6-dcbe576431f4","Type":"ContainerDied","Data":"0a170a4006a8c3164cd3fe8fa6afd36eebe1ff01623085518d252923c44409b1"}
Jul 02 19:21:59.194485 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:59.194450    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6974d4f959-w4pqq" event={"ID":"c55e7418-d422-4508-acf6-dcbe576431f4","Type":"ContainerStarted","Data":"8cedbf28070868a9f2500b583a600911111ca694f7a3f9aa749bc3c69996ec0b"}
Jul 02 19:21:59.194834 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:59.194585    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6974d4f959-w4pqq"
Jul 02 19:21:59.217843 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:21:59.217791    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6974d4f959-w4pqq" podStartSLOduration=3.97952786 podStartE2EDuration="8.217775886s" totalImagesPullingTime="3.187841721s" totalInitContainerRuntime="1.050406305s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:21:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:21:59.215899464 +0000 UTC m=+615.579969377" watchObservedRunningTime="2026-07-02 19:21:59.217775886 +0000 UTC m=+615.581845798"
Jul 02 19:22:02.992615 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:22:02.992579    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:22:03.093016 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:22:03.092982    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:22:05.177410 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:22:05.177337    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5d5f586fb-tgb8j"
Jul 02 19:22:10.202895 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:22:10.202867    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6974d4f959-w4pqq"
Jul 02 19:22:11.265106 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:22:11.265069    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:22:11.887444 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:22:11.887412    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:22:12.002874 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:22:12.002840    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:22:17.562325 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:22:17.562294    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:22:17.648823 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:22:17.648788    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-f9f996d75-s7vnm"]
Jul 02 19:22:17.656072 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:22:17.656052    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-f9f996d75-s7vnm"
Jul 02 19:22:17.661511 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:22:17.661494    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 02 19:22:17.661664 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:22:17.661645    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 02 19:22:17.663074 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:22:17.663059    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-wnvht\""
Jul 02 19:22:17.671176 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:22:17.671141    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-f9f996d75-s7vnm"]
Jul 02 19:22:17.688967 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:22:17.688941    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6pwl\" (UniqueName: \"kubernetes.io/projected/d2383b06-9801-4c35-ac1f-aa34dd7075f1-kube-api-access-g6pwl\") pod \"kube-auth-proxy-f9f996d75-s7vnm\" (UID: \"d2383b06-9801-4c35-ac1f-aa34dd7075f1\") " pod="openshift-ingress/kube-auth-proxy-f9f996d75-s7vnm"
Jul 02 19:22:17.689127 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:22:17.689018    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d2383b06-9801-4c35-ac1f-aa34dd7075f1-tmp\") pod \"kube-auth-proxy-f9f996d75-s7vnm\" (UID: \"d2383b06-9801-4c35-ac1f-aa34dd7075f1\") " pod="openshift-ingress/kube-auth-proxy-f9f996d75-s7vnm"
Jul 02 19:22:17.689127 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:22:17.689044    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2383b06-9801-4c35-ac1f-aa34dd7075f1-tls-certs\") pod \"kube-auth-proxy-f9f996d75-s7vnm\" (UID: \"d2383b06-9801-4c35-ac1f-aa34dd7075f1\") " pod="openshift-ingress/kube-auth-proxy-f9f996d75-s7vnm"
Jul 02 19:22:17.689445 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:22:17.689429    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:22:17.789419 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:22:17.789383    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d2383b06-9801-4c35-ac1f-aa34dd7075f1-tmp\") pod \"kube-auth-proxy-f9f996d75-s7vnm\" (UID: \"d2383b06-9801-4c35-ac1f-aa34dd7075f1\") " pod="openshift-ingress/kube-auth-proxy-f9f996d75-s7vnm"
Jul 02 19:22:17.789419 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:22:17.789428    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2383b06-9801-4c35-ac1f-aa34dd7075f1-tls-certs\") pod \"kube-auth-proxy-f9f996d75-s7vnm\" (UID: \"d2383b06-9801-4c35-ac1f-aa34dd7075f1\") " pod="openshift-ingress/kube-auth-proxy-f9f996d75-s7vnm"
Jul 02 19:22:17.789619 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:22:17.789451    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6pwl\" (UniqueName: \"kubernetes.io/projected/d2383b06-9801-4c35-ac1f-aa34dd7075f1-kube-api-access-g6pwl\") pod \"kube-auth-proxy-f9f996d75-s7vnm\" (UID: \"d2383b06-9801-4c35-ac1f-aa34dd7075f1\") " pod="openshift-ingress/kube-auth-proxy-f9f996d75-s7vnm"
Jul 02 19:22:17.791798 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:22:17.791762    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d2383b06-9801-4c35-ac1f-aa34dd7075f1-tmp\") pod \"kube-auth-proxy-f9f996d75-s7vnm\" (UID: \"d2383b06-9801-4c35-ac1f-aa34dd7075f1\") " pod="openshift-ingress/kube-auth-proxy-f9f996d75-s7vnm"
Jul 02 19:22:17.792039 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:22:17.792018    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2383b06-9801-4c35-ac1f-aa34dd7075f1-tls-certs\") pod \"kube-auth-proxy-f9f996d75-s7vnm\" (UID: \"d2383b06-9801-4c35-ac1f-aa34dd7075f1\") " pod="openshift-ingress/kube-auth-proxy-f9f996d75-s7vnm"
Jul 02 19:22:17.804685 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:22:17.804654    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6pwl\" (UniqueName: \"kubernetes.io/projected/d2383b06-9801-4c35-ac1f-aa34dd7075f1-kube-api-access-g6pwl\") pod \"kube-auth-proxy-f9f996d75-s7vnm\" (UID: \"d2383b06-9801-4c35-ac1f-aa34dd7075f1\") " pod="openshift-ingress/kube-auth-proxy-f9f996d75-s7vnm"
Jul 02 19:22:17.894711 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:22:17.894630    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:22:17.965155 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:22:17.965118    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-f9f996d75-s7vnm"
Jul 02 19:22:17.980847 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:22:17.980817    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:22:18.080731 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:22:18.080694    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:22:18.097781 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:22:18.097659    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-f9f996d75-s7vnm"]
Jul 02 19:22:18.100474 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:22:18.100453    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2383b06_9801_4c35_ac1f_aa34dd7075f1.slice/crio-5f113e5148471c61586cfe2a3329a543ead9920ec8a13b0a60764f8e636fde6e WatchSource:0}: Error finding container 5f113e5148471c61586cfe2a3329a543ead9920ec8a13b0a60764f8e636fde6e: Status 404 returned error can't find the container with id 5f113e5148471c61586cfe2a3329a543ead9920ec8a13b0a60764f8e636fde6e
Jul 02 19:22:18.186724 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:22:18.186640    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:22:18.269649 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:22:18.269615    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-f9f996d75-s7vnm" event={"ID":"d2383b06-9801-4c35-ac1f-aa34dd7075f1","Type":"ContainerStarted","Data":"5f113e5148471c61586cfe2a3329a543ead9920ec8a13b0a60764f8e636fde6e"}
Jul 02 19:22:18.697363 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:22:18.697332    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:22:18.803846 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:22:18.803816    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:22:18.904596 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:22:18.904565    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:22:18.998862 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:22:18.998823    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:22:19.936502 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:22:19.936469    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:22:22.287495 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:22:22.287463    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-f9f996d75-s7vnm" event={"ID":"d2383b06-9801-4c35-ac1f-aa34dd7075f1","Type":"ContainerStarted","Data":"b61eca033c28b450965e5868ce2808f790db73b975ba029dafdc7337f882ff20"}
Jul 02 19:22:22.305003 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:22:22.304952    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-f9f996d75-s7vnm" podStartSLOduration=1.750939071 podStartE2EDuration="5.30493446s" totalImagesPullingTime="3.553995389s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:22:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:22:22.303787387 +0000 UTC m=+638.667857301" watchObservedRunningTime="2026-07-02 19:22:22.30493446 +0000 UTC m=+638.669004375"
Jul 02 19:22:25.066987 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:22:25.066956    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:22:25.167657 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:22:25.167621    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:22:25.762901 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:22:25.762863    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:22:26.102828 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:22:26.102735    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:22:26.264928 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:22:26.264884    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:22:27.580731 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:22:27.580695    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:22:27.679228 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:22:27.679169    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:22:27.760878 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:22:27.760852    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:22:28.020990 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:22:28.020946    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:22:28.128814 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:22:28.128785    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:22:28.880602 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:22:28.880569    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:22:28.974700 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:22:28.974675    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:22:51.899076 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:22:51.899040    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:22:52.000341 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:22:52.000309    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:22:53.815601 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:22:53.815569    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:22:53.869737 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:22:53.869703    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:23:03.457396 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:23:03.457363    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:23:13.288455 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:23:13.288424    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:23:13.388655 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:23:13.388610    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:23:13.487718 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:23:13.487667    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:23:14.232197 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:23:14.232137    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:23:14.475555 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:23:14.475527    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:23:27.122693 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:23:27.122661    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:23:27.222783 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:23:27.222748    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:23:38.275707 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:23:38.275633    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:23:38.376969 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:23:38.376937    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:23:38.430788 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:23:38.430737    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:23:42.029602 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:23:42.029571    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:23:42.630612 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:23:42.630581    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:23:47.444711 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:23:47.444674    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:23:49.504829 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:23:49.504788    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:23:49.600992 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:23:49.600966    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:23:50.033125 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:23:50.033098    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:23:51.957320 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:23:51.957287    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:23:53.670684 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:23:53.670645    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:23:55.249377 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:23:55.249347    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:23:56.494111 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:23:56.494075    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:23:56.969374 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:23:56.969344    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-tf79h"]
Jul 02 19:23:56.972617 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:23:56.972598    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tf79h"
Jul 02 19:23:56.975230 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:23:56.975200    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 02 19:23:56.975363 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:23:56.975270    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-pdpn6\""
Jul 02 19:23:56.975459 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:23:56.975429    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 02 19:23:56.975459 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:23:56.975432    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 02 19:23:56.984972 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:23:56.984952    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-tf79h"]
Jul 02 19:23:57.121992 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:23:57.121957    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9fm4\" (UniqueName: \"kubernetes.io/projected/d4de94f9-8c78-4ab0-b796-3803518e58a5-kube-api-access-k9fm4\") pod \"dns-operator-controller-manager-864dd78c4c-tf79h\" (UID: \"d4de94f9-8c78-4ab0-b796-3803518e58a5\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tf79h"
Jul 02 19:23:57.222939 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:23:57.222829    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9fm4\" (UniqueName: \"kubernetes.io/projected/d4de94f9-8c78-4ab0-b796-3803518e58a5-kube-api-access-k9fm4\") pod \"dns-operator-controller-manager-864dd78c4c-tf79h\" (UID: \"d4de94f9-8c78-4ab0-b796-3803518e58a5\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tf79h"
Jul 02 19:23:57.234690 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:23:57.234666    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9fm4\" (UniqueName: \"kubernetes.io/projected/d4de94f9-8c78-4ab0-b796-3803518e58a5-kube-api-access-k9fm4\") pod \"dns-operator-controller-manager-864dd78c4c-tf79h\" (UID: \"d4de94f9-8c78-4ab0-b796-3803518e58a5\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tf79h"
Jul 02 19:23:57.282530 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:23:57.282501    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tf79h"
Jul 02 19:23:57.430976 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:23:57.430941    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-tf79h"]
Jul 02 19:23:57.435489 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:23:57.435464    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4de94f9_8c78_4ab0_b796_3803518e58a5.slice/crio-f2543e27018c91c871050f836d0570d3aa8f89b0d3660e1b02f7ab40e7a82529 WatchSource:0}: Error finding container f2543e27018c91c871050f836d0570d3aa8f89b0d3660e1b02f7ab40e7a82529: Status 404 returned error can't find the container with id f2543e27018c91c871050f836d0570d3aa8f89b0d3660e1b02f7ab40e7a82529
Jul 02 19:23:57.646685 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:23:57.646607    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tf79h" event={"ID":"d4de94f9-8c78-4ab0-b796-3803518e58a5","Type":"ContainerStarted","Data":"f2543e27018c91c871050f836d0570d3aa8f89b0d3660e1b02f7ab40e7a82529"}
Jul 02 19:23:58.434102 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:23:58.434071    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:23:58.496385 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:23:58.496353    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:23:58.836035 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:23:58.836004    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:23:58.901682 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:23:58.901641    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:24:00.663104 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:00.663069    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tf79h" event={"ID":"d4de94f9-8c78-4ab0-b796-3803518e58a5","Type":"ContainerStarted","Data":"f7f692847dfcb214963a3f8eb1df039a0b2d27b04aa3adcf0e4c085108c0f4ba"}
Jul 02 19:24:00.663500 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:00.663208    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tf79h"
Jul 02 19:24:00.706394 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:00.706349    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tf79h" podStartSLOduration=2.16590929 podStartE2EDuration="4.706334279s" totalImagesPullingTime="2.540424989s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:23:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:24:00.704684978 +0000 UTC m=+737.068754891" watchObservedRunningTime="2026-07-02 19:24:00.706334279 +0000 UTC m=+737.070404191"
Jul 02 19:24:02.438462 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:02.438425    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:24:02.545543 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:02.545509    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:24:03.415196 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:03.415160    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-d46vz"]
Jul 02 19:24:03.418486 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:03.418466    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-d46vz"
Jul 02 19:24:03.421172 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:03.421145    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 02 19:24:03.421298 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:03.421254    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-zd8cf\""
Jul 02 19:24:03.421298 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:03.421276    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 02 19:24:03.428261 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:03.428240    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-d46vz"]
Jul 02 19:24:03.430954 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:03.430904    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:24:03.565015 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:03.564979    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:24:03.576136 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:03.576107    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/697e2b89-9737-49e5-a9ad-0fdd3d076cc2-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-d46vz\" (UID: \"697e2b89-9737-49e5-a9ad-0fdd3d076cc2\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-d46vz"
Jul 02 19:24:03.576238 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:03.576146    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m88zg\" (UniqueName: \"kubernetes.io/projected/697e2b89-9737-49e5-a9ad-0fdd3d076cc2-kube-api-access-m88zg\") pod \"kuadrant-console-plugin-66b5774985-d46vz\" (UID: \"697e2b89-9737-49e5-a9ad-0fdd3d076cc2\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-d46vz"
Jul 02 19:24:03.576299 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:03.576260    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/697e2b89-9737-49e5-a9ad-0fdd3d076cc2-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-d46vz\" (UID: \"697e2b89-9737-49e5-a9ad-0fdd3d076cc2\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-d46vz"
Jul 02 19:24:03.676793 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:03.676710    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/697e2b89-9737-49e5-a9ad-0fdd3d076cc2-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-d46vz\" (UID: \"697e2b89-9737-49e5-a9ad-0fdd3d076cc2\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-d46vz"
Jul 02 19:24:03.676793 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:03.676750    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/697e2b89-9737-49e5-a9ad-0fdd3d076cc2-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-d46vz\" (UID: \"697e2b89-9737-49e5-a9ad-0fdd3d076cc2\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-d46vz"
Jul 02 19:24:03.676793 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:03.676771    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m88zg\" (UniqueName: \"kubernetes.io/projected/697e2b89-9737-49e5-a9ad-0fdd3d076cc2-kube-api-access-m88zg\") pod \"kuadrant-console-plugin-66b5774985-d46vz\" (UID: \"697e2b89-9737-49e5-a9ad-0fdd3d076cc2\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-d46vz"
Jul 02 19:24:03.677410 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:03.677391    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/697e2b89-9737-49e5-a9ad-0fdd3d076cc2-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-d46vz\" (UID: \"697e2b89-9737-49e5-a9ad-0fdd3d076cc2\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-d46vz"
Jul 02 19:24:03.679443 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:03.679423    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/697e2b89-9737-49e5-a9ad-0fdd3d076cc2-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-d46vz\" (UID: \"697e2b89-9737-49e5-a9ad-0fdd3d076cc2\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-d46vz"
Jul 02 19:24:03.694825 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:03.694801    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m88zg\" (UniqueName: \"kubernetes.io/projected/697e2b89-9737-49e5-a9ad-0fdd3d076cc2-kube-api-access-m88zg\") pod \"kuadrant-console-plugin-66b5774985-d46vz\" (UID: \"697e2b89-9737-49e5-a9ad-0fdd3d076cc2\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-d46vz"
Jul 02 19:24:03.727807 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:03.727777    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-d46vz"
Jul 02 19:24:03.873087 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:03.873063    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-d46vz"]
Jul 02 19:24:03.874607 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:24:03.874575    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod697e2b89_9737_49e5_a9ad_0fdd3d076cc2.slice/crio-6f966844dc90112c9596a8bb012e1c988ee011584a13ede088e9b8bdd932692d WatchSource:0}: Error finding container 6f966844dc90112c9596a8bb012e1c988ee011584a13ede088e9b8bdd932692d: Status 404 returned error can't find the container with id 6f966844dc90112c9596a8bb012e1c988ee011584a13ede088e9b8bdd932692d
Jul 02 19:24:04.686602 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:04.686557    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-d46vz" event={"ID":"697e2b89-9737-49e5-a9ad-0fdd3d076cc2","Type":"ContainerStarted","Data":"6f966844dc90112c9596a8bb012e1c988ee011584a13ede088e9b8bdd932692d"}
Jul 02 19:24:05.645568 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:05.645528    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:24:05.745730 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:05.745701    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:24:11.670781 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:11.670743    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tf79h"
Jul 02 19:24:12.210145 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:12.210117    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:24:12.311379 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:12.311349    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:24:13.165392 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:13.165358    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kl9g2"]
Jul 02 19:24:13.174053 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:13.173962    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kl9g2"
Jul 02 19:24:13.177307 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:13.177284    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-jzbcg\""
Jul 02 19:24:13.187408 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:13.187346    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kl9g2"]
Jul 02 19:24:13.365071 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:13.365036    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b2b320ba-9525-4fd8-abe3-76dea40845cd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-kl9g2\" (UID: \"b2b320ba-9525-4fd8-abe3-76dea40845cd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kl9g2"
Jul 02 19:24:13.365071 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:13.365076    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drgst\" (UniqueName: \"kubernetes.io/projected/b2b320ba-9525-4fd8-abe3-76dea40845cd-kube-api-access-drgst\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-kl9g2\" (UID: \"b2b320ba-9525-4fd8-abe3-76dea40845cd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kl9g2"
Jul 02 19:24:13.465969 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:13.465901    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b2b320ba-9525-4fd8-abe3-76dea40845cd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-kl9g2\" (UID: \"b2b320ba-9525-4fd8-abe3-76dea40845cd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kl9g2"
Jul 02 19:24:13.466153 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:13.465976    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drgst\" (UniqueName: \"kubernetes.io/projected/b2b320ba-9525-4fd8-abe3-76dea40845cd-kube-api-access-drgst\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-kl9g2\" (UID: \"b2b320ba-9525-4fd8-abe3-76dea40845cd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kl9g2"
Jul 02 19:24:13.466319 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:13.466303    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b2b320ba-9525-4fd8-abe3-76dea40845cd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-kl9g2\" (UID: \"b2b320ba-9525-4fd8-abe3-76dea40845cd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kl9g2"
Jul 02 19:24:13.476093 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:13.476066    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-drgst\" (UniqueName: \"kubernetes.io/projected/b2b320ba-9525-4fd8-abe3-76dea40845cd-kube-api-access-drgst\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-kl9g2\" (UID: \"b2b320ba-9525-4fd8-abe3-76dea40845cd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kl9g2"
Jul 02 19:24:13.486754 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:13.486732    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kl9g2"
Jul 02 19:24:13.954567 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:13.954529    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kl9g2"]
Jul 02 19:24:13.969814 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:13.969778    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kl9g2"]
Jul 02 19:24:14.034617 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:14.034585    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mbxdb"]
Jul 02 19:24:14.049025 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:14.048977    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mbxdb"
Jul 02 19:24:14.052217 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:14.051577    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mbxdb"]
Jul 02 19:24:14.052950 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:14.052514    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-jmq4x\""
Jul 02 19:24:14.071631 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:14.071603    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6gwj\" (UniqueName: \"kubernetes.io/projected/814747b5-bdef-49ca-9961-91d7b57d8299-kube-api-access-z6gwj\") pod \"limitador-operator-controller-manager-859d7b78bd-mbxdb\" (UID: \"814747b5-bdef-49ca-9961-91d7b57d8299\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mbxdb"
Jul 02 19:24:14.172155 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:14.172115    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6gwj\" (UniqueName: \"kubernetes.io/projected/814747b5-bdef-49ca-9961-91d7b57d8299-kube-api-access-z6gwj\") pod \"limitador-operator-controller-manager-859d7b78bd-mbxdb\" (UID: \"814747b5-bdef-49ca-9961-91d7b57d8299\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mbxdb"
Jul 02 19:24:14.184973 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:14.184949    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6gwj\" (UniqueName: \"kubernetes.io/projected/814747b5-bdef-49ca-9961-91d7b57d8299-kube-api-access-z6gwj\") pod \"limitador-operator-controller-manager-859d7b78bd-mbxdb\" (UID: \"814747b5-bdef-49ca-9961-91d7b57d8299\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mbxdb"
Jul 02 19:24:14.365620 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:14.365534    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mbxdb"
Jul 02 19:24:17.826059 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:17.826026    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:24:17.966202 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:17.966168    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:24:18.422103 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:18.422059    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:24:18.484181 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:18.484142    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:24:21.828233 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:21.828205    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:24:21.929012 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:21.928976    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:24:25.265141 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:25.265110    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:24:25.363197 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:25.363165    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:24:27.201823 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:27.201805    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mbxdb"]
Jul 02 19:24:27.204078 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:24:27.204053    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod814747b5_bdef_49ca_9961_91d7b57d8299.slice/crio-02d4e62d5623730a9083c41d4e501a6c46d3c6c2b9f4220a158b22f6f414b5e5 WatchSource:0}: Error finding container 02d4e62d5623730a9083c41d4e501a6c46d3c6c2b9f4220a158b22f6f414b5e5: Status 404 returned error can't find the container with id 02d4e62d5623730a9083c41d4e501a6c46d3c6c2b9f4220a158b22f6f414b5e5
Jul 02 19:24:27.799179 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:27.799093    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mbxdb" event={"ID":"814747b5-bdef-49ca-9961-91d7b57d8299","Type":"ContainerStarted","Data":"02d4e62d5623730a9083c41d4e501a6c46d3c6c2b9f4220a158b22f6f414b5e5"}
Jul 02 19:24:27.800451 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:27.800425    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-d46vz" event={"ID":"697e2b89-9737-49e5-a9ad-0fdd3d076cc2","Type":"ContainerStarted","Data":"b68aeb938de7b5a61eb7fb7dd7b3cd3269eaee618af68e1bc6c3b62228a7d129"}
Jul 02 19:24:27.818234 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:27.818194    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-d46vz" podStartSLOduration=1.198016443 podStartE2EDuration="24.818177033s" totalImagesPullingTime="23.62016059s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:24:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:24:27.81751133 +0000 UTC m=+764.181581264" watchObservedRunningTime="2026-07-02 19:24:27.818177033 +0000 UTC m=+764.182246945"
Jul 02 19:24:29.946782 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:24:29.946748    2562 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-6fb7879bc9-kl9g2_kuadrant-system_b2b320ba-9525-4fd8-abe3-76dea40845cd_0(059b6aaee1681247c398ad9efeb2047f4672826ba30047f9fda1b836f697ebc3): error adding pod kuadrant-system_kuadrant-operator-controller-manager-6fb7879bc9-kl9g2 to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}"
Jul 02 19:24:29.947093 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:24:29.946824    2562 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-6fb7879bc9-kl9g2_kuadrant-system_b2b320ba-9525-4fd8-abe3-76dea40845cd_0(059b6aaee1681247c398ad9efeb2047f4672826ba30047f9fda1b836f697ebc3): error adding pod kuadrant-system_kuadrant-operator-controller-manager-6fb7879bc9-kl9g2 to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kl9g2"
Jul 02 19:24:30.814546 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:30.814516    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mbxdb" event={"ID":"814747b5-bdef-49ca-9961-91d7b57d8299","Type":"ContainerStarted","Data":"2730720deae8664fcac36be09269728a8a3222bc80f934cee4430ace823e8c6d"}
Jul 02 19:24:30.814761 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:30.814532    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kl9g2"
Jul 02 19:24:30.817378 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:24:30.817356    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-kl9g2\" is forbidden: User \"system:node:ip-10-0-143-38.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-38.ec2.internal' and this object" podUID="b2b320ba-9525-4fd8-abe3-76dea40845cd" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kl9g2"
Jul 02 19:24:30.830614 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:30.830583    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kl9g2"
Jul 02 19:24:30.834888 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:24:30.834857    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-kl9g2\" is forbidden: User \"system:node:ip-10-0-143-38.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-38.ec2.internal' and this object" podUID="b2b320ba-9525-4fd8-abe3-76dea40845cd" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kl9g2"
Jul 02 19:24:30.902125 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:30.902090    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:24:30.928608 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:30.928586    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b2b320ba-9525-4fd8-abe3-76dea40845cd-extensions-socket-volume\") pod \"b2b320ba-9525-4fd8-abe3-76dea40845cd\" (UID: \"b2b320ba-9525-4fd8-abe3-76dea40845cd\") "
Jul 02 19:24:30.928764 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:30.928679    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-drgst\" (UniqueName: \"kubernetes.io/projected/b2b320ba-9525-4fd8-abe3-76dea40845cd-kube-api-access-drgst\") pod \"b2b320ba-9525-4fd8-abe3-76dea40845cd\" (UID: \"b2b320ba-9525-4fd8-abe3-76dea40845cd\") "
Jul 02 19:24:30.928895 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:30.928871    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2b320ba-9525-4fd8-abe3-76dea40845cd-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b2b320ba-9525-4fd8-abe3-76dea40845cd" (UID: "b2b320ba-9525-4fd8-abe3-76dea40845cd"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:24:30.930799 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:30.930773    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2b320ba-9525-4fd8-abe3-76dea40845cd-kube-api-access-drgst" (OuterVolumeSpecName: "kube-api-access-drgst") pod "b2b320ba-9525-4fd8-abe3-76dea40845cd" (UID: "b2b320ba-9525-4fd8-abe3-76dea40845cd"). InnerVolumeSpecName "kube-api-access-drgst". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:24:31.002744 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:31.002669    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:24:31.029840 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:31.029809    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-drgst\" (UniqueName: \"kubernetes.io/projected/b2b320ba-9525-4fd8-abe3-76dea40845cd-kube-api-access-drgst\") on node \"ip-10-0-143-38.ec2.internal\" DevicePath \"\""
Jul 02 19:24:31.029840 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:31.029839    2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b2b320ba-9525-4fd8-abe3-76dea40845cd-extensions-socket-volume\") on node \"ip-10-0-143-38.ec2.internal\" DevicePath \"\""
Jul 02 19:24:31.819233 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:31.819205    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mbxdb"
Jul 02 19:24:31.819455 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:31.819272    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kl9g2"
Jul 02 19:24:31.821876 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:24:31.821848    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-kl9g2\" is forbidden: User \"system:node:ip-10-0-143-38.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-38.ec2.internal' and this object" podUID="b2b320ba-9525-4fd8-abe3-76dea40845cd" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kl9g2"
Jul 02 19:24:31.842981 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:31.842907    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mbxdb" podStartSLOduration=14.322561561 podStartE2EDuration="17.842892147s" totalImagesPullingTime="3.520330586s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:24:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:24:31.841116236 +0000 UTC m=+768.205186150" watchObservedRunningTime="2026-07-02 19:24:31.842892147 +0000 UTC m=+768.206962059"
Jul 02 19:24:31.843534 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:24:31.843506    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-kl9g2\" is forbidden: User \"system:node:ip-10-0-143-38.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-38.ec2.internal' and this object" podUID="b2b320ba-9525-4fd8-abe3-76dea40845cd" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kl9g2"
Jul 02 19:24:32.117788 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:32.117710    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2b320ba-9525-4fd8-abe3-76dea40845cd" path="/var/lib/kubelet/pods/b2b320ba-9525-4fd8-abe3-76dea40845cd/volumes"
Jul 02 19:24:42.799175 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:42.799121    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:24:42.825498 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:42.825475    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mbxdb"
Jul 02 19:24:43.103410 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:43.103329    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:24:44.175894 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:44.175864    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:24:57.322222 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:57.322186    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:24:57.420145 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:57.420114    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:24:57.482026 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:57.481992    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:24:58.121603 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:58.121568    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:24:58.176690 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:24:58.176656    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:25:16.330944 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:25:16.330892    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:25:28.090375 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:25:28.090338    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:25:28.189458 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:25:28.189431    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:25:32.190397 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:25:32.190355    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:25:32.291931 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:25:32.291890    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:25:34.117795 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:25:34.117756    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:25:34.218169 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:25:34.218134    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:25:34.315104 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:25:34.315074    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:25:34.375060 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:25:34.374978    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:25:37.167101 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:25:37.167067    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:25:37.258708 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:25:37.258658    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:26:08.688465 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:26:08.688436    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:26:09.146479 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:26:09.146445    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:26:09.348454 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:26:09.348410    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:26:09.700134 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:26:09.700102    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:26:09.800978 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:26:09.800944    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:26:09.878309 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:26:09.878280    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-nsqst"]
Jul 02 19:26:09.881730 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:26:09.881710    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-nsqst"
Jul 02 19:26:09.884629 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:26:09.884614    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-ck4fg\""
Jul 02 19:26:09.884712 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:26:09.884614    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 02 19:26:09.891516 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:26:09.891495    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-nsqst"]
Jul 02 19:26:09.954084 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:26:09.954061    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/000ad09b-8cf8-4ddf-a643-1743c1a8c0db-plugins-config-volume\") pod \"payload-pre-processing-7964457696-nsqst\" (UID: \"000ad09b-8cf8-4ddf-a643-1743c1a8c0db\") " pod="openshift-ingress/payload-pre-processing-7964457696-nsqst"
Jul 02 19:26:09.954229 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:26:09.954099    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5v7cq\" (UniqueName: \"kubernetes.io/projected/000ad09b-8cf8-4ddf-a643-1743c1a8c0db-kube-api-access-5v7cq\") pod \"payload-pre-processing-7964457696-nsqst\" (UID: \"000ad09b-8cf8-4ddf-a643-1743c1a8c0db\") " pod="openshift-ingress/payload-pre-processing-7964457696-nsqst"
Jul 02 19:26:10.055049 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:26:10.055011    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/000ad09b-8cf8-4ddf-a643-1743c1a8c0db-plugins-config-volume\") pod \"payload-pre-processing-7964457696-nsqst\" (UID: \"000ad09b-8cf8-4ddf-a643-1743c1a8c0db\") " pod="openshift-ingress/payload-pre-processing-7964457696-nsqst"
Jul 02 19:26:10.055220 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:26:10.055060    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5v7cq\" (UniqueName: \"kubernetes.io/projected/000ad09b-8cf8-4ddf-a643-1743c1a8c0db-kube-api-access-5v7cq\") pod \"payload-pre-processing-7964457696-nsqst\" (UID: \"000ad09b-8cf8-4ddf-a643-1743c1a8c0db\") " pod="openshift-ingress/payload-pre-processing-7964457696-nsqst"
Jul 02 19:26:10.055714 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:26:10.055695    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/000ad09b-8cf8-4ddf-a643-1743c1a8c0db-plugins-config-volume\") pod \"payload-pre-processing-7964457696-nsqst\" (UID: \"000ad09b-8cf8-4ddf-a643-1743c1a8c0db\") " pod="openshift-ingress/payload-pre-processing-7964457696-nsqst"
Jul 02 19:26:10.062800 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:26:10.062775    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5v7cq\" (UniqueName: \"kubernetes.io/projected/000ad09b-8cf8-4ddf-a643-1743c1a8c0db-kube-api-access-5v7cq\") pod \"payload-pre-processing-7964457696-nsqst\" (UID: \"000ad09b-8cf8-4ddf-a643-1743c1a8c0db\") " pod="openshift-ingress/payload-pre-processing-7964457696-nsqst"
Jul 02 19:26:10.192463 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:26:10.192413    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-nsqst"
Jul 02 19:26:10.321761 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:26:10.321732    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-nsqst"]
Jul 02 19:26:10.323771 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:26:10.323747    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod000ad09b_8cf8_4ddf_a643_1743c1a8c0db.slice/crio-06a238da213fcaf8708c1346a674b09b937a4463369fe53a6e6ebcf91c104e93 WatchSource:0}: Error finding container 06a238da213fcaf8708c1346a674b09b937a4463369fe53a6e6ebcf91c104e93: Status 404 returned error can't find the container with id 06a238da213fcaf8708c1346a674b09b937a4463369fe53a6e6ebcf91c104e93
Jul 02 19:26:11.227197 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:26:11.227150    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-nsqst" event={"ID":"000ad09b-8cf8-4ddf-a643-1743c1a8c0db","Type":"ContainerStarted","Data":"06a238da213fcaf8708c1346a674b09b937a4463369fe53a6e6ebcf91c104e93"}
Jul 02 19:26:12.233636 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:26:12.233549    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-nsqst" event={"ID":"000ad09b-8cf8-4ddf-a643-1743c1a8c0db","Type":"ContainerStarted","Data":"b54003b4afc657826cdf5687df5ca407e4f1f446e6d3264188dabda99115edc1"}
Jul 02 19:26:12.233636 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:26:12.233615    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-nsqst"
Jul 02 19:26:12.252656 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:26:12.252601    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-nsqst" podStartSLOduration=1.6195788 podStartE2EDuration="3.252586009s" totalImagesPullingTime="1.633007209s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:26:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:26:12.251686867 +0000 UTC m=+868.615756779" watchObservedRunningTime="2026-07-02 19:26:12.252586009 +0000 UTC m=+868.616655923"
Jul 02 19:26:19.074720 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:26:19.074689    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:26:19.156880 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:26:19.156849    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:26:23.239803 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:26:23.239775    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-nsqst"
Jul 02 19:26:43.178600 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:26:43.178496    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:26:44.017636 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:26:44.017606    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lgt7t_38beee50-e2c9-489e-91cb-f1bfad99fabf/ovn-acl-logging/0.log"
Jul 02 19:26:44.019206 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:26:44.019185    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lgt7t_38beee50-e2c9-489e-91cb-f1bfad99fabf/ovn-acl-logging/0.log"
Jul 02 19:26:44.303730 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:26:44.303622    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:26:49.004304 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:26:49.004265    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-6mp4g"]
Jul 02 19:26:49.008824 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:26:49.008803    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6mp4g"
Jul 02 19:26:49.011898 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:26:49.011878    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 02 19:26:49.012043 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:26:49.011879    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-kv7q5\""
Jul 02 19:26:49.012043 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:26:49.011946    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 02 19:26:49.013062 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:26:49.013047    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 02 19:26:49.016992 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:26:49.016969    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-6mp4g"]
Jul 02 19:26:49.030140 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:26:49.030096    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:26:49.094284 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:26:49.094245    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c92b556f-3fa5-4f8b-b682-eed2a5cfd3c6-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6mp4g\" (UID: \"c92b556f-3fa5-4f8b-b682-eed2a5cfd3c6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6mp4g"
Jul 02 19:26:49.094284 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:26:49.094287    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c92b556f-3fa5-4f8b-b682-eed2a5cfd3c6-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6mp4g\" (UID: \"c92b556f-3fa5-4f8b-b682-eed2a5cfd3c6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6mp4g"
Jul 02 19:26:49.094492 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:26:49.094339    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c92b556f-3fa5-4f8b-b682-eed2a5cfd3c6-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6mp4g\" (UID: \"c92b556f-3fa5-4f8b-b682-eed2a5cfd3c6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6mp4g"
Jul 02 19:26:49.094492 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:26:49.094358    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c92b556f-3fa5-4f8b-b682-eed2a5cfd3c6-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6mp4g\" (UID: \"c92b556f-3fa5-4f8b-b682-eed2a5cfd3c6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6mp4g"
Jul 02 19:26:49.094492 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:26:49.094378    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c92b556f-3fa5-4f8b-b682-eed2a5cfd3c6-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6mp4g\" (UID: \"c92b556f-3fa5-4f8b-b682-eed2a5cfd3c6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6mp4g"
Jul 02 19:26:49.094492 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:26:49.094401    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xd6s\" (UniqueName: \"kubernetes.io/projected/c92b556f-3fa5-4f8b-b682-eed2a5cfd3c6-kube-api-access-7xd6s\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6mp4g\" (UID: \"c92b556f-3fa5-4f8b-b682-eed2a5cfd3c6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6mp4g"
Jul 02 19:26:49.195082 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:26:49.195044    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c92b556f-3fa5-4f8b-b682-eed2a5cfd3c6-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6mp4g\" (UID: \"c92b556f-3fa5-4f8b-b682-eed2a5cfd3c6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6mp4g"
Jul 02 19:26:49.195082 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:26:49.195083    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c92b556f-3fa5-4f8b-b682-eed2a5cfd3c6-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6mp4g\" (UID: \"c92b556f-3fa5-4f8b-b682-eed2a5cfd3c6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6mp4g"
Jul 02 19:26:49.195462 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:26:49.195424    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c92b556f-3fa5-4f8b-b682-eed2a5cfd3c6-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6mp4g\" (UID: \"c92b556f-3fa5-4f8b-b682-eed2a5cfd3c6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6mp4g"
Jul 02 19:26:49.195462 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:26:49.195451    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c92b556f-3fa5-4f8b-b682-eed2a5cfd3c6-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6mp4g\" (UID: \"c92b556f-3fa5-4f8b-b682-eed2a5cfd3c6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6mp4g"
Jul 02 19:26:49.195661 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:26:49.195479    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c92b556f-3fa5-4f8b-b682-eed2a5cfd3c6-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6mp4g\" (UID: \"c92b556f-3fa5-4f8b-b682-eed2a5cfd3c6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6mp4g"
Jul 02 19:26:49.195661 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:26:49.195539    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c92b556f-3fa5-4f8b-b682-eed2a5cfd3c6-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6mp4g\" (UID: \"c92b556f-3fa5-4f8b-b682-eed2a5cfd3c6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6mp4g"
Jul 02 19:26:49.195661 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:26:49.195589    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c92b556f-3fa5-4f8b-b682-eed2a5cfd3c6-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6mp4g\" (UID: \"c92b556f-3fa5-4f8b-b682-eed2a5cfd3c6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6mp4g"
Jul 02 19:26:49.195808 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:26:49.195593    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xd6s\" (UniqueName: \"kubernetes.io/projected/c92b556f-3fa5-4f8b-b682-eed2a5cfd3c6-kube-api-access-7xd6s\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6mp4g\" (UID: \"c92b556f-3fa5-4f8b-b682-eed2a5cfd3c6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6mp4g"
Jul 02 19:26:49.196518 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:26:49.196311    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c92b556f-3fa5-4f8b-b682-eed2a5cfd3c6-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6mp4g\" (UID: \"c92b556f-3fa5-4f8b-b682-eed2a5cfd3c6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6mp4g"
Jul 02 19:26:49.204013 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:26:49.203976    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c92b556f-3fa5-4f8b-b682-eed2a5cfd3c6-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6mp4g\" (UID: \"c92b556f-3fa5-4f8b-b682-eed2a5cfd3c6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6mp4g"
Jul 02 19:26:49.205206 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:26:49.205186    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c92b556f-3fa5-4f8b-b682-eed2a5cfd3c6-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6mp4g\" (UID: \"c92b556f-3fa5-4f8b-b682-eed2a5cfd3c6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6mp4g"
Jul 02 19:26:49.206175 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:26:49.206155    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xd6s\" (UniqueName: \"kubernetes.io/projected/c92b556f-3fa5-4f8b-b682-eed2a5cfd3c6-kube-api-access-7xd6s\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6mp4g\" (UID: \"c92b556f-3fa5-4f8b-b682-eed2a5cfd3c6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6mp4g"
Jul 02 19:26:49.319165 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:26:49.319068    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6mp4g"
Jul 02 19:26:49.452319 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:26:49.452298    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-6mp4g"]
Jul 02 19:26:49.454471 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:26:49.454442    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc92b556f_3fa5_4f8b_b682_eed2a5cfd3c6.slice/crio-25c8ec2c46965555b69c4d031fb96cc34c61c4d5a94bc9415b2d6a73615b8b28 WatchSource:0}: Error finding container 25c8ec2c46965555b69c4d031fb96cc34c61c4d5a94bc9415b2d6a73615b8b28: Status 404 returned error can't find the container with id 25c8ec2c46965555b69c4d031fb96cc34c61c4d5a94bc9415b2d6a73615b8b28
Jul 02 19:26:50.401407 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:26:50.401364    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6mp4g" event={"ID":"c92b556f-3fa5-4f8b-b682-eed2a5cfd3c6","Type":"ContainerStarted","Data":"25c8ec2c46965555b69c4d031fb96cc34c61c4d5a94bc9415b2d6a73615b8b28"}
Jul 02 19:26:51.407109 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:26:51.407076    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6mp4g" event={"ID":"c92b556f-3fa5-4f8b-b682-eed2a5cfd3c6","Type":"ContainerStarted","Data":"37d50ebab31bb0a894402f527d38e0d71ada2c537d1ef1d2e3641a172fa925a5"}
Jul 02 19:26:51.428602 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:26:51.428554    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6mp4g" podStartSLOduration=2.391592873 podStartE2EDuration="3.428537886s" totalImagesPullingTime="1.036945013s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:26:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:26:51.427241424 +0000 UTC m=+907.791311336" watchObservedRunningTime="2026-07-02 19:26:51.428537886 +0000 UTC m=+907.792607799"
Jul 02 19:26:59.319879 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:26:59.319840    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6mp4g"
Jul 02 19:26:59.320325 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:26:59.320142    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6mp4g"
Jul 02 19:26:59.332693 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:26:59.332674    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6mp4g"
Jul 02 19:26:59.453202 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:26:59.453169    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6mp4g"
Jul 02 19:26:59.631370 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:26:59.631299    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:27:09.434190 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:27:09.434147    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:27:16.711751 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:27:16.711695    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-gkrj4"]
Jul 02 19:27:16.715230 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:27:16.715213    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gkrj4"
Jul 02 19:27:16.718156 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:27:16.718137    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 02 19:27:16.724770 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:27:16.724750    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-gkrj4"]
Jul 02 19:27:16.796355 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:27:16.796321    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:27:16.831420 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:27:16.831383    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bcf9348c-6bef-4076-b2da-32e22342f762-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gkrj4\" (UID: \"bcf9348c-6bef-4076-b2da-32e22342f762\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gkrj4"
Jul 02 19:27:16.831420 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:27:16.831421    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bcf9348c-6bef-4076-b2da-32e22342f762-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gkrj4\" (UID: \"bcf9348c-6bef-4076-b2da-32e22342f762\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gkrj4"
Jul 02 19:27:16.831606 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:27:16.831459    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bcf9348c-6bef-4076-b2da-32e22342f762-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gkrj4\" (UID: \"bcf9348c-6bef-4076-b2da-32e22342f762\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gkrj4"
Jul 02 19:27:16.831606 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:27:16.831519    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bcf9348c-6bef-4076-b2da-32e22342f762-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gkrj4\" (UID: \"bcf9348c-6bef-4076-b2da-32e22342f762\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gkrj4"
Jul 02 19:27:16.831606 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:27:16.831549    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76bgr\" (UniqueName: \"kubernetes.io/projected/bcf9348c-6bef-4076-b2da-32e22342f762-kube-api-access-76bgr\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gkrj4\" (UID: \"bcf9348c-6bef-4076-b2da-32e22342f762\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gkrj4"
Jul 02 19:27:16.831606 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:27:16.831587    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bcf9348c-6bef-4076-b2da-32e22342f762-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gkrj4\" (UID: \"bcf9348c-6bef-4076-b2da-32e22342f762\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gkrj4"
Jul 02 19:27:16.932466 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:27:16.932430    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bcf9348c-6bef-4076-b2da-32e22342f762-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gkrj4\" (UID: \"bcf9348c-6bef-4076-b2da-32e22342f762\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gkrj4"
Jul 02 19:27:16.932625 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:27:16.932544    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bcf9348c-6bef-4076-b2da-32e22342f762-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gkrj4\" (UID: \"bcf9348c-6bef-4076-b2da-32e22342f762\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gkrj4"
Jul 02 19:27:16.932625 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:27:16.932564    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bcf9348c-6bef-4076-b2da-32e22342f762-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gkrj4\" (UID: \"bcf9348c-6bef-4076-b2da-32e22342f762\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gkrj4"
Jul 02 19:27:16.932625 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:27:16.932595    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bcf9348c-6bef-4076-b2da-32e22342f762-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gkrj4\" (UID: \"bcf9348c-6bef-4076-b2da-32e22342f762\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gkrj4"
Jul 02 19:27:16.932625 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:27:16.932623    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bcf9348c-6bef-4076-b2da-32e22342f762-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gkrj4\" (UID: \"bcf9348c-6bef-4076-b2da-32e22342f762\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gkrj4"
Jul 02 19:27:16.932852 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:27:16.932641    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76bgr\" (UniqueName: \"kubernetes.io/projected/bcf9348c-6bef-4076-b2da-32e22342f762-kube-api-access-76bgr\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gkrj4\" (UID: \"bcf9348c-6bef-4076-b2da-32e22342f762\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gkrj4"
Jul 02 19:27:16.932852 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:27:16.932738    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bcf9348c-6bef-4076-b2da-32e22342f762-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gkrj4\" (UID: \"bcf9348c-6bef-4076-b2da-32e22342f762\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gkrj4"
Jul 02 19:27:16.933007 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:27:16.932946    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bcf9348c-6bef-4076-b2da-32e22342f762-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gkrj4\" (UID: \"bcf9348c-6bef-4076-b2da-32e22342f762\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gkrj4"
Jul 02 19:27:16.933103 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:27:16.933082    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bcf9348c-6bef-4076-b2da-32e22342f762-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gkrj4\" (UID: \"bcf9348c-6bef-4076-b2da-32e22342f762\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gkrj4"
Jul 02 19:27:16.934856 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:27:16.934840    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bcf9348c-6bef-4076-b2da-32e22342f762-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gkrj4\" (UID: \"bcf9348c-6bef-4076-b2da-32e22342f762\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gkrj4"
Jul 02 19:27:16.935172 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:27:16.935156    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bcf9348c-6bef-4076-b2da-32e22342f762-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gkrj4\" (UID: \"bcf9348c-6bef-4076-b2da-32e22342f762\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gkrj4"
Jul 02 19:27:16.940783 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:27:16.940766    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-76bgr\" (UniqueName: \"kubernetes.io/projected/bcf9348c-6bef-4076-b2da-32e22342f762-kube-api-access-76bgr\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gkrj4\" (UID: \"bcf9348c-6bef-4076-b2da-32e22342f762\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gkrj4"
Jul 02 19:27:17.025981 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:27:17.025878    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gkrj4"
Jul 02 19:27:17.160427 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:27:17.160401    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-gkrj4"]
Jul 02 19:27:17.163042 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:27:17.163016    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcf9348c_6bef_4076_b2da_32e22342f762.slice/crio-f20aac6a51016e49ff72ce4cda6ff7a73f1668815e80e1f7548d7b958d108c0c WatchSource:0}: Error finding container f20aac6a51016e49ff72ce4cda6ff7a73f1668815e80e1f7548d7b958d108c0c: Status 404 returned error can't find the container with id f20aac6a51016e49ff72ce4cda6ff7a73f1668815e80e1f7548d7b958d108c0c
Jul 02 19:27:17.164469 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:27:17.164450    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 19:27:17.522900 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:27:17.522861    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gkrj4" event={"ID":"bcf9348c-6bef-4076-b2da-32e22342f762","Type":"ContainerStarted","Data":"dd999f90edf80745ccbb68c96395f7e7f8f1683125040321cb72920115d5238f"}
Jul 02 19:27:17.523086 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:27:17.522943    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gkrj4" event={"ID":"bcf9348c-6bef-4076-b2da-32e22342f762","Type":"ContainerStarted","Data":"f20aac6a51016e49ff72ce4cda6ff7a73f1668815e80e1f7548d7b958d108c0c"}
Jul 02 19:27:17.542108 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:27:17.542063    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gkrj4" podStartSLOduration=1.310116908 podStartE2EDuration="1.542044583s" totalImagesPullingTime="231.927675ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:27:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:27:17.540168817 +0000 UTC m=+933.904238730" watchObservedRunningTime="2026-07-02 19:27:17.542044583 +0000 UTC m=+933.906114495"
Jul 02 19:27:27.026780 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:27:27.026726    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gkrj4"
Jul 02 19:27:27.027293 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:27:27.026803    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gkrj4"
Jul 02 19:27:27.039442 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:27:27.039416    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gkrj4"
Jul 02 19:27:27.576587 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:27:27.576561    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gkrj4"
Jul 02 19:27:33.002559 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:27:33.002516    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5c46x"]
Jul 02 19:27:33.007722 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:27:33.007703    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5c46x"
Jul 02 19:27:33.010698 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:27:33.010669    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 02 19:27:33.017819 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:27:33.017796    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5c46x"]
Jul 02 19:27:33.023990 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:27:33.023968    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:27:33.077958 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:27:33.077929    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9692d427-dbdd-43ac-bd9a-17a46639e871-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5c46x\" (UID: \"9692d427-dbdd-43ac-bd9a-17a46639e871\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5c46x"
Jul 02 19:27:33.077958 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:27:33.077961    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cf6m6\" (UniqueName: \"kubernetes.io/projected/9692d427-dbdd-43ac-bd9a-17a46639e871-kube-api-access-cf6m6\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5c46x\" (UID: \"9692d427-dbdd-43ac-bd9a-17a46639e871\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5c46x"
Jul 02 19:27:33.078184 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:27:33.077996    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9692d427-dbdd-43ac-bd9a-17a46639e871-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5c46x\" (UID: \"9692d427-dbdd-43ac-bd9a-17a46639e871\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5c46x"
Jul 02 19:27:33.078184 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:27:33.078077    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9692d427-dbdd-43ac-bd9a-17a46639e871-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5c46x\" (UID: \"9692d427-dbdd-43ac-bd9a-17a46639e871\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5c46x"
Jul 02 19:27:33.078184 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:27:33.078128    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9692d427-dbdd-43ac-bd9a-17a46639e871-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5c46x\" (UID: \"9692d427-dbdd-43ac-bd9a-17a46639e871\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5c46x"
Jul 02 19:27:33.078184 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:27:33.078148    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9692d427-dbdd-43ac-bd9a-17a46639e871-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5c46x\" (UID: \"9692d427-dbdd-43ac-bd9a-17a46639e871\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5c46x"
Jul 02 19:27:33.178862 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:27:33.178819    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9692d427-dbdd-43ac-bd9a-17a46639e871-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5c46x\" (UID: \"9692d427-dbdd-43ac-bd9a-17a46639e871\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5c46x"
Jul 02 19:27:33.178862 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:27:33.178865    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cf6m6\" (UniqueName: \"kubernetes.io/projected/9692d427-dbdd-43ac-bd9a-17a46639e871-kube-api-access-cf6m6\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5c46x\" (UID: \"9692d427-dbdd-43ac-bd9a-17a46639e871\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5c46x"
Jul 02 19:27:33.179122 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:27:33.178907    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9692d427-dbdd-43ac-bd9a-17a46639e871-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5c46x\" (UID: \"9692d427-dbdd-43ac-bd9a-17a46639e871\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5c46x"
Jul 02 19:27:33.179122 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:27:33.178989    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9692d427-dbdd-43ac-bd9a-17a46639e871-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5c46x\" (UID: \"9692d427-dbdd-43ac-bd9a-17a46639e871\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5c46x"
Jul 02 19:27:33.179122 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:27:33.179014    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9692d427-dbdd-43ac-bd9a-17a46639e871-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5c46x\" (UID: \"9692d427-dbdd-43ac-bd9a-17a46639e871\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5c46x"
Jul 02 19:27:33.179122 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:27:33.179041    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9692d427-dbdd-43ac-bd9a-17a46639e871-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5c46x\" (UID: \"9692d427-dbdd-43ac-bd9a-17a46639e871\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5c46x"
Jul 02 19:27:33.179360 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:27:33.179344    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9692d427-dbdd-43ac-bd9a-17a46639e871-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5c46x\" (UID: \"9692d427-dbdd-43ac-bd9a-17a46639e871\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5c46x"
Jul 02 19:27:33.179420 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:27:33.179402    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9692d427-dbdd-43ac-bd9a-17a46639e871-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5c46x\" (UID: \"9692d427-dbdd-43ac-bd9a-17a46639e871\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5c46x"
Jul 02 19:27:33.179474 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:27:33.179433    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9692d427-dbdd-43ac-bd9a-17a46639e871-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5c46x\" (UID: \"9692d427-dbdd-43ac-bd9a-17a46639e871\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5c46x"
Jul 02 19:27:33.181218 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:27:33.181194    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9692d427-dbdd-43ac-bd9a-17a46639e871-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5c46x\" (UID: \"9692d427-dbdd-43ac-bd9a-17a46639e871\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5c46x"
Jul 02 19:27:33.181648 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:27:33.181628    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9692d427-dbdd-43ac-bd9a-17a46639e871-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5c46x\" (UID: \"9692d427-dbdd-43ac-bd9a-17a46639e871\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5c46x"
Jul 02 19:27:33.188115 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:27:33.188090    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cf6m6\" (UniqueName: \"kubernetes.io/projected/9692d427-dbdd-43ac-bd9a-17a46639e871-kube-api-access-cf6m6\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5c46x\" (UID: \"9692d427-dbdd-43ac-bd9a-17a46639e871\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5c46x"
Jul 02 19:27:33.317523 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:27:33.317436    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5c46x"
Jul 02 19:27:33.450174 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:27:33.450146    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5c46x"]
Jul 02 19:27:33.451967 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:27:33.451940    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9692d427_dbdd_43ac_bd9a_17a46639e871.slice/crio-0b431872b869ba56704da763aca44a39425e0055de8e1e02a174bc237be3a47d WatchSource:0}: Error finding container 0b431872b869ba56704da763aca44a39425e0055de8e1e02a174bc237be3a47d: Status 404 returned error can't find the container with id 0b431872b869ba56704da763aca44a39425e0055de8e1e02a174bc237be3a47d
Jul 02 19:27:33.593697 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:27:33.593605    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5c46x" event={"ID":"9692d427-dbdd-43ac-bd9a-17a46639e871","Type":"ContainerStarted","Data":"0b431872b869ba56704da763aca44a39425e0055de8e1e02a174bc237be3a47d"}
Jul 02 19:27:34.599457 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:27:34.599416    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5c46x" event={"ID":"9692d427-dbdd-43ac-bd9a-17a46639e871","Type":"ContainerStarted","Data":"5fe5d07af6fe4b519507ab8718a9b04a8f5b6ad821e5cf1d621c37d169704f11"}
Jul 02 19:27:34.620058 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:27:34.620004    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5c46x" podStartSLOduration=2.425344383 podStartE2EDuration="2.619989529s" totalImagesPullingTime="194.645146ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:27:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:27:34.617883094 +0000 UTC m=+950.981953008" watchObservedRunningTime="2026-07-02 19:27:34.619989529 +0000 UTC m=+950.984059441"
Jul 02 19:27:43.318280 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:27:43.318239    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5c46x"
Jul 02 19:27:43.318689 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:27:43.318296    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5c46x"
Jul 02 19:27:43.331123 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:27:43.331096    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5c46x"
Jul 02 19:27:43.642365 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:27:43.642281    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:27:43.650867 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:27:43.650844    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5c46x"
Jul 02 19:28:02.509266 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:28:02.509232    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:28:02.611548 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:28:02.611509    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:28:07.178195 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:28:07.178101    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:28:07.239088 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:28:07.239055    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:28:22.434048 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:28:22.434013    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:28:22.532454 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:28:22.532419    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:28:23.290594 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:28:23.290561    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:28:23.529974 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:28:23.529944    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:28:23.628696 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:28:23.628620    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:28:47.417131 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:28:47.417098    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:28:47.473554 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:28:47.473519    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:29:34.004713 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:29:34.004669    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:29:35.238748 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:29:35.238667    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:30:11.670744 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:30:11.670712    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:30:11.769877 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:30:11.769837    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:30:11.966263 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:30:11.966234    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:30:17.695690 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:30:17.695640    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:30:17.800310 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:30:17.800284    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:30:17.908293 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:30:17.908260    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:30:18.100658 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:30:18.100631    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:30:23.730722 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:30:23.730687    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:30:23.832906 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:30:23.832879    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:31:44.043381 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:31:44.043349    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lgt7t_38beee50-e2c9-489e-91cb-f1bfad99fabf/ovn-acl-logging/0.log"
Jul 02 19:31:44.046187 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:31:44.046168    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lgt7t_38beee50-e2c9-489e-91cb-f1bfad99fabf/ovn-acl-logging/0.log"
Jul 02 19:35:31.554505 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:35:31.554471    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:35:32.692080 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:35:32.692043    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:36:36.167626 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:36:36.167596    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:36:44.069540 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:36:44.069515    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lgt7t_38beee50-e2c9-489e-91cb-f1bfad99fabf/ovn-acl-logging/0.log"
Jul 02 19:36:44.079166 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:36:44.079134    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lgt7t_38beee50-e2c9-489e-91cb-f1bfad99fabf/ovn-acl-logging/0.log"
Jul 02 19:36:53.515194 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:36:53.515159    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:37:48.489480 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:37:48.489448    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:37:48.591542 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:37:48.591511    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:41:10.510872 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:41:10.510836    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:41:18.199644 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:41:18.199606    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:41:26.432212 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:41:26.432176    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:41:31.512020 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:41:31.511986    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:41:34.395848 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:41:34.395819    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:41:34.486695 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:41:34.486656    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:41:34.964975 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:41:34.964938    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:41:40.610741 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:41:40.610708    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:41:40.714607 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:41:40.714577    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:41:40.937172 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:41:40.937062    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:41:41.037186 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:41:41.037128    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:41:42.087449 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:41:42.087397    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:41:42.246670 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:41:42.246635    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:41:42.394945 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:41:42.394840    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:41:42.486768 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:41:42.486733    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:41:42.790190 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:41:42.790163    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:41:42.891137 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:41:42.891108    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:41:44.102044 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:41:44.102014    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lgt7t_38beee50-e2c9-489e-91cb-f1bfad99fabf/ovn-acl-logging/0.log"
Jul 02 19:41:44.110328 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:41:44.110308    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lgt7t_38beee50-e2c9-489e-91cb-f1bfad99fabf/ovn-acl-logging/0.log"
Jul 02 19:41:44.506044 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:41:44.506017    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:41:45.978102 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:41:45.978074    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:41:47.085381 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:41:47.085347    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:41:47.265486 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:41:47.265459    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:41:47.380628 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:41:47.380548    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:41:47.439893 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:41:47.439862    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:41:48.931942 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:41:48.931893    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:41:52.964010 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:41:52.963960    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:41:53.065257 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:41:53.065224    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:41:53.268762 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:41:53.268678    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:41:53.368856 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:41:53.368822    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:41:54.472649 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:41:54.472618    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:41:54.582206 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:41:54.582176    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:41:54.679227 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:41:54.679191    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:41:55.021640 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:41:55.021607    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:41:55.126461 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:41:55.126431    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:41:56.388436 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:41:56.388409    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:41:59.486878 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:41:59.486848    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:41:59.777662 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:41:59.777549    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:42:05.783992 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:42:05.783959    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:42:05.886101 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:42:05.886052    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:42:07.385156 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:42:07.385122    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:42:11.774700 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:42:11.774652    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:42:11.873037 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:42:11.873007    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:42:11.961095 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:42:11.961066    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:42:13.058112 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:42:13.058078    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:42:13.137853 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:42:13.137804    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:42:13.202185 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:42:13.202155    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:42:13.303560 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:42:13.303523    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:42:13.747116 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:42:13.747077    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:42:13.848104 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:42:13.848069    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:42:15.232862 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:42:15.232812    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:42:17.599233 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:42:17.599199    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:42:17.728637 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:42:17.728605    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:42:17.829499 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:42:17.829457    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:42:17.963803 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:42:17.963763    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:42:19.614758 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:42:19.614722    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:42:23.779664 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:42:23.779631    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:42:23.893119 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:42:23.893087    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:42:24.259866 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:42:24.259832    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:42:24.353983 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:42:24.353948    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:42:24.453879 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:42:24.453844    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:42:25.832234 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:42:25.832202    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:42:31.580751 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:42:31.580716    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:42:31.688849 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:42:31.688813    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:42:31.780726 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:42:31.780693    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:42:31.882642 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:42:31.882551    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:42:32.271373 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:42:32.271340    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:42:58.202490 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:42:58.202452    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:43:04.264106 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:43:04.264072    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:43:04.483284 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:43:04.483251    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:43:04.583826 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:43:04.583750    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:43:20.364546 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:43:20.364512    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:43:26.049993 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:43:26.049958    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:43:26.114573 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:43:26.114544    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:43:26.197096 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:43:26.197067    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:43:26.324639 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:43:26.324562    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:43:36.810824 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:43:36.810785    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:43:37.717450 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:43:37.717385    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:43:43.274250 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:43:43.274217    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:43:43.338267 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:43:43.338234    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:43:43.421786 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:43:43.421752    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:43:43.520410 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:43:43.520378    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:43:43.620624 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:43:43.620548    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:43:44.337438 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:43:44.337404    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:43:44.431158 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:43:44.431108    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:43:44.531058 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:43:44.531025    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:43:46.136488 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:43:46.136454    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:43:51.950250 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:43:51.950219    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:43:52.011671 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:43:52.011638    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:43:52.608642 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:43:52.608615    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:43:58.520972 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:43:58.520937    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:43:58.622617 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:43:58.622582    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:43:58.818530 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:43:58.818455    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:43:59.064479 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:43:59.064447    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:43:59.281624 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:43:59.281593    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:44:02.167192 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:44:02.167132    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:44:02.260133 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:44:02.260097    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:44:02.323127 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:44:02.323090    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:44:02.454039 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:44:02.454010    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:44:02.807696 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:44:02.807611    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:44:02.907664 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:44:02.907634    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:44:06.644250 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:44:06.644204    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:44:07.310620 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:44:07.310584    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:44:07.406257 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:44:07.406223    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:44:07.774332 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:44:07.774301    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:44:13.682592 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:44:13.682556    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:44:13.744465 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:44:13.744438    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:44:14.094936 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:44:14.094879    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:44:14.392674 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:44:14.392597    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:44:14.491836 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:44:14.491806    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:44:20.426836 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:44:20.426803    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:44:20.485523 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:44:20.485486    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:44:20.663085 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:44:20.663048    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:44:20.892505 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:44:20.892469    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:44:21.018126 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:44:21.018095    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:44:21.114362 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:44:21.114334    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:44:21.221789 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:44:21.221757    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:44:26.946584 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:44:26.946549    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:44:27.054461 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:44:27.054431    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:44:27.147454 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:44:27.147414    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:44:27.304990 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:44:27.304952    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:44:32.868057 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:44:32.868021    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:44:32.931821 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:44:32.931791    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:44:39.227901 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:44:39.227826    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:44:39.528004 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:44:39.527907    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:44:39.735902 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:44:39.735868    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:44:42.361324 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:44:42.361291    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:44:42.437572 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:44:42.437535    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:44:42.524457 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:44:42.524426    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:44:42.622944 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:44:42.622853    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:44:42.913776 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:44:42.913694    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:44:43.011232 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:44:43.011199    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:44:46.846278 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:44:46.846244    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:44:56.301278 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:44:56.301243    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-363f6558/e2e-lifecycle-model-363f6558-kserve-846599cddc-dlbzx"]
Jul 02 19:44:56.304435 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:44:56.304420    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-363f6558/e2e-lifecycle-model-363f6558-kserve-846599cddc-dlbzx"
Jul 02 19:44:56.308752 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:44:56.308732    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-363f6558\"/\"kube-root-ca.crt\""
Jul 02 19:44:56.308894 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:44:56.308818    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-363f6558\"/\"e2e-lifecycle-model-363f6558-kserve-self-signed-certs\""
Jul 02 19:44:56.308894 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:44:56.308853    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-363f6558\"/\"openshift-service-ca.crt\""
Jul 02 19:44:56.308894 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:44:56.308872    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-363f6558\"/\"default-dockercfg-r4jzv\""
Jul 02 19:44:56.313368 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:44:56.313349    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-363f6558/e2e-lifecycle-model-363f6558-kserve-846599cddc-dlbzx"]
Jul 02 19:44:56.356846 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:44:56.356814    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/378cbb8e-18f0-46e5-afb1-18061ba58a62-home\") pod \"e2e-lifecycle-model-363f6558-kserve-846599cddc-dlbzx\" (UID: \"378cbb8e-18f0-46e5-afb1-18061ba58a62\") " pod="ai-tenant-e2e-mt-363f6558/e2e-lifecycle-model-363f6558-kserve-846599cddc-dlbzx"
Jul 02 19:44:56.357020 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:44:56.356855    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/378cbb8e-18f0-46e5-afb1-18061ba58a62-dshm\") pod \"e2e-lifecycle-model-363f6558-kserve-846599cddc-dlbzx\" (UID: \"378cbb8e-18f0-46e5-afb1-18061ba58a62\") " pod="ai-tenant-e2e-mt-363f6558/e2e-lifecycle-model-363f6558-kserve-846599cddc-dlbzx"
Jul 02 19:44:56.357020 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:44:56.356870    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/378cbb8e-18f0-46e5-afb1-18061ba58a62-model-cache\") pod \"e2e-lifecycle-model-363f6558-kserve-846599cddc-dlbzx\" (UID: \"378cbb8e-18f0-46e5-afb1-18061ba58a62\") " pod="ai-tenant-e2e-mt-363f6558/e2e-lifecycle-model-363f6558-kserve-846599cddc-dlbzx"
Jul 02 19:44:56.357020 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:44:56.356952    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/378cbb8e-18f0-46e5-afb1-18061ba58a62-tls-certs\") pod \"e2e-lifecycle-model-363f6558-kserve-846599cddc-dlbzx\" (UID: \"378cbb8e-18f0-46e5-afb1-18061ba58a62\") " pod="ai-tenant-e2e-mt-363f6558/e2e-lifecycle-model-363f6558-kserve-846599cddc-dlbzx"
Jul 02 19:44:56.357020 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:44:56.356985    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkd5j\" (UniqueName: \"kubernetes.io/projected/378cbb8e-18f0-46e5-afb1-18061ba58a62-kube-api-access-gkd5j\") pod \"e2e-lifecycle-model-363f6558-kserve-846599cddc-dlbzx\" (UID: \"378cbb8e-18f0-46e5-afb1-18061ba58a62\") " pod="ai-tenant-e2e-mt-363f6558/e2e-lifecycle-model-363f6558-kserve-846599cddc-dlbzx"
Jul 02 19:44:56.357020 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:44:56.357005    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/378cbb8e-18f0-46e5-afb1-18061ba58a62-tmp-dir\") pod \"e2e-lifecycle-model-363f6558-kserve-846599cddc-dlbzx\" (UID: \"378cbb8e-18f0-46e5-afb1-18061ba58a62\") " pod="ai-tenant-e2e-mt-363f6558/e2e-lifecycle-model-363f6558-kserve-846599cddc-dlbzx"
Jul 02 19:44:56.397184 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:44:56.397143    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:44:56.457519 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:44:56.457474    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/378cbb8e-18f0-46e5-afb1-18061ba58a62-home\") pod \"e2e-lifecycle-model-363f6558-kserve-846599cddc-dlbzx\" (UID: \"378cbb8e-18f0-46e5-afb1-18061ba58a62\") " pod="ai-tenant-e2e-mt-363f6558/e2e-lifecycle-model-363f6558-kserve-846599cddc-dlbzx"
Jul 02 19:44:56.457519 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:44:56.457521    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/378cbb8e-18f0-46e5-afb1-18061ba58a62-dshm\") pod \"e2e-lifecycle-model-363f6558-kserve-846599cddc-dlbzx\" (UID: \"378cbb8e-18f0-46e5-afb1-18061ba58a62\") " pod="ai-tenant-e2e-mt-363f6558/e2e-lifecycle-model-363f6558-kserve-846599cddc-dlbzx"
Jul 02 19:44:56.457770 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:44:56.457541    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/378cbb8e-18f0-46e5-afb1-18061ba58a62-model-cache\") pod \"e2e-lifecycle-model-363f6558-kserve-846599cddc-dlbzx\" (UID: \"378cbb8e-18f0-46e5-afb1-18061ba58a62\") " pod="ai-tenant-e2e-mt-363f6558/e2e-lifecycle-model-363f6558-kserve-846599cddc-dlbzx"
Jul 02 19:44:56.457770 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:44:56.457572    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/378cbb8e-18f0-46e5-afb1-18061ba58a62-tls-certs\") pod \"e2e-lifecycle-model-363f6558-kserve-846599cddc-dlbzx\" (UID: \"378cbb8e-18f0-46e5-afb1-18061ba58a62\") " pod="ai-tenant-e2e-mt-363f6558/e2e-lifecycle-model-363f6558-kserve-846599cddc-dlbzx"
Jul 02 19:44:56.457770 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:44:56.457588    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkd5j\" (UniqueName: \"kubernetes.io/projected/378cbb8e-18f0-46e5-afb1-18061ba58a62-kube-api-access-gkd5j\") pod \"e2e-lifecycle-model-363f6558-kserve-846599cddc-dlbzx\" (UID: \"378cbb8e-18f0-46e5-afb1-18061ba58a62\") " pod="ai-tenant-e2e-mt-363f6558/e2e-lifecycle-model-363f6558-kserve-846599cddc-dlbzx"
Jul 02 19:44:56.457770 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:44:56.457606    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/378cbb8e-18f0-46e5-afb1-18061ba58a62-tmp-dir\") pod \"e2e-lifecycle-model-363f6558-kserve-846599cddc-dlbzx\" (UID: \"378cbb8e-18f0-46e5-afb1-18061ba58a62\") " pod="ai-tenant-e2e-mt-363f6558/e2e-lifecycle-model-363f6558-kserve-846599cddc-dlbzx"
Jul 02 19:44:56.458068 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:44:56.458048    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/378cbb8e-18f0-46e5-afb1-18061ba58a62-tmp-dir\") pod \"e2e-lifecycle-model-363f6558-kserve-846599cddc-dlbzx\" (UID: \"378cbb8e-18f0-46e5-afb1-18061ba58a62\") " pod="ai-tenant-e2e-mt-363f6558/e2e-lifecycle-model-363f6558-kserve-846599cddc-dlbzx"
Jul 02 19:44:56.458131 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:44:56.458072    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/378cbb8e-18f0-46e5-afb1-18061ba58a62-home\") pod \"e2e-lifecycle-model-363f6558-kserve-846599cddc-dlbzx\" (UID: \"378cbb8e-18f0-46e5-afb1-18061ba58a62\") " pod="ai-tenant-e2e-mt-363f6558/e2e-lifecycle-model-363f6558-kserve-846599cddc-dlbzx"
Jul 02 19:44:56.458131 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:44:56.458107    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/378cbb8e-18f0-46e5-afb1-18061ba58a62-model-cache\") pod \"e2e-lifecycle-model-363f6558-kserve-846599cddc-dlbzx\" (UID: \"378cbb8e-18f0-46e5-afb1-18061ba58a62\") " pod="ai-tenant-e2e-mt-363f6558/e2e-lifecycle-model-363f6558-kserve-846599cddc-dlbzx"
Jul 02 19:44:56.459864 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:44:56.459843    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/378cbb8e-18f0-46e5-afb1-18061ba58a62-dshm\") pod \"e2e-lifecycle-model-363f6558-kserve-846599cddc-dlbzx\" (UID: \"378cbb8e-18f0-46e5-afb1-18061ba58a62\") " pod="ai-tenant-e2e-mt-363f6558/e2e-lifecycle-model-363f6558-kserve-846599cddc-dlbzx"
Jul 02 19:44:56.460315 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:44:56.460294    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/378cbb8e-18f0-46e5-afb1-18061ba58a62-tls-certs\") pod \"e2e-lifecycle-model-363f6558-kserve-846599cddc-dlbzx\" (UID: \"378cbb8e-18f0-46e5-afb1-18061ba58a62\") " pod="ai-tenant-e2e-mt-363f6558/e2e-lifecycle-model-363f6558-kserve-846599cddc-dlbzx"
Jul 02 19:44:56.467907 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:44:56.467874    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkd5j\" (UniqueName: \"kubernetes.io/projected/378cbb8e-18f0-46e5-afb1-18061ba58a62-kube-api-access-gkd5j\") pod \"e2e-lifecycle-model-363f6558-kserve-846599cddc-dlbzx\" (UID: \"378cbb8e-18f0-46e5-afb1-18061ba58a62\") " pod="ai-tenant-e2e-mt-363f6558/e2e-lifecycle-model-363f6558-kserve-846599cddc-dlbzx"
Jul 02 19:44:56.613971 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:44:56.613847    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-363f6558/e2e-lifecycle-model-363f6558-kserve-846599cddc-dlbzx"
Jul 02 19:44:56.746539 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:44:56.746499    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-363f6558/e2e-lifecycle-model-363f6558-kserve-846599cddc-dlbzx"]
Jul 02 19:44:56.749560 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:44:56.749527    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod378cbb8e_18f0_46e5_afb1_18061ba58a62.slice/crio-7f39580486fd20dee2b91ba81c15715a4bad18617108d221518e058f58547f1f WatchSource:0}: Error finding container 7f39580486fd20dee2b91ba81c15715a4bad18617108d221518e058f58547f1f: Status 404 returned error can't find the container with id 7f39580486fd20dee2b91ba81c15715a4bad18617108d221518e058f58547f1f
Jul 02 19:44:57.203781 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:44:57.203736    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-363f6558/e2e-lifecycle-model-363f6558-kserve-846599cddc-dlbzx" event={"ID":"378cbb8e-18f0-46e5-afb1-18061ba58a62","Type":"ContainerStarted","Data":"450f50617889b1b8e224f845b30fb600c60ec7a7f9897f4bb81f2dc97a84deee"}
Jul 02 19:44:57.203781 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:44:57.203781    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-363f6558/e2e-lifecycle-model-363f6558-kserve-846599cddc-dlbzx" event={"ID":"378cbb8e-18f0-46e5-afb1-18061ba58a62","Type":"ContainerStarted","Data":"7f39580486fd20dee2b91ba81c15715a4bad18617108d221518e058f58547f1f"}
Jul 02 19:44:57.222720 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:44:57.222674    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-363f6558/e2e-lifecycle-model-363f6558-kserve-846599cddc-dlbzx" podStartSLOduration=1.222657701 podStartE2EDuration="1.222657701s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:44:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:44:57.219798062 +0000 UTC m=+1993.583867999" watchObservedRunningTime="2026-07-02 19:44:57.222657701 +0000 UTC m=+1993.586727614"
Jul 02 19:44:58.535589 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:44:58.535553    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:44:58.636908 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:44:58.636876    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:45:03.635598 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:45:03.635553    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:45:04.025015 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:45:04.024977    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:45:06.614153 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:45:06.614114    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-363f6558/e2e-lifecycle-model-363f6558-kserve-846599cddc-dlbzx"
Jul 02 19:45:06.614569 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:45:06.614168    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-363f6558/e2e-lifecycle-model-363f6558-kserve-846599cddc-dlbzx"
Jul 02 19:45:06.626545 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:45:06.626526    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-363f6558/e2e-lifecycle-model-363f6558-kserve-846599cddc-dlbzx"
Jul 02 19:45:07.260050 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:45:07.260025    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-363f6558/e2e-lifecycle-model-363f6558-kserve-846599cddc-dlbzx"
Jul 02 19:45:09.850680 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:45:09.850648    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:45:14.040032 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:45:14.039994    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:45:14.335669 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:45:14.335602    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:45:20.119069 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:45:20.119033    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:45:22.524491 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:45:22.524457    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:45:25.094950 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:45:25.094900    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-363f6558/e2e-lifecycle-model-363f6558-kserve-846599cddc-dlbzx"]
Jul 02 19:45:25.190135 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:45:25.190107    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:45:40.115719 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:45:40.115667    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-363f6558/e2e-lifecycle-model-363f6558-kserve-846599cddc-dlbzx" podUID="378cbb8e-18f0-46e5-afb1-18061ba58a62" containerName="main" containerID="cri-o://450f50617889b1b8e224f845b30fb600c60ec7a7f9897f4bb81f2dc97a84deee" gracePeriod=45
Jul 02 19:45:40.372750 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:45:40.372690    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-363f6558/e2e-lifecycle-model-363f6558-kserve-846599cddc-dlbzx"
Jul 02 19:45:40.395384 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:45:40.395348    2562 generic.go:356] "Generic (PLEG): container finished" podID="378cbb8e-18f0-46e5-afb1-18061ba58a62" containerID="450f50617889b1b8e224f845b30fb600c60ec7a7f9897f4bb81f2dc97a84deee" exitCode=0
Jul 02 19:45:40.395562 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:45:40.395399    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-363f6558/e2e-lifecycle-model-363f6558-kserve-846599cddc-dlbzx"
Jul 02 19:45:40.395562 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:45:40.395487    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-363f6558/e2e-lifecycle-model-363f6558-kserve-846599cddc-dlbzx" event={"ID":"378cbb8e-18f0-46e5-afb1-18061ba58a62","Type":"ContainerDied","Data":"450f50617889b1b8e224f845b30fb600c60ec7a7f9897f4bb81f2dc97a84deee"}
Jul 02 19:45:40.395562 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:45:40.395522    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-363f6558/e2e-lifecycle-model-363f6558-kserve-846599cddc-dlbzx" event={"ID":"378cbb8e-18f0-46e5-afb1-18061ba58a62","Type":"ContainerDied","Data":"7f39580486fd20dee2b91ba81c15715a4bad18617108d221518e058f58547f1f"}
Jul 02 19:45:40.395562 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:45:40.395546    2562 scope.go:117] "RemoveContainer" containerID="450f50617889b1b8e224f845b30fb600c60ec7a7f9897f4bb81f2dc97a84deee"
Jul 02 19:45:40.404258 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:45:40.404240    2562 scope.go:117] "RemoveContainer" containerID="450f50617889b1b8e224f845b30fb600c60ec7a7f9897f4bb81f2dc97a84deee"
Jul 02 19:45:40.404552 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:45:40.404533    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"450f50617889b1b8e224f845b30fb600c60ec7a7f9897f4bb81f2dc97a84deee\": container with ID starting with 450f50617889b1b8e224f845b30fb600c60ec7a7f9897f4bb81f2dc97a84deee not found: ID does not exist" containerID="450f50617889b1b8e224f845b30fb600c60ec7a7f9897f4bb81f2dc97a84deee"
Jul 02 19:45:40.404619 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:45:40.404560    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"450f50617889b1b8e224f845b30fb600c60ec7a7f9897f4bb81f2dc97a84deee"} err="failed to get container status \"450f50617889b1b8e224f845b30fb600c60ec7a7f9897f4bb81f2dc97a84deee\": rpc error: code = NotFound desc = could not find container \"450f50617889b1b8e224f845b30fb600c60ec7a7f9897f4bb81f2dc97a84deee\": container with ID starting with 450f50617889b1b8e224f845b30fb600c60ec7a7f9897f4bb81f2dc97a84deee not found: ID does not exist"
Jul 02 19:45:40.450139 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:45:40.450109    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/378cbb8e-18f0-46e5-afb1-18061ba58a62-model-cache\") pod \"378cbb8e-18f0-46e5-afb1-18061ba58a62\" (UID: \"378cbb8e-18f0-46e5-afb1-18061ba58a62\") "
Jul 02 19:45:40.450305 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:45:40.450151    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/378cbb8e-18f0-46e5-afb1-18061ba58a62-dshm\") pod \"378cbb8e-18f0-46e5-afb1-18061ba58a62\" (UID: \"378cbb8e-18f0-46e5-afb1-18061ba58a62\") "
Jul 02 19:45:40.450305 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:45:40.450180    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/378cbb8e-18f0-46e5-afb1-18061ba58a62-home\") pod \"378cbb8e-18f0-46e5-afb1-18061ba58a62\" (UID: \"378cbb8e-18f0-46e5-afb1-18061ba58a62\") "
Jul 02 19:45:40.450305 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:45:40.450200    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gkd5j\" (UniqueName: \"kubernetes.io/projected/378cbb8e-18f0-46e5-afb1-18061ba58a62-kube-api-access-gkd5j\") pod \"378cbb8e-18f0-46e5-afb1-18061ba58a62\" (UID: \"378cbb8e-18f0-46e5-afb1-18061ba58a62\") "
Jul 02 19:45:40.450305 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:45:40.450239    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/378cbb8e-18f0-46e5-afb1-18061ba58a62-tls-certs\") pod \"378cbb8e-18f0-46e5-afb1-18061ba58a62\" (UID: \"378cbb8e-18f0-46e5-afb1-18061ba58a62\") "
Jul 02 19:45:40.450305 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:45:40.450267    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/378cbb8e-18f0-46e5-afb1-18061ba58a62-tmp-dir\") pod \"378cbb8e-18f0-46e5-afb1-18061ba58a62\" (UID: \"378cbb8e-18f0-46e5-afb1-18061ba58a62\") "
Jul 02 19:45:40.450560 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:45:40.450435    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/378cbb8e-18f0-46e5-afb1-18061ba58a62-home" (OuterVolumeSpecName: "home") pod "378cbb8e-18f0-46e5-afb1-18061ba58a62" (UID: "378cbb8e-18f0-46e5-afb1-18061ba58a62"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:45:40.450560 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:45:40.450455    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/378cbb8e-18f0-46e5-afb1-18061ba58a62-model-cache" (OuterVolumeSpecName: "model-cache") pod "378cbb8e-18f0-46e5-afb1-18061ba58a62" (UID: "378cbb8e-18f0-46e5-afb1-18061ba58a62"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:45:40.450660 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:45:40.450594    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/378cbb8e-18f0-46e5-afb1-18061ba58a62-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "378cbb8e-18f0-46e5-afb1-18061ba58a62" (UID: "378cbb8e-18f0-46e5-afb1-18061ba58a62"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:45:40.450660 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:45:40.450618    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/378cbb8e-18f0-46e5-afb1-18061ba58a62-model-cache\") on node \"ip-10-0-143-38.ec2.internal\" DevicePath \"\""
Jul 02 19:45:40.450660 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:45:40.450636    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/378cbb8e-18f0-46e5-afb1-18061ba58a62-home\") on node \"ip-10-0-143-38.ec2.internal\" DevicePath \"\""
Jul 02 19:45:40.452496 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:45:40.452467    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/378cbb8e-18f0-46e5-afb1-18061ba58a62-kube-api-access-gkd5j" (OuterVolumeSpecName: "kube-api-access-gkd5j") pod "378cbb8e-18f0-46e5-afb1-18061ba58a62" (UID: "378cbb8e-18f0-46e5-afb1-18061ba58a62"). InnerVolumeSpecName "kube-api-access-gkd5j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:45:40.452597 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:45:40.452491    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/378cbb8e-18f0-46e5-afb1-18061ba58a62-dshm" (OuterVolumeSpecName: "dshm") pod "378cbb8e-18f0-46e5-afb1-18061ba58a62" (UID: "378cbb8e-18f0-46e5-afb1-18061ba58a62"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:45:40.452597 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:45:40.452492    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/378cbb8e-18f0-46e5-afb1-18061ba58a62-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "378cbb8e-18f0-46e5-afb1-18061ba58a62" (UID: "378cbb8e-18f0-46e5-afb1-18061ba58a62"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:45:40.551439 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:45:40.551405    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/378cbb8e-18f0-46e5-afb1-18061ba58a62-dshm\") on node \"ip-10-0-143-38.ec2.internal\" DevicePath \"\""
Jul 02 19:45:40.551439 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:45:40.551433    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gkd5j\" (UniqueName: \"kubernetes.io/projected/378cbb8e-18f0-46e5-afb1-18061ba58a62-kube-api-access-gkd5j\") on node \"ip-10-0-143-38.ec2.internal\" DevicePath \"\""
Jul 02 19:45:40.551439 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:45:40.551444    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/378cbb8e-18f0-46e5-afb1-18061ba58a62-tls-certs\") on node \"ip-10-0-143-38.ec2.internal\" DevicePath \"\""
Jul 02 19:45:40.551669 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:45:40.551453    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/378cbb8e-18f0-46e5-afb1-18061ba58a62-tmp-dir\") on node \"ip-10-0-143-38.ec2.internal\" DevicePath \"\""
Jul 02 19:45:40.719225 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:45:40.719193    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-363f6558/e2e-lifecycle-model-363f6558-kserve-846599cddc-dlbzx"]
Jul 02 19:45:40.723063 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:45:40.723043    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-363f6558/e2e-lifecycle-model-363f6558-kserve-846599cddc-dlbzx"]
Jul 02 19:45:42.117255 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:45:42.117220    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="378cbb8e-18f0-46e5-afb1-18061ba58a62" path="/var/lib/kubelet/pods/378cbb8e-18f0-46e5-afb1-18061ba58a62/volumes"
Jul 02 19:46:01.319973 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:46:01.319900    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:46:02.363589 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:46:02.363551    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:46:07.794201 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:46:07.794121    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:46:07.923685 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:46:07.923651    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:46:08.093701 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:46:08.093629    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:46:08.341077 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:46:08.341047    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:46:09.357406 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:46:09.357326    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:46:09.458485 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:46:09.458453    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:46:09.528503 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:46:09.528470    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:46:10.257949 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:46:10.257896    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:46:10.365739 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:46:10.365711    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:46:10.567039 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:46:10.566903    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:46:11.893547 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:46:11.893461    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:46:17.693777 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:46:17.693743    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:46:17.824481 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:46:17.824450    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:46:18.374055 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:46:18.374022    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:46:24.182597 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:46:24.182559    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:46:24.255641 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:46:24.255604    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:46:24.323401 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:46:24.323365    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:46:34.897287 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:46:34.897250    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:46:35.232150 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:46:35.232117    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:46:44.129295 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:46:44.129269    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lgt7t_38beee50-e2c9-489e-91cb-f1bfad99fabf/ovn-acl-logging/0.log"
Jul 02 19:46:44.136261 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:46:44.136242    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lgt7t_38beee50-e2c9-489e-91cb-f1bfad99fabf/ovn-acl-logging/0.log"
Jul 02 19:46:56.204858 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:46:56.204823    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:47:02.030184 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:47:02.030148    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:47:02.105280 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:47:02.105248    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:47:02.347633 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:47:02.347547    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:47:02.770709 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:47:02.770677    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:47:03.210139 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:47:03.210111    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:47:06.186087 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:47:06.186000    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:47:06.332549 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:47:06.332507    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:47:06.452355 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:47:06.452274    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:47:07.030109 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:47:07.030076    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:47:07.117444 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:47:07.117414    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:47:07.227678 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:47:07.227644    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:47:10.682134 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:47:10.682099    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:47:11.017616 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:47:11.017584    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:47:11.394721 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:47:11.394624    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:47:11.542737 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:47:11.542703    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:47:14.219542 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:47:14.219514    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:47:14.326479 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:47:14.326448    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:47:14.504244 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:47:14.504170    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:47:14.865451 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:47:14.865367    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:47:15.161301 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:47:15.161197    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:47:15.271303 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:47:15.271275    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:47:18.725582 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:47:18.725550    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:47:28.961717 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:47:28.961680    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:47:29.060468 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:47:29.060440    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:47:36.846598 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:47:36.846494    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:47:36.946711 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:47:36.946680    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:47:41.510487 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:47:41.510451    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-067416/test-model-067416-kserve-75bdbd8f7-wnzvr"]
Jul 02 19:47:41.510867 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:47:41.510815    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="378cbb8e-18f0-46e5-afb1-18061ba58a62" containerName="main"
Jul 02 19:47:41.510867 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:47:41.510826    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="378cbb8e-18f0-46e5-afb1-18061ba58a62" containerName="main"
Jul 02 19:47:41.510980 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:47:41.510888    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="378cbb8e-18f0-46e5-afb1-18061ba58a62" containerName="main"
Jul 02 19:47:41.514106 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:47:41.514091    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-067416/test-model-067416-kserve-75bdbd8f7-wnzvr"
Jul 02 19:47:41.517229 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:47:41.517204    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-067416\"/\"openshift-service-ca.crt\""
Jul 02 19:47:41.517354 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:47:41.517280    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-067416\"/\"kube-root-ca.crt\""
Jul 02 19:47:41.518607 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:47:41.518590    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-067416\"/\"default-dockercfg-2z6rv\""
Jul 02 19:47:41.518683 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:47:41.518590    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-067416\"/\"test-model-067416-kserve-self-signed-certs\""
Jul 02 19:47:41.533619 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:47:41.533597    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-067416/test-model-067416-kserve-75bdbd8f7-wnzvr"]
Jul 02 19:47:41.572555 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:47:41.572520    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:47:41.581938 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:47:41.581892    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7521e0aa-20a8-48bd-bf28-883e886bb6e0-tls-certs\") pod \"test-model-067416-kserve-75bdbd8f7-wnzvr\" (UID: \"7521e0aa-20a8-48bd-bf28-883e886bb6e0\") " pod="ai-tenant-e2e-inf-a-067416/test-model-067416-kserve-75bdbd8f7-wnzvr"
Jul 02 19:47:41.581938 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:47:41.581940    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7521e0aa-20a8-48bd-bf28-883e886bb6e0-model-cache\") pod \"test-model-067416-kserve-75bdbd8f7-wnzvr\" (UID: \"7521e0aa-20a8-48bd-bf28-883e886bb6e0\") " pod="ai-tenant-e2e-inf-a-067416/test-model-067416-kserve-75bdbd8f7-wnzvr"
Jul 02 19:47:41.582147 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:47:41.582041    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7521e0aa-20a8-48bd-bf28-883e886bb6e0-home\") pod \"test-model-067416-kserve-75bdbd8f7-wnzvr\" (UID: \"7521e0aa-20a8-48bd-bf28-883e886bb6e0\") " pod="ai-tenant-e2e-inf-a-067416/test-model-067416-kserve-75bdbd8f7-wnzvr"
Jul 02 19:47:41.582147 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:47:41.582076    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7521e0aa-20a8-48bd-bf28-883e886bb6e0-tmp-dir\") pod \"test-model-067416-kserve-75bdbd8f7-wnzvr\" (UID: \"7521e0aa-20a8-48bd-bf28-883e886bb6e0\") " pod="ai-tenant-e2e-inf-a-067416/test-model-067416-kserve-75bdbd8f7-wnzvr"
Jul 02 19:47:41.582147 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:47:41.582122    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7521e0aa-20a8-48bd-bf28-883e886bb6e0-dshm\") pod \"test-model-067416-kserve-75bdbd8f7-wnzvr\" (UID: \"7521e0aa-20a8-48bd-bf28-883e886bb6e0\") " pod="ai-tenant-e2e-inf-a-067416/test-model-067416-kserve-75bdbd8f7-wnzvr"
Jul 02 19:47:41.582147 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:47:41.582143    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52qhm\" (UniqueName: \"kubernetes.io/projected/7521e0aa-20a8-48bd-bf28-883e886bb6e0-kube-api-access-52qhm\") pod \"test-model-067416-kserve-75bdbd8f7-wnzvr\" (UID: \"7521e0aa-20a8-48bd-bf28-883e886bb6e0\") " pod="ai-tenant-e2e-inf-a-067416/test-model-067416-kserve-75bdbd8f7-wnzvr"
Jul 02 19:47:41.683496 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:47:41.683457    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7521e0aa-20a8-48bd-bf28-883e886bb6e0-home\") pod \"test-model-067416-kserve-75bdbd8f7-wnzvr\" (UID: \"7521e0aa-20a8-48bd-bf28-883e886bb6e0\") " pod="ai-tenant-e2e-inf-a-067416/test-model-067416-kserve-75bdbd8f7-wnzvr"
Jul 02 19:47:41.683692 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:47:41.683510    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7521e0aa-20a8-48bd-bf28-883e886bb6e0-tmp-dir\") pod \"test-model-067416-kserve-75bdbd8f7-wnzvr\" (UID: \"7521e0aa-20a8-48bd-bf28-883e886bb6e0\") " pod="ai-tenant-e2e-inf-a-067416/test-model-067416-kserve-75bdbd8f7-wnzvr"
Jul 02 19:47:41.683692 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:47:41.683551    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7521e0aa-20a8-48bd-bf28-883e886bb6e0-dshm\") pod \"test-model-067416-kserve-75bdbd8f7-wnzvr\" (UID: \"7521e0aa-20a8-48bd-bf28-883e886bb6e0\") " pod="ai-tenant-e2e-inf-a-067416/test-model-067416-kserve-75bdbd8f7-wnzvr"
Jul 02 19:47:41.683692 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:47:41.683572    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52qhm\" (UniqueName: \"kubernetes.io/projected/7521e0aa-20a8-48bd-bf28-883e886bb6e0-kube-api-access-52qhm\") pod \"test-model-067416-kserve-75bdbd8f7-wnzvr\" (UID: \"7521e0aa-20a8-48bd-bf28-883e886bb6e0\") " pod="ai-tenant-e2e-inf-a-067416/test-model-067416-kserve-75bdbd8f7-wnzvr"
Jul 02 19:47:41.683692 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:47:41.683608    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7521e0aa-20a8-48bd-bf28-883e886bb6e0-tls-certs\") pod \"test-model-067416-kserve-75bdbd8f7-wnzvr\" (UID: \"7521e0aa-20a8-48bd-bf28-883e886bb6e0\") " pod="ai-tenant-e2e-inf-a-067416/test-model-067416-kserve-75bdbd8f7-wnzvr"
Jul 02 19:47:41.683692 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:47:41.683640    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7521e0aa-20a8-48bd-bf28-883e886bb6e0-model-cache\") pod \"test-model-067416-kserve-75bdbd8f7-wnzvr\" (UID: \"7521e0aa-20a8-48bd-bf28-883e886bb6e0\") " pod="ai-tenant-e2e-inf-a-067416/test-model-067416-kserve-75bdbd8f7-wnzvr"
Jul 02 19:47:41.684009 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:47:41.683949    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7521e0aa-20a8-48bd-bf28-883e886bb6e0-home\") pod \"test-model-067416-kserve-75bdbd8f7-wnzvr\" (UID: \"7521e0aa-20a8-48bd-bf28-883e886bb6e0\") " pod="ai-tenant-e2e-inf-a-067416/test-model-067416-kserve-75bdbd8f7-wnzvr"
Jul 02 19:47:41.684009 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:47:41.683967    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7521e0aa-20a8-48bd-bf28-883e886bb6e0-tmp-dir\") pod \"test-model-067416-kserve-75bdbd8f7-wnzvr\" (UID: \"7521e0aa-20a8-48bd-bf28-883e886bb6e0\") " pod="ai-tenant-e2e-inf-a-067416/test-model-067416-kserve-75bdbd8f7-wnzvr"
Jul 02 19:47:41.684119 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:47:41.684066    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7521e0aa-20a8-48bd-bf28-883e886bb6e0-model-cache\") pod \"test-model-067416-kserve-75bdbd8f7-wnzvr\" (UID: \"7521e0aa-20a8-48bd-bf28-883e886bb6e0\") " pod="ai-tenant-e2e-inf-a-067416/test-model-067416-kserve-75bdbd8f7-wnzvr"
Jul 02 19:47:41.686047 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:47:41.686025    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7521e0aa-20a8-48bd-bf28-883e886bb6e0-dshm\") pod \"test-model-067416-kserve-75bdbd8f7-wnzvr\" (UID: \"7521e0aa-20a8-48bd-bf28-883e886bb6e0\") " pod="ai-tenant-e2e-inf-a-067416/test-model-067416-kserve-75bdbd8f7-wnzvr"
Jul 02 19:47:41.686336 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:47:41.686317    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7521e0aa-20a8-48bd-bf28-883e886bb6e0-tls-certs\") pod \"test-model-067416-kserve-75bdbd8f7-wnzvr\" (UID: \"7521e0aa-20a8-48bd-bf28-883e886bb6e0\") " pod="ai-tenant-e2e-inf-a-067416/test-model-067416-kserve-75bdbd8f7-wnzvr"
Jul 02 19:47:41.693843 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:47:41.693811    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-52qhm\" (UniqueName: \"kubernetes.io/projected/7521e0aa-20a8-48bd-bf28-883e886bb6e0-kube-api-access-52qhm\") pod \"test-model-067416-kserve-75bdbd8f7-wnzvr\" (UID: \"7521e0aa-20a8-48bd-bf28-883e886bb6e0\") " pod="ai-tenant-e2e-inf-a-067416/test-model-067416-kserve-75bdbd8f7-wnzvr"
Jul 02 19:47:41.822899 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:47:41.822809    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-067416/test-model-067416-kserve-75bdbd8f7-wnzvr"
Jul 02 19:47:41.958117 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:47:41.958093    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-067416/test-model-067416-kserve-75bdbd8f7-wnzvr"]
Jul 02 19:47:41.960106 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:47:41.960081    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7521e0aa_20a8_48bd_bf28_883e886bb6e0.slice/crio-335c4ce71f010ea98631609a29f99d2f4a5e8f07e57bd7a0b4b3ecf37f25d82a WatchSource:0}: Error finding container 335c4ce71f010ea98631609a29f99d2f4a5e8f07e57bd7a0b4b3ecf37f25d82a: Status 404 returned error can't find the container with id 335c4ce71f010ea98631609a29f99d2f4a5e8f07e57bd7a0b4b3ecf37f25d82a
Jul 02 19:47:42.940647 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:47:42.940616    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-067416/test-model-067416-kserve-75bdbd8f7-wnzvr" event={"ID":"7521e0aa-20a8-48bd-bf28-883e886bb6e0","Type":"ContainerStarted","Data":"1752928e08dd42d70e787ee9830f6f5b00ebd39c1f25eecdbb1265edbd6ad2e6"}
Jul 02 19:47:42.941114 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:47:42.940653    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-067416/test-model-067416-kserve-75bdbd8f7-wnzvr" event={"ID":"7521e0aa-20a8-48bd-bf28-883e886bb6e0","Type":"ContainerStarted","Data":"335c4ce71f010ea98631609a29f99d2f4a5e8f07e57bd7a0b4b3ecf37f25d82a"}
Jul 02 19:47:42.972412 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:47:42.972362    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-067416/test-model-067416-kserve-75bdbd8f7-wnzvr" podStartSLOduration=1.97234478 podStartE2EDuration="1.97234478s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:47:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:47:42.971061114 +0000 UTC m=+2159.335131040" watchObservedRunningTime="2026-07-02 19:47:42.97234478 +0000 UTC m=+2159.336414693"
Jul 02 19:47:51.823153 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:47:51.823111    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-067416/test-model-067416-kserve-75bdbd8f7-wnzvr"
Jul 02 19:47:51.823153 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:47:51.823171    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-067416/test-model-067416-kserve-75bdbd8f7-wnzvr"
Jul 02 19:47:51.835808 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:47:51.835787    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-067416/test-model-067416-kserve-75bdbd8f7-wnzvr"
Jul 02 19:47:51.990272 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:47:51.990242    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-067416/test-model-067416-kserve-75bdbd8f7-wnzvr"
Jul 02 19:48:17.111468 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:48:17.111434    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-3fa1d8/test-model-3fa1d8-kserve-848fb894ff-w5vqg"]
Jul 02 19:48:17.115401 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:48:17.115378    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-3fa1d8/test-model-3fa1d8-kserve-848fb894ff-w5vqg"
Jul 02 19:48:17.119483 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:48:17.119460    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-3fa1d8\"/\"test-model-3fa1d8-kserve-self-signed-certs\""
Jul 02 19:48:17.119609 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:48:17.119530    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-3fa1d8\"/\"default-dockercfg-stqx5\""
Jul 02 19:48:17.119609 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:48:17.119598    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-3fa1d8\"/\"kube-root-ca.crt\""
Jul 02 19:48:17.119704 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:48:17.119657    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-3fa1d8\"/\"openshift-service-ca.crt\""
Jul 02 19:48:17.124407 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:48:17.124387    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-3fa1d8/test-model-3fa1d8-kserve-848fb894ff-w5vqg"]
Jul 02 19:48:17.189220 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:48:17.189186    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/10656d43-16bd-41a4-ab24-fa5f160795c9-home\") pod \"test-model-3fa1d8-kserve-848fb894ff-w5vqg\" (UID: \"10656d43-16bd-41a4-ab24-fa5f160795c9\") " pod="ai-tenant-e2e-inf-b-3fa1d8/test-model-3fa1d8-kserve-848fb894ff-w5vqg"
Jul 02 19:48:17.189400 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:48:17.189230    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/10656d43-16bd-41a4-ab24-fa5f160795c9-tmp-dir\") pod \"test-model-3fa1d8-kserve-848fb894ff-w5vqg\" (UID: \"10656d43-16bd-41a4-ab24-fa5f160795c9\") " pod="ai-tenant-e2e-inf-b-3fa1d8/test-model-3fa1d8-kserve-848fb894ff-w5vqg"
Jul 02 19:48:17.189400 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:48:17.189256    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/10656d43-16bd-41a4-ab24-fa5f160795c9-tls-certs\") pod \"test-model-3fa1d8-kserve-848fb894ff-w5vqg\" (UID: \"10656d43-16bd-41a4-ab24-fa5f160795c9\") " pod="ai-tenant-e2e-inf-b-3fa1d8/test-model-3fa1d8-kserve-848fb894ff-w5vqg"
Jul 02 19:48:17.189400 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:48:17.189305    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/10656d43-16bd-41a4-ab24-fa5f160795c9-model-cache\") pod \"test-model-3fa1d8-kserve-848fb894ff-w5vqg\" (UID: \"10656d43-16bd-41a4-ab24-fa5f160795c9\") " pod="ai-tenant-e2e-inf-b-3fa1d8/test-model-3fa1d8-kserve-848fb894ff-w5vqg"
Jul 02 19:48:17.189400 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:48:17.189359    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/10656d43-16bd-41a4-ab24-fa5f160795c9-dshm\") pod \"test-model-3fa1d8-kserve-848fb894ff-w5vqg\" (UID: \"10656d43-16bd-41a4-ab24-fa5f160795c9\") " pod="ai-tenant-e2e-inf-b-3fa1d8/test-model-3fa1d8-kserve-848fb894ff-w5vqg"
Jul 02 19:48:17.189400 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:48:17.189376    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkj6q\" (UniqueName: \"kubernetes.io/projected/10656d43-16bd-41a4-ab24-fa5f160795c9-kube-api-access-tkj6q\") pod \"test-model-3fa1d8-kserve-848fb894ff-w5vqg\" (UID: \"10656d43-16bd-41a4-ab24-fa5f160795c9\") " pod="ai-tenant-e2e-inf-b-3fa1d8/test-model-3fa1d8-kserve-848fb894ff-w5vqg"
Jul 02 19:48:17.290168 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:48:17.290129    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/10656d43-16bd-41a4-ab24-fa5f160795c9-model-cache\") pod \"test-model-3fa1d8-kserve-848fb894ff-w5vqg\" (UID: \"10656d43-16bd-41a4-ab24-fa5f160795c9\") " pod="ai-tenant-e2e-inf-b-3fa1d8/test-model-3fa1d8-kserve-848fb894ff-w5vqg"
Jul 02 19:48:17.290342 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:48:17.290205    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/10656d43-16bd-41a4-ab24-fa5f160795c9-dshm\") pod \"test-model-3fa1d8-kserve-848fb894ff-w5vqg\" (UID: \"10656d43-16bd-41a4-ab24-fa5f160795c9\") " pod="ai-tenant-e2e-inf-b-3fa1d8/test-model-3fa1d8-kserve-848fb894ff-w5vqg"
Jul 02 19:48:17.290342 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:48:17.290221    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkj6q\" (UniqueName: \"kubernetes.io/projected/10656d43-16bd-41a4-ab24-fa5f160795c9-kube-api-access-tkj6q\") pod \"test-model-3fa1d8-kserve-848fb894ff-w5vqg\" (UID: \"10656d43-16bd-41a4-ab24-fa5f160795c9\") " pod="ai-tenant-e2e-inf-b-3fa1d8/test-model-3fa1d8-kserve-848fb894ff-w5vqg"
Jul 02 19:48:17.290342 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:48:17.290281    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/10656d43-16bd-41a4-ab24-fa5f160795c9-home\") pod \"test-model-3fa1d8-kserve-848fb894ff-w5vqg\" (UID: \"10656d43-16bd-41a4-ab24-fa5f160795c9\") " pod="ai-tenant-e2e-inf-b-3fa1d8/test-model-3fa1d8-kserve-848fb894ff-w5vqg"
Jul 02 19:48:17.290342 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:48:17.290304    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/10656d43-16bd-41a4-ab24-fa5f160795c9-tmp-dir\") pod \"test-model-3fa1d8-kserve-848fb894ff-w5vqg\" (UID: \"10656d43-16bd-41a4-ab24-fa5f160795c9\") " pod="ai-tenant-e2e-inf-b-3fa1d8/test-model-3fa1d8-kserve-848fb894ff-w5vqg"
Jul 02 19:48:17.290342 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:48:17.290323    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/10656d43-16bd-41a4-ab24-fa5f160795c9-tls-certs\") pod \"test-model-3fa1d8-kserve-848fb894ff-w5vqg\" (UID: \"10656d43-16bd-41a4-ab24-fa5f160795c9\") " pod="ai-tenant-e2e-inf-b-3fa1d8/test-model-3fa1d8-kserve-848fb894ff-w5vqg"
Jul 02 19:48:17.290617 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:48:17.290579    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/10656d43-16bd-41a4-ab24-fa5f160795c9-model-cache\") pod \"test-model-3fa1d8-kserve-848fb894ff-w5vqg\" (UID: \"10656d43-16bd-41a4-ab24-fa5f160795c9\") " pod="ai-tenant-e2e-inf-b-3fa1d8/test-model-3fa1d8-kserve-848fb894ff-w5vqg"
Jul 02 19:48:17.290676 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:48:17.290653    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/10656d43-16bd-41a4-ab24-fa5f160795c9-home\") pod \"test-model-3fa1d8-kserve-848fb894ff-w5vqg\" (UID: \"10656d43-16bd-41a4-ab24-fa5f160795c9\") " pod="ai-tenant-e2e-inf-b-3fa1d8/test-model-3fa1d8-kserve-848fb894ff-w5vqg"
Jul 02 19:48:17.290754 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:48:17.290735    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/10656d43-16bd-41a4-ab24-fa5f160795c9-tmp-dir\") pod \"test-model-3fa1d8-kserve-848fb894ff-w5vqg\" (UID: \"10656d43-16bd-41a4-ab24-fa5f160795c9\") " pod="ai-tenant-e2e-inf-b-3fa1d8/test-model-3fa1d8-kserve-848fb894ff-w5vqg"
Jul 02 19:48:17.292575 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:48:17.292559    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/10656d43-16bd-41a4-ab24-fa5f160795c9-dshm\") pod \"test-model-3fa1d8-kserve-848fb894ff-w5vqg\" (UID: \"10656d43-16bd-41a4-ab24-fa5f160795c9\") " pod="ai-tenant-e2e-inf-b-3fa1d8/test-model-3fa1d8-kserve-848fb894ff-w5vqg"
Jul 02 19:48:17.292964 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:48:17.292943    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/10656d43-16bd-41a4-ab24-fa5f160795c9-tls-certs\") pod \"test-model-3fa1d8-kserve-848fb894ff-w5vqg\" (UID: \"10656d43-16bd-41a4-ab24-fa5f160795c9\") " pod="ai-tenant-e2e-inf-b-3fa1d8/test-model-3fa1d8-kserve-848fb894ff-w5vqg"
Jul 02 19:48:17.298575 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:48:17.298554    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkj6q\" (UniqueName: \"kubernetes.io/projected/10656d43-16bd-41a4-ab24-fa5f160795c9-kube-api-access-tkj6q\") pod \"test-model-3fa1d8-kserve-848fb894ff-w5vqg\" (UID: \"10656d43-16bd-41a4-ab24-fa5f160795c9\") " pod="ai-tenant-e2e-inf-b-3fa1d8/test-model-3fa1d8-kserve-848fb894ff-w5vqg"
Jul 02 19:48:17.425582 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:48:17.425492    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-3fa1d8/test-model-3fa1d8-kserve-848fb894ff-w5vqg"
Jul 02 19:48:17.562341 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:48:17.562312    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-3fa1d8/test-model-3fa1d8-kserve-848fb894ff-w5vqg"]
Jul 02 19:48:17.564139 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:48:17.564111    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:48:17.565040 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:48:17.565015    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod10656d43_16bd_41a4_ab24_fa5f160795c9.slice/crio-9dcd2cafdd8e1643a1f2696a594bab23d2f297b6d806900ac216eb881f596627 WatchSource:0}: Error finding container 9dcd2cafdd8e1643a1f2696a594bab23d2f297b6d806900ac216eb881f596627: Status 404 returned error can't find the container with id 9dcd2cafdd8e1643a1f2696a594bab23d2f297b6d806900ac216eb881f596627
Jul 02 19:48:18.101898 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:48:18.101855    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-3fa1d8/test-model-3fa1d8-kserve-848fb894ff-w5vqg" event={"ID":"10656d43-16bd-41a4-ab24-fa5f160795c9","Type":"ContainerStarted","Data":"81831885dd6d7a7f9f40aa8e589cc9999a487686c47442a9291530aaaced39a6"}
Jul 02 19:48:18.102095 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:48:18.101907    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-3fa1d8/test-model-3fa1d8-kserve-848fb894ff-w5vqg" event={"ID":"10656d43-16bd-41a4-ab24-fa5f160795c9","Type":"ContainerStarted","Data":"9dcd2cafdd8e1643a1f2696a594bab23d2f297b6d806900ac216eb881f596627"}
Jul 02 19:48:18.118562 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:48:18.118500    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-3fa1d8/test-model-3fa1d8-kserve-848fb894ff-w5vqg" podStartSLOduration=1.118483277 podStartE2EDuration="1.118483277s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:48:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:48:18.118404224 +0000 UTC m=+2194.482474137" watchObservedRunningTime="2026-07-02 19:48:18.118483277 +0000 UTC m=+2194.482553193"
Jul 02 19:48:27.426347 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:48:27.426312    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-3fa1d8/test-model-3fa1d8-kserve-848fb894ff-w5vqg"
Jul 02 19:48:27.426755 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:48:27.426363    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-3fa1d8/test-model-3fa1d8-kserve-848fb894ff-w5vqg"
Jul 02 19:48:27.438969 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:48:27.438944    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-3fa1d8/test-model-3fa1d8-kserve-848fb894ff-w5vqg"
Jul 02 19:48:28.157540 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:48:28.157511    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-3fa1d8/test-model-3fa1d8-kserve-848fb894ff-w5vqg"
Jul 02 19:48:31.426141 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:48:31.426047    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:48:31.526594 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:48:31.526565    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:48:44.713292 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:48:44.713262    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:48:44.770207 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:48:44.770178    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:49:03.210595 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:03.210563    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-067416/test-model-067416-kserve-75bdbd8f7-wnzvr"]
Jul 02 19:49:03.231468 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:03.231436    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:49:04.108162 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:04.108129    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-3fa1d8/test-model-3fa1d8-kserve-848fb894ff-w5vqg"]
Jul 02 19:49:04.128866 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:04.128830    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:49:04.284994 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:04.284950    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:49:04.694460 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:04.694386    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:49:04.882106 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:04.882069    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:49:04.983501 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:04.983456    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:49:05.143449 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:05.143406    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:49:09.770019 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:09.769987    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:49:18.231156 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:18.231118    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-067416/test-model-067416-kserve-75bdbd8f7-wnzvr" podUID="7521e0aa-20a8-48bd-bf28-883e886bb6e0" containerName="main" containerID="cri-o://1752928e08dd42d70e787ee9830f6f5b00ebd39c1f25eecdbb1265edbd6ad2e6" gracePeriod=45
Jul 02 19:49:18.378055 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:18.378024    2562 generic.go:356] "Generic (PLEG): container finished" podID="7521e0aa-20a8-48bd-bf28-883e886bb6e0" containerID="1752928e08dd42d70e787ee9830f6f5b00ebd39c1f25eecdbb1265edbd6ad2e6" exitCode=0
Jul 02 19:49:18.378221 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:18.378075    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-067416/test-model-067416-kserve-75bdbd8f7-wnzvr" event={"ID":"7521e0aa-20a8-48bd-bf28-883e886bb6e0","Type":"ContainerDied","Data":"1752928e08dd42d70e787ee9830f6f5b00ebd39c1f25eecdbb1265edbd6ad2e6"}
Jul 02 19:49:18.474366 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:18.474342    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-067416/test-model-067416-kserve-75bdbd8f7-wnzvr"
Jul 02 19:49:18.524639 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:18.524562    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7521e0aa-20a8-48bd-bf28-883e886bb6e0-dshm\") pod \"7521e0aa-20a8-48bd-bf28-883e886bb6e0\" (UID: \"7521e0aa-20a8-48bd-bf28-883e886bb6e0\") "
Jul 02 19:49:18.524639 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:18.524634    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-52qhm\" (UniqueName: \"kubernetes.io/projected/7521e0aa-20a8-48bd-bf28-883e886bb6e0-kube-api-access-52qhm\") pod \"7521e0aa-20a8-48bd-bf28-883e886bb6e0\" (UID: \"7521e0aa-20a8-48bd-bf28-883e886bb6e0\") "
Jul 02 19:49:18.524862 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:18.524674    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7521e0aa-20a8-48bd-bf28-883e886bb6e0-tmp-dir\") pod \"7521e0aa-20a8-48bd-bf28-883e886bb6e0\" (UID: \"7521e0aa-20a8-48bd-bf28-883e886bb6e0\") "
Jul 02 19:49:18.524862 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:18.524733    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7521e0aa-20a8-48bd-bf28-883e886bb6e0-home\") pod \"7521e0aa-20a8-48bd-bf28-883e886bb6e0\" (UID: \"7521e0aa-20a8-48bd-bf28-883e886bb6e0\") "
Jul 02 19:49:18.524862 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:18.524754    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7521e0aa-20a8-48bd-bf28-883e886bb6e0-tls-certs\") pod \"7521e0aa-20a8-48bd-bf28-883e886bb6e0\" (UID: \"7521e0aa-20a8-48bd-bf28-883e886bb6e0\") "
Jul 02 19:49:18.524862 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:18.524769    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7521e0aa-20a8-48bd-bf28-883e886bb6e0-model-cache\") pod \"7521e0aa-20a8-48bd-bf28-883e886bb6e0\" (UID: \"7521e0aa-20a8-48bd-bf28-883e886bb6e0\") "
Jul 02 19:49:18.525096 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:18.525021    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7521e0aa-20a8-48bd-bf28-883e886bb6e0-home" (OuterVolumeSpecName: "home") pod "7521e0aa-20a8-48bd-bf28-883e886bb6e0" (UID: "7521e0aa-20a8-48bd-bf28-883e886bb6e0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:49:18.525096 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:18.525034    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7521e0aa-20a8-48bd-bf28-883e886bb6e0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7521e0aa-20a8-48bd-bf28-883e886bb6e0" (UID: "7521e0aa-20a8-48bd-bf28-883e886bb6e0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:49:18.525174 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:18.525132    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7521e0aa-20a8-48bd-bf28-883e886bb6e0-model-cache" (OuterVolumeSpecName: "model-cache") pod "7521e0aa-20a8-48bd-bf28-883e886bb6e0" (UID: "7521e0aa-20a8-48bd-bf28-883e886bb6e0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:49:18.526974 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:18.526943    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7521e0aa-20a8-48bd-bf28-883e886bb6e0-dshm" (OuterVolumeSpecName: "dshm") pod "7521e0aa-20a8-48bd-bf28-883e886bb6e0" (UID: "7521e0aa-20a8-48bd-bf28-883e886bb6e0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:49:18.527098 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:18.527061    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7521e0aa-20a8-48bd-bf28-883e886bb6e0-kube-api-access-52qhm" (OuterVolumeSpecName: "kube-api-access-52qhm") pod "7521e0aa-20a8-48bd-bf28-883e886bb6e0" (UID: "7521e0aa-20a8-48bd-bf28-883e886bb6e0"). InnerVolumeSpecName "kube-api-access-52qhm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:49:18.527098 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:18.527064    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7521e0aa-20a8-48bd-bf28-883e886bb6e0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7521e0aa-20a8-48bd-bf28-883e886bb6e0" (UID: "7521e0aa-20a8-48bd-bf28-883e886bb6e0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:49:18.626327 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:18.626285    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-52qhm\" (UniqueName: \"kubernetes.io/projected/7521e0aa-20a8-48bd-bf28-883e886bb6e0-kube-api-access-52qhm\") on node \"ip-10-0-143-38.ec2.internal\" DevicePath \"\""
Jul 02 19:49:18.626327 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:18.626320    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7521e0aa-20a8-48bd-bf28-883e886bb6e0-tmp-dir\") on node \"ip-10-0-143-38.ec2.internal\" DevicePath \"\""
Jul 02 19:49:18.626327 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:18.626329    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7521e0aa-20a8-48bd-bf28-883e886bb6e0-home\") on node \"ip-10-0-143-38.ec2.internal\" DevicePath \"\""
Jul 02 19:49:18.626327 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:18.626337    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7521e0aa-20a8-48bd-bf28-883e886bb6e0-tls-certs\") on node \"ip-10-0-143-38.ec2.internal\" DevicePath \"\""
Jul 02 19:49:18.626587 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:18.626346    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7521e0aa-20a8-48bd-bf28-883e886bb6e0-model-cache\") on node \"ip-10-0-143-38.ec2.internal\" DevicePath \"\""
Jul 02 19:49:18.626587 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:18.626353    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7521e0aa-20a8-48bd-bf28-883e886bb6e0-dshm\") on node \"ip-10-0-143-38.ec2.internal\" DevicePath \"\""
Jul 02 19:49:19.128619 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:19.128585    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-3fa1d8/test-model-3fa1d8-kserve-848fb894ff-w5vqg" podUID="10656d43-16bd-41a4-ab24-fa5f160795c9" containerName="main" containerID="cri-o://81831885dd6d7a7f9f40aa8e589cc9999a487686c47442a9291530aaaced39a6" gracePeriod=45
Jul 02 19:49:19.375745 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:19.375719    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-3fa1d8/test-model-3fa1d8-kserve-848fb894ff-w5vqg"
Jul 02 19:49:19.383677 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:19.383612    2562 generic.go:356] "Generic (PLEG): container finished" podID="10656d43-16bd-41a4-ab24-fa5f160795c9" containerID="81831885dd6d7a7f9f40aa8e589cc9999a487686c47442a9291530aaaced39a6" exitCode=0
Jul 02 19:49:19.383677 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:19.383650    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-3fa1d8/test-model-3fa1d8-kserve-848fb894ff-w5vqg"
Jul 02 19:49:19.383677 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:19.383653    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-3fa1d8/test-model-3fa1d8-kserve-848fb894ff-w5vqg" event={"ID":"10656d43-16bd-41a4-ab24-fa5f160795c9","Type":"ContainerDied","Data":"81831885dd6d7a7f9f40aa8e589cc9999a487686c47442a9291530aaaced39a6"}
Jul 02 19:49:19.383883 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:19.383706    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-3fa1d8/test-model-3fa1d8-kserve-848fb894ff-w5vqg" event={"ID":"10656d43-16bd-41a4-ab24-fa5f160795c9","Type":"ContainerDied","Data":"9dcd2cafdd8e1643a1f2696a594bab23d2f297b6d806900ac216eb881f596627"}
Jul 02 19:49:19.383883 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:19.383732    2562 scope.go:117] "RemoveContainer" containerID="81831885dd6d7a7f9f40aa8e589cc9999a487686c47442a9291530aaaced39a6"
Jul 02 19:49:19.384973 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:19.384956    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-067416/test-model-067416-kserve-75bdbd8f7-wnzvr"
Jul 02 19:49:19.385064 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:19.384992    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-067416/test-model-067416-kserve-75bdbd8f7-wnzvr" event={"ID":"7521e0aa-20a8-48bd-bf28-883e886bb6e0","Type":"ContainerDied","Data":"335c4ce71f010ea98631609a29f99d2f4a5e8f07e57bd7a0b4b3ecf37f25d82a"}
Jul 02 19:49:19.393533 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:19.393514    2562 scope.go:117] "RemoveContainer" containerID="81831885dd6d7a7f9f40aa8e589cc9999a487686c47442a9291530aaaced39a6"
Jul 02 19:49:19.393818 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:49:19.393799    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81831885dd6d7a7f9f40aa8e589cc9999a487686c47442a9291530aaaced39a6\": container with ID starting with 81831885dd6d7a7f9f40aa8e589cc9999a487686c47442a9291530aaaced39a6 not found: ID does not exist" containerID="81831885dd6d7a7f9f40aa8e589cc9999a487686c47442a9291530aaaced39a6"
Jul 02 19:49:19.393886 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:19.393829    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81831885dd6d7a7f9f40aa8e589cc9999a487686c47442a9291530aaaced39a6"} err="failed to get container status \"81831885dd6d7a7f9f40aa8e589cc9999a487686c47442a9291530aaaced39a6\": rpc error: code = NotFound desc = could not find container \"81831885dd6d7a7f9f40aa8e589cc9999a487686c47442a9291530aaaced39a6\": container with ID starting with 81831885dd6d7a7f9f40aa8e589cc9999a487686c47442a9291530aaaced39a6 not found: ID does not exist"
Jul 02 19:49:19.393886 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:19.393845    2562 scope.go:117] "RemoveContainer" containerID="1752928e08dd42d70e787ee9830f6f5b00ebd39c1f25eecdbb1265edbd6ad2e6"
Jul 02 19:49:19.412115 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:19.412091    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-067416/test-model-067416-kserve-75bdbd8f7-wnzvr"]
Jul 02 19:49:19.421796 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:19.421770    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-067416/test-model-067416-kserve-75bdbd8f7-wnzvr"]
Jul 02 19:49:19.434177 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:19.434158    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tkj6q\" (UniqueName: \"kubernetes.io/projected/10656d43-16bd-41a4-ab24-fa5f160795c9-kube-api-access-tkj6q\") pod \"10656d43-16bd-41a4-ab24-fa5f160795c9\" (UID: \"10656d43-16bd-41a4-ab24-fa5f160795c9\") "
Jul 02 19:49:19.434274 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:19.434258    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/10656d43-16bd-41a4-ab24-fa5f160795c9-dshm\") pod \"10656d43-16bd-41a4-ab24-fa5f160795c9\" (UID: \"10656d43-16bd-41a4-ab24-fa5f160795c9\") "
Jul 02 19:49:19.434314 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:19.434295    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/10656d43-16bd-41a4-ab24-fa5f160795c9-model-cache\") pod \"10656d43-16bd-41a4-ab24-fa5f160795c9\" (UID: \"10656d43-16bd-41a4-ab24-fa5f160795c9\") "
Jul 02 19:49:19.434349 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:19.434338    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/10656d43-16bd-41a4-ab24-fa5f160795c9-home\") pod \"10656d43-16bd-41a4-ab24-fa5f160795c9\" (UID: \"10656d43-16bd-41a4-ab24-fa5f160795c9\") "
Jul 02 19:49:19.434379 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:19.434362    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/10656d43-16bd-41a4-ab24-fa5f160795c9-tls-certs\") pod \"10656d43-16bd-41a4-ab24-fa5f160795c9\" (UID: \"10656d43-16bd-41a4-ab24-fa5f160795c9\") "
Jul 02 19:49:19.434432 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:19.434420    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/10656d43-16bd-41a4-ab24-fa5f160795c9-tmp-dir\") pod \"10656d43-16bd-41a4-ab24-fa5f160795c9\" (UID: \"10656d43-16bd-41a4-ab24-fa5f160795c9\") "
Jul 02 19:49:19.434727 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:19.434580    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10656d43-16bd-41a4-ab24-fa5f160795c9-model-cache" (OuterVolumeSpecName: "model-cache") pod "10656d43-16bd-41a4-ab24-fa5f160795c9" (UID: "10656d43-16bd-41a4-ab24-fa5f160795c9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:49:19.434727 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:19.434605    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10656d43-16bd-41a4-ab24-fa5f160795c9-home" (OuterVolumeSpecName: "home") pod "10656d43-16bd-41a4-ab24-fa5f160795c9" (UID: "10656d43-16bd-41a4-ab24-fa5f160795c9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:49:19.434727 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:19.434699    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10656d43-16bd-41a4-ab24-fa5f160795c9-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "10656d43-16bd-41a4-ab24-fa5f160795c9" (UID: "10656d43-16bd-41a4-ab24-fa5f160795c9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:49:19.434870 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:19.434765    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/10656d43-16bd-41a4-ab24-fa5f160795c9-model-cache\") on node \"ip-10-0-143-38.ec2.internal\" DevicePath \"\""
Jul 02 19:49:19.434870 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:19.434788    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/10656d43-16bd-41a4-ab24-fa5f160795c9-home\") on node \"ip-10-0-143-38.ec2.internal\" DevicePath \"\""
Jul 02 19:49:19.436600 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:19.436575    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10656d43-16bd-41a4-ab24-fa5f160795c9-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "10656d43-16bd-41a4-ab24-fa5f160795c9" (UID: "10656d43-16bd-41a4-ab24-fa5f160795c9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:49:19.436703 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:19.436632    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10656d43-16bd-41a4-ab24-fa5f160795c9-kube-api-access-tkj6q" (OuterVolumeSpecName: "kube-api-access-tkj6q") pod "10656d43-16bd-41a4-ab24-fa5f160795c9" (UID: "10656d43-16bd-41a4-ab24-fa5f160795c9"). InnerVolumeSpecName "kube-api-access-tkj6q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:49:19.436703 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:19.436673    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10656d43-16bd-41a4-ab24-fa5f160795c9-dshm" (OuterVolumeSpecName: "dshm") pod "10656d43-16bd-41a4-ab24-fa5f160795c9" (UID: "10656d43-16bd-41a4-ab24-fa5f160795c9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:49:19.535852 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:19.535824    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/10656d43-16bd-41a4-ab24-fa5f160795c9-dshm\") on node \"ip-10-0-143-38.ec2.internal\" DevicePath \"\""
Jul 02 19:49:19.535852 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:19.535848    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/10656d43-16bd-41a4-ab24-fa5f160795c9-tls-certs\") on node \"ip-10-0-143-38.ec2.internal\" DevicePath \"\""
Jul 02 19:49:19.535852 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:19.535858    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/10656d43-16bd-41a4-ab24-fa5f160795c9-tmp-dir\") on node \"ip-10-0-143-38.ec2.internal\" DevicePath \"\""
Jul 02 19:49:19.536133 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:19.535867    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tkj6q\" (UniqueName: \"kubernetes.io/projected/10656d43-16bd-41a4-ab24-fa5f160795c9-kube-api-access-tkj6q\") on node \"ip-10-0-143-38.ec2.internal\" DevicePath \"\""
Jul 02 19:49:19.705683 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:19.705642    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-3fa1d8/test-model-3fa1d8-kserve-848fb894ff-w5vqg"]
Jul 02 19:49:19.709657 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:19.709634    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-3fa1d8/test-model-3fa1d8-kserve-848fb894ff-w5vqg"]
Jul 02 19:49:20.118258 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:20.118230    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="10656d43-16bd-41a4-ab24-fa5f160795c9" path="/var/lib/kubelet/pods/10656d43-16bd-41a4-ab24-fa5f160795c9/volumes"
Jul 02 19:49:20.118720 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:20.118690    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7521e0aa-20a8-48bd-bf28-883e886bb6e0" path="/var/lib/kubelet/pods/7521e0aa-20a8-48bd-bf28-883e886bb6e0/volumes"
Jul 02 19:49:46.552386 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:46.552349    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:49:46.826327 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:46.826244    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:49:47.070892 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:47.070856    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:49:47.389879 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:47.389848    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:49:47.748353 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:47.748319    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:49:47.852807 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:47.852776    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:49:48.023966 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:48.023857    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:49:53.601619 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:53.601590    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:49:53.702838 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:53.702803    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:49:53.862797 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:53.862717    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:49:54.090344 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:54.090312    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:49:54.417316 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:54.417287    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:49:54.749807 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:54.749765    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:49:55.142871 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:55.142788    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:49:57.924082 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:57.924050    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:49:58.016696 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:58.016657    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:49:58.116570 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:58.116544    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:49:58.583520 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:58.583486    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:49:58.685497 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:58.685469    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:49:59.466154 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:59.466119    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:49:59.567524 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:49:59.567490    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:50:00.163138 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:50:00.163103    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:50:00.259558 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:50:00.259528    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:50:00.681754 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:50:00.681720    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:50:02.396245 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:50:02.396200    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:50:02.848288 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:50:02.848251    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:50:03.155103 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:50:03.155025    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:50:04.087378 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:50:04.087346    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:50:05.898931 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:50:05.898891    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:50:06.002269 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:50:06.002235    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:50:06.101215 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:50:06.101177    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:50:06.198048 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:50:06.197960    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:50:06.566101 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:50:06.566070    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:50:06.666452 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:50:06.666418    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:50:10.385014 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:50:10.384977    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:50:15.095202 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:50:15.095158    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:50:18.462053 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:50:18.462021    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:50:18.838087 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:50:18.838004    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:50:18.939806 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:50:18.939775    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:50:19.040847 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:50:19.040820    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:50:19.183437 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:50:19.183357    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:50:24.464807 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:50:24.464778    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:50:24.529536 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:50:24.529501    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:50:24.738296 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:50:24.738221    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:50:24.976359 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:50:24.976329    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:50:25.242845 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:50:25.242810    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:50:25.782859 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:50:25.782831    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:50:25.931834 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:50:25.931805    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:50:26.024033 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:50:26.024004    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:50:26.134419 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:50:26.134339    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:50:26.246122 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:50:26.246093    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:50:31.465831 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:50:31.465796    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:50:31.566140 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:50:31.566102    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:50:31.726837 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:50:31.726752    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:50:31.942678 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:50:31.942648    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:50:32.276361 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:50:32.276333    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:50:32.569901 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:50:32.569824    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:50:32.820559 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:50:32.820474    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:50:35.095157 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:50:35.095080    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:50:35.185309 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:50:35.185274    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:50:35.258273 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:50:35.258242    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:50:35.800849 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:50:35.800819    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:50:35.900239 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:50:35.900210    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:50:36.001214 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:50:36.001158    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:50:39.581770 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:50:39.581730    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:50:39.894928 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:50:39.894839    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:50:40.203657 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:50:40.203633    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:50:40.487962 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:50:40.487860    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:50:43.119598 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:50:43.119565    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:50:43.203259 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:50:43.203227    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:50:43.268493 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:50:43.268456    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:50:43.769998 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:50:43.769958    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:50:43.872085 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:50:43.872053    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:50:44.252102 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:50:44.252069    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:50:47.655106 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:50:47.655070    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:50:57.511037 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:50:57.511001    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:50:57.612122 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:50:57.612087    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:51:02.504262 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:51:02.504227    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-2fca4d/auth-test-model-2fca4d-kserve-95586f7b7-bz9rr"]
Jul 02 19:51:02.505494 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:51:02.505468    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7521e0aa-20a8-48bd-bf28-883e886bb6e0" containerName="main"
Jul 02 19:51:02.505639 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:51:02.505628    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="7521e0aa-20a8-48bd-bf28-883e886bb6e0" containerName="main"
Jul 02 19:51:02.505727 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:51:02.505718    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10656d43-16bd-41a4-ab24-fa5f160795c9" containerName="main"
Jul 02 19:51:02.505797 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:51:02.505789    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="10656d43-16bd-41a4-ab24-fa5f160795c9" containerName="main"
Jul 02 19:51:02.506085 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:51:02.506072    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="10656d43-16bd-41a4-ab24-fa5f160795c9" containerName="main"
Jul 02 19:51:02.506207 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:51:02.506196    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="7521e0aa-20a8-48bd-bf28-883e886bb6e0" containerName="main"
Jul 02 19:51:02.510216 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:51:02.510193    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-2fca4d/auth-test-model-2fca4d-kserve-95586f7b7-bz9rr"
Jul 02 19:51:02.514713 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:51:02.514694    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-2fca4d\"/\"default-dockercfg-xvlvk\""
Jul 02 19:51:02.514713 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:51:02.514705    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-2fca4d\"/\"openshift-service-ca.crt\""
Jul 02 19:51:02.514904 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:51:02.514735    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-2fca4d\"/\"auth-test-model-2fca4d-kserve-self-signed-certs\""
Jul 02 19:51:02.515353 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:51:02.515319    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-2fca4d\"/\"kube-root-ca.crt\""
Jul 02 19:51:02.516818 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:51:02.516791    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-2fca4d/auth-test-model-2fca4d-kserve-95586f7b7-bz9rr"]
Jul 02 19:51:02.536467 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:51:02.536440    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:51:02.627830 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:51:02.627799    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e189c25-aae2-423e-84db-f379f5dfcbbc-dshm\") pod \"auth-test-model-2fca4d-kserve-95586f7b7-bz9rr\" (UID: \"7e189c25-aae2-423e-84db-f379f5dfcbbc\") " pod="ai-tenant-e2e-shared-a-2fca4d/auth-test-model-2fca4d-kserve-95586f7b7-bz9rr"
Jul 02 19:51:02.627830 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:51:02.627832    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e189c25-aae2-423e-84db-f379f5dfcbbc-home\") pod \"auth-test-model-2fca4d-kserve-95586f7b7-bz9rr\" (UID: \"7e189c25-aae2-423e-84db-f379f5dfcbbc\") " pod="ai-tenant-e2e-shared-a-2fca4d/auth-test-model-2fca4d-kserve-95586f7b7-bz9rr"
Jul 02 19:51:02.628074 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:51:02.627852    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7txmm\" (UniqueName: \"kubernetes.io/projected/7e189c25-aae2-423e-84db-f379f5dfcbbc-kube-api-access-7txmm\") pod \"auth-test-model-2fca4d-kserve-95586f7b7-bz9rr\" (UID: \"7e189c25-aae2-423e-84db-f379f5dfcbbc\") " pod="ai-tenant-e2e-shared-a-2fca4d/auth-test-model-2fca4d-kserve-95586f7b7-bz9rr"
Jul 02 19:51:02.628074 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:51:02.627883    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e189c25-aae2-423e-84db-f379f5dfcbbc-model-cache\") pod \"auth-test-model-2fca4d-kserve-95586f7b7-bz9rr\" (UID: \"7e189c25-aae2-423e-84db-f379f5dfcbbc\") " pod="ai-tenant-e2e-shared-a-2fca4d/auth-test-model-2fca4d-kserve-95586f7b7-bz9rr"
Jul 02 19:51:02.628074 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:51:02.627953    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e189c25-aae2-423e-84db-f379f5dfcbbc-tmp-dir\") pod \"auth-test-model-2fca4d-kserve-95586f7b7-bz9rr\" (UID: \"7e189c25-aae2-423e-84db-f379f5dfcbbc\") " pod="ai-tenant-e2e-shared-a-2fca4d/auth-test-model-2fca4d-kserve-95586f7b7-bz9rr"
Jul 02 19:51:02.628074 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:51:02.627982    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e189c25-aae2-423e-84db-f379f5dfcbbc-tls-certs\") pod \"auth-test-model-2fca4d-kserve-95586f7b7-bz9rr\" (UID: \"7e189c25-aae2-423e-84db-f379f5dfcbbc\") " pod="ai-tenant-e2e-shared-a-2fca4d/auth-test-model-2fca4d-kserve-95586f7b7-bz9rr"
Jul 02 19:51:02.729422 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:51:02.729383    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e189c25-aae2-423e-84db-f379f5dfcbbc-dshm\") pod \"auth-test-model-2fca4d-kserve-95586f7b7-bz9rr\" (UID: \"7e189c25-aae2-423e-84db-f379f5dfcbbc\") " pod="ai-tenant-e2e-shared-a-2fca4d/auth-test-model-2fca4d-kserve-95586f7b7-bz9rr"
Jul 02 19:51:02.729422 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:51:02.729421    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e189c25-aae2-423e-84db-f379f5dfcbbc-home\") pod \"auth-test-model-2fca4d-kserve-95586f7b7-bz9rr\" (UID: \"7e189c25-aae2-423e-84db-f379f5dfcbbc\") " pod="ai-tenant-e2e-shared-a-2fca4d/auth-test-model-2fca4d-kserve-95586f7b7-bz9rr"
Jul 02 19:51:02.729640 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:51:02.729439    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7txmm\" (UniqueName: \"kubernetes.io/projected/7e189c25-aae2-423e-84db-f379f5dfcbbc-kube-api-access-7txmm\") pod \"auth-test-model-2fca4d-kserve-95586f7b7-bz9rr\" (UID: \"7e189c25-aae2-423e-84db-f379f5dfcbbc\") " pod="ai-tenant-e2e-shared-a-2fca4d/auth-test-model-2fca4d-kserve-95586f7b7-bz9rr"
Jul 02 19:51:02.729640 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:51:02.729465    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e189c25-aae2-423e-84db-f379f5dfcbbc-model-cache\") pod \"auth-test-model-2fca4d-kserve-95586f7b7-bz9rr\" (UID: \"7e189c25-aae2-423e-84db-f379f5dfcbbc\") " pod="ai-tenant-e2e-shared-a-2fca4d/auth-test-model-2fca4d-kserve-95586f7b7-bz9rr"
Jul 02 19:51:02.729640 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:51:02.729515    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e189c25-aae2-423e-84db-f379f5dfcbbc-tmp-dir\") pod \"auth-test-model-2fca4d-kserve-95586f7b7-bz9rr\" (UID: \"7e189c25-aae2-423e-84db-f379f5dfcbbc\") " pod="ai-tenant-e2e-shared-a-2fca4d/auth-test-model-2fca4d-kserve-95586f7b7-bz9rr"
Jul 02 19:51:02.729640 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:51:02.729562    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e189c25-aae2-423e-84db-f379f5dfcbbc-tls-certs\") pod \"auth-test-model-2fca4d-kserve-95586f7b7-bz9rr\" (UID: \"7e189c25-aae2-423e-84db-f379f5dfcbbc\") " pod="ai-tenant-e2e-shared-a-2fca4d/auth-test-model-2fca4d-kserve-95586f7b7-bz9rr"
Jul 02 19:51:02.729849 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:51:02.729825    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e189c25-aae2-423e-84db-f379f5dfcbbc-home\") pod \"auth-test-model-2fca4d-kserve-95586f7b7-bz9rr\" (UID: \"7e189c25-aae2-423e-84db-f379f5dfcbbc\") " pod="ai-tenant-e2e-shared-a-2fca4d/auth-test-model-2fca4d-kserve-95586f7b7-bz9rr"
Jul 02 19:51:02.729894 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:51:02.729878    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e189c25-aae2-423e-84db-f379f5dfcbbc-model-cache\") pod \"auth-test-model-2fca4d-kserve-95586f7b7-bz9rr\" (UID: \"7e189c25-aae2-423e-84db-f379f5dfcbbc\") " pod="ai-tenant-e2e-shared-a-2fca4d/auth-test-model-2fca4d-kserve-95586f7b7-bz9rr"
Jul 02 19:51:02.730025 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:51:02.730004    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e189c25-aae2-423e-84db-f379f5dfcbbc-tmp-dir\") pod \"auth-test-model-2fca4d-kserve-95586f7b7-bz9rr\" (UID: \"7e189c25-aae2-423e-84db-f379f5dfcbbc\") " pod="ai-tenant-e2e-shared-a-2fca4d/auth-test-model-2fca4d-kserve-95586f7b7-bz9rr"
Jul 02 19:51:02.731854 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:51:02.731834    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e189c25-aae2-423e-84db-f379f5dfcbbc-dshm\") pod \"auth-test-model-2fca4d-kserve-95586f7b7-bz9rr\" (UID: \"7e189c25-aae2-423e-84db-f379f5dfcbbc\") " pod="ai-tenant-e2e-shared-a-2fca4d/auth-test-model-2fca4d-kserve-95586f7b7-bz9rr"
Jul 02 19:51:02.732135 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:51:02.732119    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e189c25-aae2-423e-84db-f379f5dfcbbc-tls-certs\") pod \"auth-test-model-2fca4d-kserve-95586f7b7-bz9rr\" (UID: \"7e189c25-aae2-423e-84db-f379f5dfcbbc\") " pod="ai-tenant-e2e-shared-a-2fca4d/auth-test-model-2fca4d-kserve-95586f7b7-bz9rr"
Jul 02 19:51:02.739854 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:51:02.739833    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7txmm\" (UniqueName: \"kubernetes.io/projected/7e189c25-aae2-423e-84db-f379f5dfcbbc-kube-api-access-7txmm\") pod \"auth-test-model-2fca4d-kserve-95586f7b7-bz9rr\" (UID: \"7e189c25-aae2-423e-84db-f379f5dfcbbc\") " pod="ai-tenant-e2e-shared-a-2fca4d/auth-test-model-2fca4d-kserve-95586f7b7-bz9rr"
Jul 02 19:51:02.821981 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:51:02.821868    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-2fca4d/auth-test-model-2fca4d-kserve-95586f7b7-bz9rr"
Jul 02 19:51:02.954821 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:51:02.954798    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-2fca4d/auth-test-model-2fca4d-kserve-95586f7b7-bz9rr"]
Jul 02 19:51:02.956801 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:51:02.956772    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7e189c25_aae2_423e_84db_f379f5dfcbbc.slice/crio-37a12f32c4d1f005a87251e87465564cf1a921ffdf02a1fade1fc23d14edf957 WatchSource:0}: Error finding container 37a12f32c4d1f005a87251e87465564cf1a921ffdf02a1fade1fc23d14edf957: Status 404 returned error can't find the container with id 37a12f32c4d1f005a87251e87465564cf1a921ffdf02a1fade1fc23d14edf957
Jul 02 19:51:03.852903 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:51:03.852870    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-2fca4d/auth-test-model-2fca4d-kserve-95586f7b7-bz9rr" event={"ID":"7e189c25-aae2-423e-84db-f379f5dfcbbc","Type":"ContainerStarted","Data":"5cbe9f4fe1aa78b99bd23eb5a39a944139ae84083fd731fb11252e1b2d01a26a"}
Jul 02 19:51:03.853312 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:51:03.852929    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-2fca4d/auth-test-model-2fca4d-kserve-95586f7b7-bz9rr" event={"ID":"7e189c25-aae2-423e-84db-f379f5dfcbbc","Type":"ContainerStarted","Data":"37a12f32c4d1f005a87251e87465564cf1a921ffdf02a1fade1fc23d14edf957"}
Jul 02 19:51:03.870344 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:51:03.870292    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-2fca4d/auth-test-model-2fca4d-kserve-95586f7b7-bz9rr" podStartSLOduration=1.870277207 podStartE2EDuration="1.870277207s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:51:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:51:03.869464264 +0000 UTC m=+2360.233534179" watchObservedRunningTime="2026-07-02 19:51:03.870277207 +0000 UTC m=+2360.234347119"
Jul 02 19:51:05.349396 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:51:05.349368    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:51:05.450822 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:51:05.450794    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:51:12.822795 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:51:12.822752    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-2fca4d/auth-test-model-2fca4d-kserve-95586f7b7-bz9rr"
Jul 02 19:51:12.823227 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:51:12.822815    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-2fca4d/auth-test-model-2fca4d-kserve-95586f7b7-bz9rr"
Jul 02 19:51:12.835268 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:51:12.835241    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-2fca4d/auth-test-model-2fca4d-kserve-95586f7b7-bz9rr"
Jul 02 19:51:12.905260 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:51:12.905233    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-2fca4d/auth-test-model-2fca4d-kserve-95586f7b7-bz9rr"
Jul 02 19:51:18.017632 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:51:18.017599    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-f9d728/auth-test-model-f9d728-kserve-746ff56795-vsmwq"]
Jul 02 19:51:18.021153 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:51:18.021135    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f9d728/auth-test-model-f9d728-kserve-746ff56795-vsmwq"
Jul 02 19:51:18.024266 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:51:18.024238    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f9d728\"/\"kube-root-ca.crt\""
Jul 02 19:51:18.025633 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:51:18.025605    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f9d728\"/\"default-dockercfg-c59xm\""
Jul 02 19:51:18.025749 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:51:18.025608    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f9d728\"/\"auth-test-model-f9d728-kserve-self-signed-certs\""
Jul 02 19:51:18.025820 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:51:18.025764    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f9d728\"/\"openshift-service-ca.crt\""
Jul 02 19:51:18.031003 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:51:18.030976    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f9d728/auth-test-model-f9d728-kserve-746ff56795-vsmwq"]
Jul 02 19:51:18.062262 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:51:18.062235    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:51:18.167226 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:51:18.167189    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbr6v\" (UniqueName: \"kubernetes.io/projected/6568bfda-c7f9-4755-9188-63cfd8d39d75-kube-api-access-jbr6v\") pod \"auth-test-model-f9d728-kserve-746ff56795-vsmwq\" (UID: \"6568bfda-c7f9-4755-9188-63cfd8d39d75\") " pod="ai-tenant-e2e-shared-b-f9d728/auth-test-model-f9d728-kserve-746ff56795-vsmwq"
Jul 02 19:51:18.167399 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:51:18.167261    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6568bfda-c7f9-4755-9188-63cfd8d39d75-home\") pod \"auth-test-model-f9d728-kserve-746ff56795-vsmwq\" (UID: \"6568bfda-c7f9-4755-9188-63cfd8d39d75\") " pod="ai-tenant-e2e-shared-b-f9d728/auth-test-model-f9d728-kserve-746ff56795-vsmwq"
Jul 02 19:51:18.167399 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:51:18.167290    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6568bfda-c7f9-4755-9188-63cfd8d39d75-dshm\") pod \"auth-test-model-f9d728-kserve-746ff56795-vsmwq\" (UID: \"6568bfda-c7f9-4755-9188-63cfd8d39d75\") " pod="ai-tenant-e2e-shared-b-f9d728/auth-test-model-f9d728-kserve-746ff56795-vsmwq"
Jul 02 19:51:18.167399 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:51:18.167325    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6568bfda-c7f9-4755-9188-63cfd8d39d75-tmp-dir\") pod \"auth-test-model-f9d728-kserve-746ff56795-vsmwq\" (UID: \"6568bfda-c7f9-4755-9188-63cfd8d39d75\") " pod="ai-tenant-e2e-shared-b-f9d728/auth-test-model-f9d728-kserve-746ff56795-vsmwq"
Jul 02 19:51:18.167399 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:51:18.167363    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6568bfda-c7f9-4755-9188-63cfd8d39d75-tls-certs\") pod \"auth-test-model-f9d728-kserve-746ff56795-vsmwq\" (UID: \"6568bfda-c7f9-4755-9188-63cfd8d39d75\") " pod="ai-tenant-e2e-shared-b-f9d728/auth-test-model-f9d728-kserve-746ff56795-vsmwq"
Jul 02 19:51:18.167399 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:51:18.167391    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6568bfda-c7f9-4755-9188-63cfd8d39d75-model-cache\") pod \"auth-test-model-f9d728-kserve-746ff56795-vsmwq\" (UID: \"6568bfda-c7f9-4755-9188-63cfd8d39d75\") " pod="ai-tenant-e2e-shared-b-f9d728/auth-test-model-f9d728-kserve-746ff56795-vsmwq"
Jul 02 19:51:18.268568 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:51:18.268478    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6568bfda-c7f9-4755-9188-63cfd8d39d75-home\") pod \"auth-test-model-f9d728-kserve-746ff56795-vsmwq\" (UID: \"6568bfda-c7f9-4755-9188-63cfd8d39d75\") " pod="ai-tenant-e2e-shared-b-f9d728/auth-test-model-f9d728-kserve-746ff56795-vsmwq"
Jul 02 19:51:18.268568 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:51:18.268518    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6568bfda-c7f9-4755-9188-63cfd8d39d75-dshm\") pod \"auth-test-model-f9d728-kserve-746ff56795-vsmwq\" (UID: \"6568bfda-c7f9-4755-9188-63cfd8d39d75\") " pod="ai-tenant-e2e-shared-b-f9d728/auth-test-model-f9d728-kserve-746ff56795-vsmwq"
Jul 02 19:51:18.268788 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:51:18.268578    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6568bfda-c7f9-4755-9188-63cfd8d39d75-tmp-dir\") pod \"auth-test-model-f9d728-kserve-746ff56795-vsmwq\" (UID: \"6568bfda-c7f9-4755-9188-63cfd8d39d75\") " pod="ai-tenant-e2e-shared-b-f9d728/auth-test-model-f9d728-kserve-746ff56795-vsmwq"
Jul 02 19:51:18.268788 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:51:18.268601    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6568bfda-c7f9-4755-9188-63cfd8d39d75-tls-certs\") pod \"auth-test-model-f9d728-kserve-746ff56795-vsmwq\" (UID: \"6568bfda-c7f9-4755-9188-63cfd8d39d75\") " pod="ai-tenant-e2e-shared-b-f9d728/auth-test-model-f9d728-kserve-746ff56795-vsmwq"
Jul 02 19:51:18.268788 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:51:18.268629    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6568bfda-c7f9-4755-9188-63cfd8d39d75-model-cache\") pod \"auth-test-model-f9d728-kserve-746ff56795-vsmwq\" (UID: \"6568bfda-c7f9-4755-9188-63cfd8d39d75\") " pod="ai-tenant-e2e-shared-b-f9d728/auth-test-model-f9d728-kserve-746ff56795-vsmwq"
Jul 02 19:51:18.268788 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:51:18.268685    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbr6v\" (UniqueName: \"kubernetes.io/projected/6568bfda-c7f9-4755-9188-63cfd8d39d75-kube-api-access-jbr6v\") pod \"auth-test-model-f9d728-kserve-746ff56795-vsmwq\" (UID: \"6568bfda-c7f9-4755-9188-63cfd8d39d75\") " pod="ai-tenant-e2e-shared-b-f9d728/auth-test-model-f9d728-kserve-746ff56795-vsmwq"
Jul 02 19:51:18.268988 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:51:18.268952    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6568bfda-c7f9-4755-9188-63cfd8d39d75-home\") pod \"auth-test-model-f9d728-kserve-746ff56795-vsmwq\" (UID: \"6568bfda-c7f9-4755-9188-63cfd8d39d75\") " pod="ai-tenant-e2e-shared-b-f9d728/auth-test-model-f9d728-kserve-746ff56795-vsmwq"
Jul 02 19:51:18.269217 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:51:18.269193    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6568bfda-c7f9-4755-9188-63cfd8d39d75-model-cache\") pod \"auth-test-model-f9d728-kserve-746ff56795-vsmwq\" (UID: \"6568bfda-c7f9-4755-9188-63cfd8d39d75\") " pod="ai-tenant-e2e-shared-b-f9d728/auth-test-model-f9d728-kserve-746ff56795-vsmwq"
Jul 02 19:51:18.269299 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:51:18.269223    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6568bfda-c7f9-4755-9188-63cfd8d39d75-tmp-dir\") pod \"auth-test-model-f9d728-kserve-746ff56795-vsmwq\" (UID: \"6568bfda-c7f9-4755-9188-63cfd8d39d75\") " pod="ai-tenant-e2e-shared-b-f9d728/auth-test-model-f9d728-kserve-746ff56795-vsmwq"
Jul 02 19:51:18.271064 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:51:18.271046    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6568bfda-c7f9-4755-9188-63cfd8d39d75-dshm\") pod \"auth-test-model-f9d728-kserve-746ff56795-vsmwq\" (UID: \"6568bfda-c7f9-4755-9188-63cfd8d39d75\") " pod="ai-tenant-e2e-shared-b-f9d728/auth-test-model-f9d728-kserve-746ff56795-vsmwq"
Jul 02 19:51:18.271339 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:51:18.271320    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6568bfda-c7f9-4755-9188-63cfd8d39d75-tls-certs\") pod \"auth-test-model-f9d728-kserve-746ff56795-vsmwq\" (UID: \"6568bfda-c7f9-4755-9188-63cfd8d39d75\") " pod="ai-tenant-e2e-shared-b-f9d728/auth-test-model-f9d728-kserve-746ff56795-vsmwq"
Jul 02 19:51:18.278103 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:51:18.278078    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbr6v\" (UniqueName: \"kubernetes.io/projected/6568bfda-c7f9-4755-9188-63cfd8d39d75-kube-api-access-jbr6v\") pod \"auth-test-model-f9d728-kserve-746ff56795-vsmwq\" (UID: \"6568bfda-c7f9-4755-9188-63cfd8d39d75\") " pod="ai-tenant-e2e-shared-b-f9d728/auth-test-model-f9d728-kserve-746ff56795-vsmwq"
Jul 02 19:51:18.332142 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:51:18.332104    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f9d728/auth-test-model-f9d728-kserve-746ff56795-vsmwq"
Jul 02 19:51:18.465963 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:51:18.465937    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f9d728/auth-test-model-f9d728-kserve-746ff56795-vsmwq"]
Jul 02 19:51:18.467526 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:51:18.467491    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6568bfda_c7f9_4755_9188_63cfd8d39d75.slice/crio-be2f88cab9b6eeec4f8301aebc85d59497dab4cc4de4010f2af2d1a60f86878f WatchSource:0}: Error finding container be2f88cab9b6eeec4f8301aebc85d59497dab4cc4de4010f2af2d1a60f86878f: Status 404 returned error can't find the container with id be2f88cab9b6eeec4f8301aebc85d59497dab4cc4de4010f2af2d1a60f86878f
Jul 02 19:51:18.922257 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:51:18.922163    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f9d728/auth-test-model-f9d728-kserve-746ff56795-vsmwq" event={"ID":"6568bfda-c7f9-4755-9188-63cfd8d39d75","Type":"ContainerStarted","Data":"35d88ea7b92c1861840359076737381fe402d433a4e612614374e392c6104c1e"}
Jul 02 19:51:18.922257 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:51:18.922210    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f9d728/auth-test-model-f9d728-kserve-746ff56795-vsmwq" event={"ID":"6568bfda-c7f9-4755-9188-63cfd8d39d75","Type":"ContainerStarted","Data":"be2f88cab9b6eeec4f8301aebc85d59497dab4cc4de4010f2af2d1a60f86878f"}
Jul 02 19:51:18.940597 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:51:18.940547    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-f9d728/auth-test-model-f9d728-kserve-746ff56795-vsmwq" podStartSLOduration=1.940531994 podStartE2EDuration="1.940531994s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:51:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:51:18.938826825 +0000 UTC m=+2375.302896739" watchObservedRunningTime="2026-07-02 19:51:18.940531994 +0000 UTC m=+2375.304601942"
Jul 02 19:51:28.333273 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:51:28.333233    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-f9d728/auth-test-model-f9d728-kserve-746ff56795-vsmwq"
Jul 02 19:51:28.333662 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:51:28.333294    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-f9d728/auth-test-model-f9d728-kserve-746ff56795-vsmwq"
Jul 02 19:51:28.346018 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:51:28.345996    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-f9d728/auth-test-model-f9d728-kserve-746ff56795-vsmwq"
Jul 02 19:51:28.979707 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:51:28.979677    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-f9d728/auth-test-model-f9d728-kserve-746ff56795-vsmwq"
Jul 02 19:51:44.154597 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:51:44.154570    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lgt7t_38beee50-e2c9-489e-91cb-f1bfad99fabf/ovn-acl-logging/0.log"
Jul 02 19:51:44.163159 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:51:44.163139    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lgt7t_38beee50-e2c9-489e-91cb-f1bfad99fabf/ovn-acl-logging/0.log"
Jul 02 19:51:54.100219 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:51:54.100187    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:53:16.461015 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:16.460977    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-2fca4d/auth-test-model-2fca4d-kserve-95586f7b7-bz9rr"]
Jul 02 19:53:16.482406 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:16.482380    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:53:17.385383 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:17.385348    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f9d728/auth-test-model-f9d728-kserve-746ff56795-vsmwq"]
Jul 02 19:53:17.407273 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:17.407242    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:53:23.508117 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:23.508080    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-2fca4d/sub-test-model-2fca4d-kserve-74cc47d8c5-9xw9t"]
Jul 02 19:53:23.511374 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:23.511354    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-2fca4d/sub-test-model-2fca4d-kserve-74cc47d8c5-9xw9t"
Jul 02 19:53:23.514303 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:23.514285    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-2fca4d\"/\"sub-test-model-2fca4d-kserve-self-signed-certs\""
Jul 02 19:53:23.521839 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:23.521813    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-2fca4d/sub-test-model-2fca4d-kserve-74cc47d8c5-9xw9t"]
Jul 02 19:53:23.621350 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:23.621312    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7-home\") pod \"sub-test-model-2fca4d-kserve-74cc47d8c5-9xw9t\" (UID: \"19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7\") " pod="ai-tenant-e2e-shared-a-2fca4d/sub-test-model-2fca4d-kserve-74cc47d8c5-9xw9t"
Jul 02 19:53:23.621350 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:23.621350    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7-model-cache\") pod \"sub-test-model-2fca4d-kserve-74cc47d8c5-9xw9t\" (UID: \"19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7\") " pod="ai-tenant-e2e-shared-a-2fca4d/sub-test-model-2fca4d-kserve-74cc47d8c5-9xw9t"
Jul 02 19:53:23.621616 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:23.621370    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7-tmp-dir\") pod \"sub-test-model-2fca4d-kserve-74cc47d8c5-9xw9t\" (UID: \"19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7\") " pod="ai-tenant-e2e-shared-a-2fca4d/sub-test-model-2fca4d-kserve-74cc47d8c5-9xw9t"
Jul 02 19:53:23.621616 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:23.621477    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxfng\" (UniqueName: \"kubernetes.io/projected/19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7-kube-api-access-vxfng\") pod \"sub-test-model-2fca4d-kserve-74cc47d8c5-9xw9t\" (UID: \"19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7\") " pod="ai-tenant-e2e-shared-a-2fca4d/sub-test-model-2fca4d-kserve-74cc47d8c5-9xw9t"
Jul 02 19:53:23.621616 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:23.621585    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7-dshm\") pod \"sub-test-model-2fca4d-kserve-74cc47d8c5-9xw9t\" (UID: \"19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7\") " pod="ai-tenant-e2e-shared-a-2fca4d/sub-test-model-2fca4d-kserve-74cc47d8c5-9xw9t"
Jul 02 19:53:23.621758 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:23.621627    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7-tls-certs\") pod \"sub-test-model-2fca4d-kserve-74cc47d8c5-9xw9t\" (UID: \"19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7\") " pod="ai-tenant-e2e-shared-a-2fca4d/sub-test-model-2fca4d-kserve-74cc47d8c5-9xw9t"
Jul 02 19:53:23.722613 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:23.722580    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7-dshm\") pod \"sub-test-model-2fca4d-kserve-74cc47d8c5-9xw9t\" (UID: \"19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7\") " pod="ai-tenant-e2e-shared-a-2fca4d/sub-test-model-2fca4d-kserve-74cc47d8c5-9xw9t"
Jul 02 19:53:23.722613 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:23.722624    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7-tls-certs\") pod \"sub-test-model-2fca4d-kserve-74cc47d8c5-9xw9t\" (UID: \"19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7\") " pod="ai-tenant-e2e-shared-a-2fca4d/sub-test-model-2fca4d-kserve-74cc47d8c5-9xw9t"
Jul 02 19:53:23.722879 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:23.722666    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7-home\") pod \"sub-test-model-2fca4d-kserve-74cc47d8c5-9xw9t\" (UID: \"19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7\") " pod="ai-tenant-e2e-shared-a-2fca4d/sub-test-model-2fca4d-kserve-74cc47d8c5-9xw9t"
Jul 02 19:53:23.722879 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:23.722681    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7-model-cache\") pod \"sub-test-model-2fca4d-kserve-74cc47d8c5-9xw9t\" (UID: \"19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7\") " pod="ai-tenant-e2e-shared-a-2fca4d/sub-test-model-2fca4d-kserve-74cc47d8c5-9xw9t"
Jul 02 19:53:23.722879 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:23.722698    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7-tmp-dir\") pod \"sub-test-model-2fca4d-kserve-74cc47d8c5-9xw9t\" (UID: \"19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7\") " pod="ai-tenant-e2e-shared-a-2fca4d/sub-test-model-2fca4d-kserve-74cc47d8c5-9xw9t"
Jul 02 19:53:23.722879 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:23.722725    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxfng\" (UniqueName: \"kubernetes.io/projected/19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7-kube-api-access-vxfng\") pod \"sub-test-model-2fca4d-kserve-74cc47d8c5-9xw9t\" (UID: \"19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7\") " pod="ai-tenant-e2e-shared-a-2fca4d/sub-test-model-2fca4d-kserve-74cc47d8c5-9xw9t"
Jul 02 19:53:23.723145 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:23.723088    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7-home\") pod \"sub-test-model-2fca4d-kserve-74cc47d8c5-9xw9t\" (UID: \"19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7\") " pod="ai-tenant-e2e-shared-a-2fca4d/sub-test-model-2fca4d-kserve-74cc47d8c5-9xw9t"
Jul 02 19:53:23.723205 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:23.723150    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7-model-cache\") pod \"sub-test-model-2fca4d-kserve-74cc47d8c5-9xw9t\" (UID: \"19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7\") " pod="ai-tenant-e2e-shared-a-2fca4d/sub-test-model-2fca4d-kserve-74cc47d8c5-9xw9t"
Jul 02 19:53:23.723260 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:23.723214    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7-tmp-dir\") pod \"sub-test-model-2fca4d-kserve-74cc47d8c5-9xw9t\" (UID: \"19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7\") " pod="ai-tenant-e2e-shared-a-2fca4d/sub-test-model-2fca4d-kserve-74cc47d8c5-9xw9t"
Jul 02 19:53:23.725011 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:23.724991    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7-dshm\") pod \"sub-test-model-2fca4d-kserve-74cc47d8c5-9xw9t\" (UID: \"19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7\") " pod="ai-tenant-e2e-shared-a-2fca4d/sub-test-model-2fca4d-kserve-74cc47d8c5-9xw9t"
Jul 02 19:53:23.725285 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:23.725268    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7-tls-certs\") pod \"sub-test-model-2fca4d-kserve-74cc47d8c5-9xw9t\" (UID: \"19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7\") " pod="ai-tenant-e2e-shared-a-2fca4d/sub-test-model-2fca4d-kserve-74cc47d8c5-9xw9t"
Jul 02 19:53:23.731272 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:23.731250    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxfng\" (UniqueName: \"kubernetes.io/projected/19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7-kube-api-access-vxfng\") pod \"sub-test-model-2fca4d-kserve-74cc47d8c5-9xw9t\" (UID: \"19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7\") " pod="ai-tenant-e2e-shared-a-2fca4d/sub-test-model-2fca4d-kserve-74cc47d8c5-9xw9t"
Jul 02 19:53:23.820472 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:23.820364    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-2fca4d/sub-test-model-2fca4d-kserve-74cc47d8c5-9xw9t"
Jul 02 19:53:23.956992 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:23.956963    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-2fca4d/sub-test-model-2fca4d-kserve-74cc47d8c5-9xw9t"]
Jul 02 19:53:23.961194 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:53:23.961168    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod19e6c5f2_34f4_4ff7_b7e4_f9ce4a9b42d7.slice/crio-82fe28def0a05ec8f652f0c48bd9b776ecc21c13d3c5982d077ad177b6bba7e7 WatchSource:0}: Error finding container 82fe28def0a05ec8f652f0c48bd9b776ecc21c13d3c5982d077ad177b6bba7e7: Status 404 returned error can't find the container with id 82fe28def0a05ec8f652f0c48bd9b776ecc21c13d3c5982d077ad177b6bba7e7
Jul 02 19:53:24.489620 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:24.489581    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-2fca4d/sub-test-model-2fca4d-kserve-74cc47d8c5-9xw9t" event={"ID":"19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7","Type":"ContainerStarted","Data":"bab655c33d09af455be67f5d15fc8338b56fcedd22369bbd4056a0d5cbff2b11"}
Jul 02 19:53:24.489620 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:24.489627    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-2fca4d/sub-test-model-2fca4d-kserve-74cc47d8c5-9xw9t" event={"ID":"19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7","Type":"ContainerStarted","Data":"82fe28def0a05ec8f652f0c48bd9b776ecc21c13d3c5982d077ad177b6bba7e7"}
Jul 02 19:53:24.507337 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:24.507282    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-2fca4d/sub-test-model-2fca4d-kserve-74cc47d8c5-9xw9t" podStartSLOduration=1.5072629549999998 podStartE2EDuration="1.507262955s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:53:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:53:24.506476532 +0000 UTC m=+2500.870546456" watchObservedRunningTime="2026-07-02 19:53:24.507262955 +0000 UTC m=+2500.871332873"
Jul 02 19:53:31.481404 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:31.481356    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-2fca4d/auth-test-model-2fca4d-kserve-95586f7b7-bz9rr" podUID="7e189c25-aae2-423e-84db-f379f5dfcbbc" containerName="main" containerID="cri-o://5cbe9f4fe1aa78b99bd23eb5a39a944139ae84083fd731fb11252e1b2d01a26a" gracePeriod=45
Jul 02 19:53:31.734285 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:31.734218    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-2fca4d/auth-test-model-2fca4d-kserve-95586f7b7-bz9rr"
Jul 02 19:53:31.896098 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:31.896067    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e189c25-aae2-423e-84db-f379f5dfcbbc-dshm\") pod \"7e189c25-aae2-423e-84db-f379f5dfcbbc\" (UID: \"7e189c25-aae2-423e-84db-f379f5dfcbbc\") "
Jul 02 19:53:31.896272 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:31.896105    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e189c25-aae2-423e-84db-f379f5dfcbbc-tmp-dir\") pod \"7e189c25-aae2-423e-84db-f379f5dfcbbc\" (UID: \"7e189c25-aae2-423e-84db-f379f5dfcbbc\") "
Jul 02 19:53:31.896272 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:31.896136    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e189c25-aae2-423e-84db-f379f5dfcbbc-tls-certs\") pod \"7e189c25-aae2-423e-84db-f379f5dfcbbc\" (UID: \"7e189c25-aae2-423e-84db-f379f5dfcbbc\") "
Jul 02 19:53:31.896272 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:31.896200    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7txmm\" (UniqueName: \"kubernetes.io/projected/7e189c25-aae2-423e-84db-f379f5dfcbbc-kube-api-access-7txmm\") pod \"7e189c25-aae2-423e-84db-f379f5dfcbbc\" (UID: \"7e189c25-aae2-423e-84db-f379f5dfcbbc\") "
Jul 02 19:53:31.896429 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:31.896279    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e189c25-aae2-423e-84db-f379f5dfcbbc-model-cache\") pod \"7e189c25-aae2-423e-84db-f379f5dfcbbc\" (UID: \"7e189c25-aae2-423e-84db-f379f5dfcbbc\") "
Jul 02 19:53:31.896429 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:31.896316    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e189c25-aae2-423e-84db-f379f5dfcbbc-home\") pod \"7e189c25-aae2-423e-84db-f379f5dfcbbc\" (UID: \"7e189c25-aae2-423e-84db-f379f5dfcbbc\") "
Jul 02 19:53:31.896429 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:31.896398    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e189c25-aae2-423e-84db-f379f5dfcbbc-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7e189c25-aae2-423e-84db-f379f5dfcbbc" (UID: "7e189c25-aae2-423e-84db-f379f5dfcbbc"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:53:31.896581 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:31.896531    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e189c25-aae2-423e-84db-f379f5dfcbbc-model-cache" (OuterVolumeSpecName: "model-cache") pod "7e189c25-aae2-423e-84db-f379f5dfcbbc" (UID: "7e189c25-aae2-423e-84db-f379f5dfcbbc"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:53:31.896636 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:31.896617    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e189c25-aae2-423e-84db-f379f5dfcbbc-home" (OuterVolumeSpecName: "home") pod "7e189c25-aae2-423e-84db-f379f5dfcbbc" (UID: "7e189c25-aae2-423e-84db-f379f5dfcbbc"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:53:31.896690 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:31.896643    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e189c25-aae2-423e-84db-f379f5dfcbbc-model-cache\") on node \"ip-10-0-143-38.ec2.internal\" DevicePath \"\""
Jul 02 19:53:31.896690 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:31.896663    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e189c25-aae2-423e-84db-f379f5dfcbbc-tmp-dir\") on node \"ip-10-0-143-38.ec2.internal\" DevicePath \"\""
Jul 02 19:53:31.898438 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:31.898408    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e189c25-aae2-423e-84db-f379f5dfcbbc-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7e189c25-aae2-423e-84db-f379f5dfcbbc" (UID: "7e189c25-aae2-423e-84db-f379f5dfcbbc"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:53:31.898438 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:31.898412    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e189c25-aae2-423e-84db-f379f5dfcbbc-kube-api-access-7txmm" (OuterVolumeSpecName: "kube-api-access-7txmm") pod "7e189c25-aae2-423e-84db-f379f5dfcbbc" (UID: "7e189c25-aae2-423e-84db-f379f5dfcbbc"). InnerVolumeSpecName "kube-api-access-7txmm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:53:31.898438 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:31.898436    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e189c25-aae2-423e-84db-f379f5dfcbbc-dshm" (OuterVolumeSpecName: "dshm") pod "7e189c25-aae2-423e-84db-f379f5dfcbbc" (UID: "7e189c25-aae2-423e-84db-f379f5dfcbbc"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:53:31.997192 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:31.997103    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7txmm\" (UniqueName: \"kubernetes.io/projected/7e189c25-aae2-423e-84db-f379f5dfcbbc-kube-api-access-7txmm\") on node \"ip-10-0-143-38.ec2.internal\" DevicePath \"\""
Jul 02 19:53:31.997192 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:31.997136    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e189c25-aae2-423e-84db-f379f5dfcbbc-home\") on node \"ip-10-0-143-38.ec2.internal\" DevicePath \"\""
Jul 02 19:53:31.997192 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:31.997147    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e189c25-aae2-423e-84db-f379f5dfcbbc-dshm\") on node \"ip-10-0-143-38.ec2.internal\" DevicePath \"\""
Jul 02 19:53:31.997192 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:31.997155    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e189c25-aae2-423e-84db-f379f5dfcbbc-tls-certs\") on node \"ip-10-0-143-38.ec2.internal\" DevicePath \"\""
Jul 02 19:53:32.406649 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:32.406530    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-f9d728/auth-test-model-f9d728-kserve-746ff56795-vsmwq" podUID="6568bfda-c7f9-4755-9188-63cfd8d39d75" containerName="main" containerID="cri-o://35d88ea7b92c1861840359076737381fe402d433a4e612614374e392c6104c1e" gracePeriod=45
Jul 02 19:53:32.527878 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:32.527839    2562 generic.go:356] "Generic (PLEG): container finished" podID="6568bfda-c7f9-4755-9188-63cfd8d39d75" containerID="35d88ea7b92c1861840359076737381fe402d433a4e612614374e392c6104c1e" exitCode=0
Jul 02 19:53:32.528246 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:32.527908    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f9d728/auth-test-model-f9d728-kserve-746ff56795-vsmwq" event={"ID":"6568bfda-c7f9-4755-9188-63cfd8d39d75","Type":"ContainerDied","Data":"35d88ea7b92c1861840359076737381fe402d433a4e612614374e392c6104c1e"}
Jul 02 19:53:32.529176 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:32.529154    2562 generic.go:356] "Generic (PLEG): container finished" podID="7e189c25-aae2-423e-84db-f379f5dfcbbc" containerID="5cbe9f4fe1aa78b99bd23eb5a39a944139ae84083fd731fb11252e1b2d01a26a" exitCode=0
Jul 02 19:53:32.529302 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:32.529227    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-2fca4d/auth-test-model-2fca4d-kserve-95586f7b7-bz9rr"
Jul 02 19:53:32.529302 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:32.529250    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-2fca4d/auth-test-model-2fca4d-kserve-95586f7b7-bz9rr" event={"ID":"7e189c25-aae2-423e-84db-f379f5dfcbbc","Type":"ContainerDied","Data":"5cbe9f4fe1aa78b99bd23eb5a39a944139ae84083fd731fb11252e1b2d01a26a"}
Jul 02 19:53:32.529302 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:32.529294    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-2fca4d/auth-test-model-2fca4d-kserve-95586f7b7-bz9rr" event={"ID":"7e189c25-aae2-423e-84db-f379f5dfcbbc","Type":"ContainerDied","Data":"37a12f32c4d1f005a87251e87465564cf1a921ffdf02a1fade1fc23d14edf957"}
Jul 02 19:53:32.529459 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:32.529311    2562 scope.go:117] "RemoveContainer" containerID="5cbe9f4fe1aa78b99bd23eb5a39a944139ae84083fd731fb11252e1b2d01a26a"
Jul 02 19:53:32.538041 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:32.538023    2562 scope.go:117] "RemoveContainer" containerID="5cbe9f4fe1aa78b99bd23eb5a39a944139ae84083fd731fb11252e1b2d01a26a"
Jul 02 19:53:32.538328 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:53:32.538306    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5cbe9f4fe1aa78b99bd23eb5a39a944139ae84083fd731fb11252e1b2d01a26a\": container with ID starting with 5cbe9f4fe1aa78b99bd23eb5a39a944139ae84083fd731fb11252e1b2d01a26a not found: ID does not exist" containerID="5cbe9f4fe1aa78b99bd23eb5a39a944139ae84083fd731fb11252e1b2d01a26a"
Jul 02 19:53:32.538412 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:32.538334    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cbe9f4fe1aa78b99bd23eb5a39a944139ae84083fd731fb11252e1b2d01a26a"} err="failed to get container status \"5cbe9f4fe1aa78b99bd23eb5a39a944139ae84083fd731fb11252e1b2d01a26a\": rpc error: code = NotFound desc = could not find container \"5cbe9f4fe1aa78b99bd23eb5a39a944139ae84083fd731fb11252e1b2d01a26a\": container with ID starting with 5cbe9f4fe1aa78b99bd23eb5a39a944139ae84083fd731fb11252e1b2d01a26a not found: ID does not exist"
Jul 02 19:53:32.546559 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:32.546532    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-2fca4d/auth-test-model-2fca4d-kserve-95586f7b7-bz9rr"]
Jul 02 19:53:32.549332 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:32.549265    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-2fca4d/auth-test-model-2fca4d-kserve-95586f7b7-bz9rr"]
Jul 02 19:53:32.651969 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:32.651904    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f9d728/auth-test-model-f9d728-kserve-746ff56795-vsmwq"
Jul 02 19:53:32.702485 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:32.702409    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6568bfda-c7f9-4755-9188-63cfd8d39d75-dshm\") pod \"6568bfda-c7f9-4755-9188-63cfd8d39d75\" (UID: \"6568bfda-c7f9-4755-9188-63cfd8d39d75\") "
Jul 02 19:53:32.702485 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:32.702469    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6568bfda-c7f9-4755-9188-63cfd8d39d75-home\") pod \"6568bfda-c7f9-4755-9188-63cfd8d39d75\" (UID: \"6568bfda-c7f9-4755-9188-63cfd8d39d75\") "
Jul 02 19:53:32.702700 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:32.702489    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6568bfda-c7f9-4755-9188-63cfd8d39d75-tmp-dir\") pod \"6568bfda-c7f9-4755-9188-63cfd8d39d75\" (UID: \"6568bfda-c7f9-4755-9188-63cfd8d39d75\") "
Jul 02 19:53:32.702700 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:32.702528    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6568bfda-c7f9-4755-9188-63cfd8d39d75-model-cache\") pod \"6568bfda-c7f9-4755-9188-63cfd8d39d75\" (UID: \"6568bfda-c7f9-4755-9188-63cfd8d39d75\") "
Jul 02 19:53:32.702700 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:32.702557    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6568bfda-c7f9-4755-9188-63cfd8d39d75-tls-certs\") pod \"6568bfda-c7f9-4755-9188-63cfd8d39d75\" (UID: \"6568bfda-c7f9-4755-9188-63cfd8d39d75\") "
Jul 02 19:53:32.702700 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:32.702586    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jbr6v\" (UniqueName: \"kubernetes.io/projected/6568bfda-c7f9-4755-9188-63cfd8d39d75-kube-api-access-jbr6v\") pod \"6568bfda-c7f9-4755-9188-63cfd8d39d75\" (UID: \"6568bfda-c7f9-4755-9188-63cfd8d39d75\") "
Jul 02 19:53:32.702884 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:32.702759    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6568bfda-c7f9-4755-9188-63cfd8d39d75-home" (OuterVolumeSpecName: "home") pod "6568bfda-c7f9-4755-9188-63cfd8d39d75" (UID: "6568bfda-c7f9-4755-9188-63cfd8d39d75"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:53:32.702884 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:32.702799    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6568bfda-c7f9-4755-9188-63cfd8d39d75-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6568bfda-c7f9-4755-9188-63cfd8d39d75" (UID: "6568bfda-c7f9-4755-9188-63cfd8d39d75"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:53:32.702884 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:32.702813    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6568bfda-c7f9-4755-9188-63cfd8d39d75-model-cache" (OuterVolumeSpecName: "model-cache") pod "6568bfda-c7f9-4755-9188-63cfd8d39d75" (UID: "6568bfda-c7f9-4755-9188-63cfd8d39d75"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:53:32.704766 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:32.704742    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6568bfda-c7f9-4755-9188-63cfd8d39d75-dshm" (OuterVolumeSpecName: "dshm") pod "6568bfda-c7f9-4755-9188-63cfd8d39d75" (UID: "6568bfda-c7f9-4755-9188-63cfd8d39d75"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:53:32.704880 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:32.704860    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6568bfda-c7f9-4755-9188-63cfd8d39d75-kube-api-access-jbr6v" (OuterVolumeSpecName: "kube-api-access-jbr6v") pod "6568bfda-c7f9-4755-9188-63cfd8d39d75" (UID: "6568bfda-c7f9-4755-9188-63cfd8d39d75"). InnerVolumeSpecName "kube-api-access-jbr6v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:53:32.704880 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:32.704862    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6568bfda-c7f9-4755-9188-63cfd8d39d75-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6568bfda-c7f9-4755-9188-63cfd8d39d75" (UID: "6568bfda-c7f9-4755-9188-63cfd8d39d75"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:53:32.803401 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:32.803367    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6568bfda-c7f9-4755-9188-63cfd8d39d75-dshm\") on node \"ip-10-0-143-38.ec2.internal\" DevicePath \"\""
Jul 02 19:53:32.803401 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:32.803395    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6568bfda-c7f9-4755-9188-63cfd8d39d75-home\") on node \"ip-10-0-143-38.ec2.internal\" DevicePath \"\""
Jul 02 19:53:32.803605 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:32.803420    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6568bfda-c7f9-4755-9188-63cfd8d39d75-tmp-dir\") on node \"ip-10-0-143-38.ec2.internal\" DevicePath \"\""
Jul 02 19:53:32.803605 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:32.803430    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6568bfda-c7f9-4755-9188-63cfd8d39d75-model-cache\") on node \"ip-10-0-143-38.ec2.internal\" DevicePath \"\""
Jul 02 19:53:32.803605 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:32.803439    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6568bfda-c7f9-4755-9188-63cfd8d39d75-tls-certs\") on node \"ip-10-0-143-38.ec2.internal\" DevicePath \"\""
Jul 02 19:53:32.803605 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:32.803448    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jbr6v\" (UniqueName: \"kubernetes.io/projected/6568bfda-c7f9-4755-9188-63cfd8d39d75-kube-api-access-jbr6v\") on node \"ip-10-0-143-38.ec2.internal\" DevicePath \"\""
Jul 02 19:53:33.535959 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:33.535906    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f9d728/auth-test-model-f9d728-kserve-746ff56795-vsmwq" event={"ID":"6568bfda-c7f9-4755-9188-63cfd8d39d75","Type":"ContainerDied","Data":"be2f88cab9b6eeec4f8301aebc85d59497dab4cc4de4010f2af2d1a60f86878f"}
Jul 02 19:53:33.535959 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:33.535957    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f9d728/auth-test-model-f9d728-kserve-746ff56795-vsmwq"
Jul 02 19:53:33.536475 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:33.535982    2562 scope.go:117] "RemoveContainer" containerID="35d88ea7b92c1861840359076737381fe402d433a4e612614374e392c6104c1e"
Jul 02 19:53:33.558878 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:33.558856    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f9d728/auth-test-model-f9d728-kserve-746ff56795-vsmwq"]
Jul 02 19:53:33.563689 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:33.563666    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-f9d728/auth-test-model-f9d728-kserve-746ff56795-vsmwq"]
Jul 02 19:53:33.821309 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:33.821232    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-2fca4d/sub-test-model-2fca4d-kserve-74cc47d8c5-9xw9t"
Jul 02 19:53:33.821309 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:33.821275    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-2fca4d/sub-test-model-2fca4d-kserve-74cc47d8c5-9xw9t"
Jul 02 19:53:33.834323 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:33.834296    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-2fca4d/sub-test-model-2fca4d-kserve-74cc47d8c5-9xw9t"
Jul 02 19:53:34.118591 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:34.118518    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6568bfda-c7f9-4755-9188-63cfd8d39d75" path="/var/lib/kubelet/pods/6568bfda-c7f9-4755-9188-63cfd8d39d75/volumes"
Jul 02 19:53:34.118884 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:34.118870    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e189c25-aae2-423e-84db-f379f5dfcbbc" path="/var/lib/kubelet/pods/7e189c25-aae2-423e-84db-f379f5dfcbbc/volumes"
Jul 02 19:53:34.553398 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:34.553371    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-2fca4d/sub-test-model-2fca4d-kserve-74cc47d8c5-9xw9t"
Jul 02 19:53:47.726334 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:47.726301    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:53:58.699521 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:58.699486    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-f9d728/sub-test-model-f9d728-kserve-bcf89b7ff-8pfmm"]
Jul 02 19:53:58.699969 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:58.699819    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6568bfda-c7f9-4755-9188-63cfd8d39d75" containerName="main"
Jul 02 19:53:58.699969 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:58.699829    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="6568bfda-c7f9-4755-9188-63cfd8d39d75" containerName="main"
Jul 02 19:53:58.699969 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:58.699841    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e189c25-aae2-423e-84db-f379f5dfcbbc" containerName="main"
Jul 02 19:53:58.699969 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:58.699847    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e189c25-aae2-423e-84db-f379f5dfcbbc" containerName="main"
Jul 02 19:53:58.699969 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:58.699901    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="6568bfda-c7f9-4755-9188-63cfd8d39d75" containerName="main"
Jul 02 19:53:58.699969 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:58.699909    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e189c25-aae2-423e-84db-f379f5dfcbbc" containerName="main"
Jul 02 19:53:58.702652 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:58.702635    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f9d728/sub-test-model-f9d728-kserve-bcf89b7ff-8pfmm"
Jul 02 19:53:58.705694 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:58.705672    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f9d728\"/\"kube-root-ca.crt\""
Jul 02 19:53:58.705825 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:58.705694    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f9d728\"/\"openshift-service-ca.crt\""
Jul 02 19:53:58.706817 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:58.706790    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f9d728\"/\"default-dockercfg-c59xm\""
Jul 02 19:53:58.706956 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:58.706939    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f9d728\"/\"sub-test-model-f9d728-kserve-self-signed-certs\""
Jul 02 19:53:58.712372 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:58.712350    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f9d728/sub-test-model-f9d728-kserve-bcf89b7ff-8pfmm"]
Jul 02 19:53:58.729680 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:58.729651    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:53:58.823772 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:58.823736    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4eaec2c-f215-4fb2-9d82-23518c19a1d4-tmp-dir\") pod \"sub-test-model-f9d728-kserve-bcf89b7ff-8pfmm\" (UID: \"a4eaec2c-f215-4fb2-9d82-23518c19a1d4\") " pod="ai-tenant-e2e-shared-b-f9d728/sub-test-model-f9d728-kserve-bcf89b7ff-8pfmm"
Jul 02 19:53:58.823772 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:58.823776    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a4eaec2c-f215-4fb2-9d82-23518c19a1d4-model-cache\") pod \"sub-test-model-f9d728-kserve-bcf89b7ff-8pfmm\" (UID: \"a4eaec2c-f215-4fb2-9d82-23518c19a1d4\") " pod="ai-tenant-e2e-shared-b-f9d728/sub-test-model-f9d728-kserve-bcf89b7ff-8pfmm"
Jul 02 19:53:58.824052 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:58.823801    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxb5m\" (UniqueName: \"kubernetes.io/projected/a4eaec2c-f215-4fb2-9d82-23518c19a1d4-kube-api-access-xxb5m\") pod \"sub-test-model-f9d728-kserve-bcf89b7ff-8pfmm\" (UID: \"a4eaec2c-f215-4fb2-9d82-23518c19a1d4\") " pod="ai-tenant-e2e-shared-b-f9d728/sub-test-model-f9d728-kserve-bcf89b7ff-8pfmm"
Jul 02 19:53:58.824052 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:58.823909    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4eaec2c-f215-4fb2-9d82-23518c19a1d4-tls-certs\") pod \"sub-test-model-f9d728-kserve-bcf89b7ff-8pfmm\" (UID: \"a4eaec2c-f215-4fb2-9d82-23518c19a1d4\") " pod="ai-tenant-e2e-shared-b-f9d728/sub-test-model-f9d728-kserve-bcf89b7ff-8pfmm"
Jul 02 19:53:58.824052 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:58.823975    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a4eaec2c-f215-4fb2-9d82-23518c19a1d4-home\") pod \"sub-test-model-f9d728-kserve-bcf89b7ff-8pfmm\" (UID: \"a4eaec2c-f215-4fb2-9d82-23518c19a1d4\") " pod="ai-tenant-e2e-shared-b-f9d728/sub-test-model-f9d728-kserve-bcf89b7ff-8pfmm"
Jul 02 19:53:58.824052 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:58.823995    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a4eaec2c-f215-4fb2-9d82-23518c19a1d4-dshm\") pod \"sub-test-model-f9d728-kserve-bcf89b7ff-8pfmm\" (UID: \"a4eaec2c-f215-4fb2-9d82-23518c19a1d4\") " pod="ai-tenant-e2e-shared-b-f9d728/sub-test-model-f9d728-kserve-bcf89b7ff-8pfmm"
Jul 02 19:53:58.925437 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:58.925401    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4eaec2c-f215-4fb2-9d82-23518c19a1d4-tmp-dir\") pod \"sub-test-model-f9d728-kserve-bcf89b7ff-8pfmm\" (UID: \"a4eaec2c-f215-4fb2-9d82-23518c19a1d4\") " pod="ai-tenant-e2e-shared-b-f9d728/sub-test-model-f9d728-kserve-bcf89b7ff-8pfmm"
Jul 02 19:53:58.925437 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:58.925436    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a4eaec2c-f215-4fb2-9d82-23518c19a1d4-model-cache\") pod \"sub-test-model-f9d728-kserve-bcf89b7ff-8pfmm\" (UID: \"a4eaec2c-f215-4fb2-9d82-23518c19a1d4\") " pod="ai-tenant-e2e-shared-b-f9d728/sub-test-model-f9d728-kserve-bcf89b7ff-8pfmm"
Jul 02 19:53:58.925685 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:58.925452    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxb5m\" (UniqueName: \"kubernetes.io/projected/a4eaec2c-f215-4fb2-9d82-23518c19a1d4-kube-api-access-xxb5m\") pod \"sub-test-model-f9d728-kserve-bcf89b7ff-8pfmm\" (UID: \"a4eaec2c-f215-4fb2-9d82-23518c19a1d4\") " pod="ai-tenant-e2e-shared-b-f9d728/sub-test-model-f9d728-kserve-bcf89b7ff-8pfmm"
Jul 02 19:53:58.925685 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:58.925508    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4eaec2c-f215-4fb2-9d82-23518c19a1d4-tls-certs\") pod \"sub-test-model-f9d728-kserve-bcf89b7ff-8pfmm\" (UID: \"a4eaec2c-f215-4fb2-9d82-23518c19a1d4\") " pod="ai-tenant-e2e-shared-b-f9d728/sub-test-model-f9d728-kserve-bcf89b7ff-8pfmm"
Jul 02 19:53:58.925685 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:58.925540    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a4eaec2c-f215-4fb2-9d82-23518c19a1d4-home\") pod \"sub-test-model-f9d728-kserve-bcf89b7ff-8pfmm\" (UID: \"a4eaec2c-f215-4fb2-9d82-23518c19a1d4\") " pod="ai-tenant-e2e-shared-b-f9d728/sub-test-model-f9d728-kserve-bcf89b7ff-8pfmm"
Jul 02 19:53:58.925685 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:58.925555    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a4eaec2c-f215-4fb2-9d82-23518c19a1d4-dshm\") pod \"sub-test-model-f9d728-kserve-bcf89b7ff-8pfmm\" (UID: \"a4eaec2c-f215-4fb2-9d82-23518c19a1d4\") " pod="ai-tenant-e2e-shared-b-f9d728/sub-test-model-f9d728-kserve-bcf89b7ff-8pfmm"
Jul 02 19:53:58.925904 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:58.925801    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4eaec2c-f215-4fb2-9d82-23518c19a1d4-tmp-dir\") pod \"sub-test-model-f9d728-kserve-bcf89b7ff-8pfmm\" (UID: \"a4eaec2c-f215-4fb2-9d82-23518c19a1d4\") " pod="ai-tenant-e2e-shared-b-f9d728/sub-test-model-f9d728-kserve-bcf89b7ff-8pfmm"
Jul 02 19:53:58.925904 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:58.925876    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a4eaec2c-f215-4fb2-9d82-23518c19a1d4-model-cache\") pod \"sub-test-model-f9d728-kserve-bcf89b7ff-8pfmm\" (UID: \"a4eaec2c-f215-4fb2-9d82-23518c19a1d4\") " pod="ai-tenant-e2e-shared-b-f9d728/sub-test-model-f9d728-kserve-bcf89b7ff-8pfmm"
Jul 02 19:53:58.926021 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:58.926010    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a4eaec2c-f215-4fb2-9d82-23518c19a1d4-home\") pod \"sub-test-model-f9d728-kserve-bcf89b7ff-8pfmm\" (UID: \"a4eaec2c-f215-4fb2-9d82-23518c19a1d4\") " pod="ai-tenant-e2e-shared-b-f9d728/sub-test-model-f9d728-kserve-bcf89b7ff-8pfmm"
Jul 02 19:53:58.927957 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:58.927934    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a4eaec2c-f215-4fb2-9d82-23518c19a1d4-dshm\") pod \"sub-test-model-f9d728-kserve-bcf89b7ff-8pfmm\" (UID: \"a4eaec2c-f215-4fb2-9d82-23518c19a1d4\") " pod="ai-tenant-e2e-shared-b-f9d728/sub-test-model-f9d728-kserve-bcf89b7ff-8pfmm"
Jul 02 19:53:58.928191 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:58.928175    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4eaec2c-f215-4fb2-9d82-23518c19a1d4-tls-certs\") pod \"sub-test-model-f9d728-kserve-bcf89b7ff-8pfmm\" (UID: \"a4eaec2c-f215-4fb2-9d82-23518c19a1d4\") " pod="ai-tenant-e2e-shared-b-f9d728/sub-test-model-f9d728-kserve-bcf89b7ff-8pfmm"
Jul 02 19:53:58.934745 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:58.934723    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxb5m\" (UniqueName: \"kubernetes.io/projected/a4eaec2c-f215-4fb2-9d82-23518c19a1d4-kube-api-access-xxb5m\") pod \"sub-test-model-f9d728-kserve-bcf89b7ff-8pfmm\" (UID: \"a4eaec2c-f215-4fb2-9d82-23518c19a1d4\") " pod="ai-tenant-e2e-shared-b-f9d728/sub-test-model-f9d728-kserve-bcf89b7ff-8pfmm"
Jul 02 19:53:59.012326 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:59.012285    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f9d728/sub-test-model-f9d728-kserve-bcf89b7ff-8pfmm"
Jul 02 19:53:59.149617 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:59.149593    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f9d728/sub-test-model-f9d728-kserve-bcf89b7ff-8pfmm"]
Jul 02 19:53:59.151940 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:53:59.151892    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda4eaec2c_f215_4fb2_9d82_23518c19a1d4.slice/crio-882d06cd84a87c4511b81117ff98dc1056f9e9ad816e9ead0b1e0b7c1f35224b WatchSource:0}: Error finding container 882d06cd84a87c4511b81117ff98dc1056f9e9ad816e9ead0b1e0b7c1f35224b: Status 404 returned error can't find the container with id 882d06cd84a87c4511b81117ff98dc1056f9e9ad816e9ead0b1e0b7c1f35224b
Jul 02 19:53:59.654096 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:59.654058    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f9d728/sub-test-model-f9d728-kserve-bcf89b7ff-8pfmm" event={"ID":"a4eaec2c-f215-4fb2-9d82-23518c19a1d4","Type":"ContainerStarted","Data":"ff3aebf76fc486f557deb423347683b15d02225047b181e119d537d413c6a9e4"}
Jul 02 19:53:59.654246 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:59.654103    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f9d728/sub-test-model-f9d728-kserve-bcf89b7ff-8pfmm" event={"ID":"a4eaec2c-f215-4fb2-9d82-23518c19a1d4","Type":"ContainerStarted","Data":"882d06cd84a87c4511b81117ff98dc1056f9e9ad816e9ead0b1e0b7c1f35224b"}
Jul 02 19:53:59.672386 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:53:59.672344    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-f9d728/sub-test-model-f9d728-kserve-bcf89b7ff-8pfmm" podStartSLOduration=1.6723287359999999 podStartE2EDuration="1.672328736s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:53:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:53:59.670161234 +0000 UTC m=+2536.034231147" watchObservedRunningTime="2026-07-02 19:53:59.672328736 +0000 UTC m=+2536.036398649"
Jul 02 19:54:01.950299 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:01.950261    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:54:02.011709 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:02.011677    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:54:09.012650 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:09.012608    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-f9d728/sub-test-model-f9d728-kserve-bcf89b7ff-8pfmm"
Jul 02 19:54:09.013178 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:09.012669    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-f9d728/sub-test-model-f9d728-kserve-bcf89b7ff-8pfmm"
Jul 02 19:54:09.025319 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:09.025294    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-f9d728/sub-test-model-f9d728-kserve-bcf89b7ff-8pfmm"
Jul 02 19:54:09.713979 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:09.713951    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-f9d728/sub-test-model-f9d728-kserve-bcf89b7ff-8pfmm"
Jul 02 19:54:39.055601 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:39.055565    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:54:42.488255 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:42.488224    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-2fca4d/sub-test-model-2fca4d-kserve-74cc47d8c5-9xw9t"]
Jul 02 19:54:42.512369 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:42.512340    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:54:43.383386 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:43.383357    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f9d728/sub-test-model-f9d728-kserve-bcf89b7ff-8pfmm"]
Jul 02 19:54:43.403938 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:43.403883    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:54:46.108752 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:46.108720    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-2fca4d/rate-test-model-2fca4d-kserve-5b8cfd847f-h26x7"]
Jul 02 19:54:46.112394 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:46.112375    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-2fca4d/rate-test-model-2fca4d-kserve-5b8cfd847f-h26x7"
Jul 02 19:54:46.115329 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:46.115309    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-2fca4d\"/\"rate-test-model-2fca4d-kserve-self-signed-certs\""
Jul 02 19:54:46.121833 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:46.121811    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-2fca4d/rate-test-model-2fca4d-kserve-5b8cfd847f-h26x7"]
Jul 02 19:54:46.135977 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:46.135890    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:54:46.252649 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:46.252613    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3-dshm\") pod \"rate-test-model-2fca4d-kserve-5b8cfd847f-h26x7\" (UID: \"5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3\") " pod="ai-tenant-e2e-shared-a-2fca4d/rate-test-model-2fca4d-kserve-5b8cfd847f-h26x7"
Jul 02 19:54:46.252649 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:46.252646    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzp4p\" (UniqueName: \"kubernetes.io/projected/5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3-kube-api-access-pzp4p\") pod \"rate-test-model-2fca4d-kserve-5b8cfd847f-h26x7\" (UID: \"5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3\") " pod="ai-tenant-e2e-shared-a-2fca4d/rate-test-model-2fca4d-kserve-5b8cfd847f-h26x7"
Jul 02 19:54:46.252844 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:46.252674    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3-model-cache\") pod \"rate-test-model-2fca4d-kserve-5b8cfd847f-h26x7\" (UID: \"5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3\") " pod="ai-tenant-e2e-shared-a-2fca4d/rate-test-model-2fca4d-kserve-5b8cfd847f-h26x7"
Jul 02 19:54:46.252844 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:46.252771    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3-home\") pod \"rate-test-model-2fca4d-kserve-5b8cfd847f-h26x7\" (UID: \"5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3\") " pod="ai-tenant-e2e-shared-a-2fca4d/rate-test-model-2fca4d-kserve-5b8cfd847f-h26x7"
Jul 02 19:54:46.252844 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:46.252812    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3-tmp-dir\") pod \"rate-test-model-2fca4d-kserve-5b8cfd847f-h26x7\" (UID: \"5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3\") " pod="ai-tenant-e2e-shared-a-2fca4d/rate-test-model-2fca4d-kserve-5b8cfd847f-h26x7"
Jul 02 19:54:46.252844 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:46.252836    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3-tls-certs\") pod \"rate-test-model-2fca4d-kserve-5b8cfd847f-h26x7\" (UID: \"5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3\") " pod="ai-tenant-e2e-shared-a-2fca4d/rate-test-model-2fca4d-kserve-5b8cfd847f-h26x7"
Jul 02 19:54:46.353650 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:46.353614    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3-dshm\") pod \"rate-test-model-2fca4d-kserve-5b8cfd847f-h26x7\" (UID: \"5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3\") " pod="ai-tenant-e2e-shared-a-2fca4d/rate-test-model-2fca4d-kserve-5b8cfd847f-h26x7"
Jul 02 19:54:46.353650 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:46.353652    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzp4p\" (UniqueName: \"kubernetes.io/projected/5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3-kube-api-access-pzp4p\") pod \"rate-test-model-2fca4d-kserve-5b8cfd847f-h26x7\" (UID: \"5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3\") " pod="ai-tenant-e2e-shared-a-2fca4d/rate-test-model-2fca4d-kserve-5b8cfd847f-h26x7"
Jul 02 19:54:46.353890 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:46.353689    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3-model-cache\") pod \"rate-test-model-2fca4d-kserve-5b8cfd847f-h26x7\" (UID: \"5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3\") " pod="ai-tenant-e2e-shared-a-2fca4d/rate-test-model-2fca4d-kserve-5b8cfd847f-h26x7"
Jul 02 19:54:46.353890 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:46.353734    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3-home\") pod \"rate-test-model-2fca4d-kserve-5b8cfd847f-h26x7\" (UID: \"5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3\") " pod="ai-tenant-e2e-shared-a-2fca4d/rate-test-model-2fca4d-kserve-5b8cfd847f-h26x7"
Jul 02 19:54:46.353890 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:46.353766    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3-tmp-dir\") pod \"rate-test-model-2fca4d-kserve-5b8cfd847f-h26x7\" (UID: \"5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3\") " pod="ai-tenant-e2e-shared-a-2fca4d/rate-test-model-2fca4d-kserve-5b8cfd847f-h26x7"
Jul 02 19:54:46.353890 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:46.353793    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3-tls-certs\") pod \"rate-test-model-2fca4d-kserve-5b8cfd847f-h26x7\" (UID: \"5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3\") " pod="ai-tenant-e2e-shared-a-2fca4d/rate-test-model-2fca4d-kserve-5b8cfd847f-h26x7"
Jul 02 19:54:46.354190 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:46.354167    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3-model-cache\") pod \"rate-test-model-2fca4d-kserve-5b8cfd847f-h26x7\" (UID: \"5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3\") " pod="ai-tenant-e2e-shared-a-2fca4d/rate-test-model-2fca4d-kserve-5b8cfd847f-h26x7"
Jul 02 19:54:46.354256 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:46.354171    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3-home\") pod \"rate-test-model-2fca4d-kserve-5b8cfd847f-h26x7\" (UID: \"5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3\") " pod="ai-tenant-e2e-shared-a-2fca4d/rate-test-model-2fca4d-kserve-5b8cfd847f-h26x7"
Jul 02 19:54:46.354256 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:46.354212    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3-tmp-dir\") pod \"rate-test-model-2fca4d-kserve-5b8cfd847f-h26x7\" (UID: \"5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3\") " pod="ai-tenant-e2e-shared-a-2fca4d/rate-test-model-2fca4d-kserve-5b8cfd847f-h26x7"
Jul 02 19:54:46.356067 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:46.356046    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3-dshm\") pod \"rate-test-model-2fca4d-kserve-5b8cfd847f-h26x7\" (UID: \"5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3\") " pod="ai-tenant-e2e-shared-a-2fca4d/rate-test-model-2fca4d-kserve-5b8cfd847f-h26x7"
Jul 02 19:54:46.356318 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:46.356302    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3-tls-certs\") pod \"rate-test-model-2fca4d-kserve-5b8cfd847f-h26x7\" (UID: \"5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3\") " pod="ai-tenant-e2e-shared-a-2fca4d/rate-test-model-2fca4d-kserve-5b8cfd847f-h26x7"
Jul 02 19:54:46.362803 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:46.362746    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzp4p\" (UniqueName: \"kubernetes.io/projected/5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3-kube-api-access-pzp4p\") pod \"rate-test-model-2fca4d-kserve-5b8cfd847f-h26x7\" (UID: \"5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3\") " pod="ai-tenant-e2e-shared-a-2fca4d/rate-test-model-2fca4d-kserve-5b8cfd847f-h26x7"
Jul 02 19:54:46.422479 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:46.422442    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-2fca4d/rate-test-model-2fca4d-kserve-5b8cfd847f-h26x7"
Jul 02 19:54:46.566036 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:46.566011    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-2fca4d/rate-test-model-2fca4d-kserve-5b8cfd847f-h26x7"]
Jul 02 19:54:46.568401 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:54:46.568376    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5f99ca70_56ef_4fe4_bea5_6dc6c370b3f3.slice/crio-42b007573969c2173cc474dc277ece0be9eb71a6a1dc95a5d8826275396227bd WatchSource:0}: Error finding container 42b007573969c2173cc474dc277ece0be9eb71a6a1dc95a5d8826275396227bd: Status 404 returned error can't find the container with id 42b007573969c2173cc474dc277ece0be9eb71a6a1dc95a5d8826275396227bd
Jul 02 19:54:46.876264 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:46.876179    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-2fca4d/rate-test-model-2fca4d-kserve-5b8cfd847f-h26x7" event={"ID":"5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3","Type":"ContainerStarted","Data":"f57d73dd50cb97d8a87ecc79ede635adb213ef1a67c8faf739290e760db10762"}
Jul 02 19:54:46.876264 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:46.876223    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-2fca4d/rate-test-model-2fca4d-kserve-5b8cfd847f-h26x7" event={"ID":"5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3","Type":"ContainerStarted","Data":"42b007573969c2173cc474dc277ece0be9eb71a6a1dc95a5d8826275396227bd"}
Jul 02 19:54:46.894721 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:46.894660    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-2fca4d/rate-test-model-2fca4d-kserve-5b8cfd847f-h26x7" podStartSLOduration=0.894644402 podStartE2EDuration="894.644402ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:54:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:54:46.892959462 +0000 UTC m=+2583.257029376" watchObservedRunningTime="2026-07-02 19:54:46.894644402 +0000 UTC m=+2583.258714315"
Jul 02 19:54:56.422851 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:56.422813    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-2fca4d/rate-test-model-2fca4d-kserve-5b8cfd847f-h26x7"
Jul 02 19:54:56.422851 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:56.422860    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-2fca4d/rate-test-model-2fca4d-kserve-5b8cfd847f-h26x7"
Jul 02 19:54:56.435212 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:56.435183    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-2fca4d/rate-test-model-2fca4d-kserve-5b8cfd847f-h26x7"
Jul 02 19:54:56.931886 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:56.931858    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-2fca4d/rate-test-model-2fca4d-kserve-5b8cfd847f-h26x7"
Jul 02 19:54:57.508278 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:57.508239    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-2fca4d/sub-test-model-2fca4d-kserve-74cc47d8c5-9xw9t" podUID="19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7" containerName="main" containerID="cri-o://bab655c33d09af455be67f5d15fc8338b56fcedd22369bbd4056a0d5cbff2b11" gracePeriod=45
Jul 02 19:54:57.765470 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:57.765407    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-2fca4d/sub-test-model-2fca4d-kserve-74cc47d8c5-9xw9t"
Jul 02 19:54:57.858650 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:57.858616    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vxfng\" (UniqueName: \"kubernetes.io/projected/19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7-kube-api-access-vxfng\") pod \"19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7\" (UID: \"19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7\") "
Jul 02 19:54:57.858650 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:57.858657    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7-model-cache\") pod \"19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7\" (UID: \"19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7\") "
Jul 02 19:54:57.858867 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:57.858718    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7-dshm\") pod \"19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7\" (UID: \"19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7\") "
Jul 02 19:54:57.858867 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:57.858757    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7-home\") pod \"19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7\" (UID: \"19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7\") "
Jul 02 19:54:57.858867 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:57.858777    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7-tmp-dir\") pod \"19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7\" (UID: \"19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7\") "
Jul 02 19:54:57.858867 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:57.858809    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7-tls-certs\") pod \"19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7\" (UID: \"19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7\") "
Jul 02 19:54:57.859086 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:57.859015    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7-home" (OuterVolumeSpecName: "home") pod "19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7" (UID: "19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:54:57.859086 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:57.859024    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7-model-cache" (OuterVolumeSpecName: "model-cache") pod "19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7" (UID: "19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:54:57.859210 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:57.859137    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7" (UID: "19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:54:57.860984 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:57.860958    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7-dshm" (OuterVolumeSpecName: "dshm") pod "19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7" (UID: "19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:54:57.860984 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:57.860961    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7-kube-api-access-vxfng" (OuterVolumeSpecName: "kube-api-access-vxfng") pod "19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7" (UID: "19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7"). InnerVolumeSpecName "kube-api-access-vxfng". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:54:57.861122 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:57.861086    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7" (UID: "19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:54:57.926704 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:57.926670    2562 generic.go:356] "Generic (PLEG): container finished" podID="19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7" containerID="bab655c33d09af455be67f5d15fc8338b56fcedd22369bbd4056a0d5cbff2b11" exitCode=0
Jul 02 19:54:57.926886 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:57.926724    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-2fca4d/sub-test-model-2fca4d-kserve-74cc47d8c5-9xw9t"
Jul 02 19:54:57.926886 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:57.926755    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-2fca4d/sub-test-model-2fca4d-kserve-74cc47d8c5-9xw9t" event={"ID":"19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7","Type":"ContainerDied","Data":"bab655c33d09af455be67f5d15fc8338b56fcedd22369bbd4056a0d5cbff2b11"}
Jul 02 19:54:57.926886 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:57.926791    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-2fca4d/sub-test-model-2fca4d-kserve-74cc47d8c5-9xw9t" event={"ID":"19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7","Type":"ContainerDied","Data":"82fe28def0a05ec8f652f0c48bd9b776ecc21c13d3c5982d077ad177b6bba7e7"}
Jul 02 19:54:57.926886 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:57.926808    2562 scope.go:117] "RemoveContainer" containerID="bab655c33d09af455be67f5d15fc8338b56fcedd22369bbd4056a0d5cbff2b11"
Jul 02 19:54:57.935531 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:57.935515    2562 scope.go:117] "RemoveContainer" containerID="bab655c33d09af455be67f5d15fc8338b56fcedd22369bbd4056a0d5cbff2b11"
Jul 02 19:54:57.935759 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:54:57.935741    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bab655c33d09af455be67f5d15fc8338b56fcedd22369bbd4056a0d5cbff2b11\": container with ID starting with bab655c33d09af455be67f5d15fc8338b56fcedd22369bbd4056a0d5cbff2b11 not found: ID does not exist" containerID="bab655c33d09af455be67f5d15fc8338b56fcedd22369bbd4056a0d5cbff2b11"
Jul 02 19:54:57.935815 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:57.935771    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bab655c33d09af455be67f5d15fc8338b56fcedd22369bbd4056a0d5cbff2b11"} err="failed to get container status \"bab655c33d09af455be67f5d15fc8338b56fcedd22369bbd4056a0d5cbff2b11\": rpc error: code = NotFound desc = could not find container \"bab655c33d09af455be67f5d15fc8338b56fcedd22369bbd4056a0d5cbff2b11\": container with ID starting with bab655c33d09af455be67f5d15fc8338b56fcedd22369bbd4056a0d5cbff2b11 not found: ID does not exist"
Jul 02 19:54:57.948330 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:57.948298    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-2fca4d/sub-test-model-2fca4d-kserve-74cc47d8c5-9xw9t"]
Jul 02 19:54:57.953986 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:57.953965    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-2fca4d/sub-test-model-2fca4d-kserve-74cc47d8c5-9xw9t"]
Jul 02 19:54:57.959700 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:57.959681    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7-dshm\") on node \"ip-10-0-143-38.ec2.internal\" DevicePath \"\""
Jul 02 19:54:57.959764 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:57.959702    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7-home\") on node \"ip-10-0-143-38.ec2.internal\" DevicePath \"\""
Jul 02 19:54:57.959764 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:57.959711    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7-tmp-dir\") on node \"ip-10-0-143-38.ec2.internal\" DevicePath \"\""
Jul 02 19:54:57.959764 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:57.959720    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7-tls-certs\") on node \"ip-10-0-143-38.ec2.internal\" DevicePath \"\""
Jul 02 19:54:57.959764 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:57.959730    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vxfng\" (UniqueName: \"kubernetes.io/projected/19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7-kube-api-access-vxfng\") on node \"ip-10-0-143-38.ec2.internal\" DevicePath \"\""
Jul 02 19:54:57.959764 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:57.959745    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7-model-cache\") on node \"ip-10-0-143-38.ec2.internal\" DevicePath \"\""
Jul 02 19:54:58.118514 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:58.118435    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7" path="/var/lib/kubelet/pods/19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7/volumes"
Jul 02 19:54:58.403662 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:58.403567    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-f9d728/sub-test-model-f9d728-kserve-bcf89b7ff-8pfmm" podUID="a4eaec2c-f215-4fb2-9d82-23518c19a1d4" containerName="main" containerID="cri-o://ff3aebf76fc486f557deb423347683b15d02225047b181e119d537d413c6a9e4" gracePeriod=45
Jul 02 19:54:58.663127 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:58.663067    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f9d728/sub-test-model-f9d728-kserve-bcf89b7ff-8pfmm"
Jul 02 19:54:58.767593 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:58.767562    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a4eaec2c-f215-4fb2-9d82-23518c19a1d4-model-cache\") pod \"a4eaec2c-f215-4fb2-9d82-23518c19a1d4\" (UID: \"a4eaec2c-f215-4fb2-9d82-23518c19a1d4\") "
Jul 02 19:54:58.767769 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:58.767606    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4eaec2c-f215-4fb2-9d82-23518c19a1d4-tls-certs\") pod \"a4eaec2c-f215-4fb2-9d82-23518c19a1d4\" (UID: \"a4eaec2c-f215-4fb2-9d82-23518c19a1d4\") "
Jul 02 19:54:58.767769 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:58.767659    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xxb5m\" (UniqueName: \"kubernetes.io/projected/a4eaec2c-f215-4fb2-9d82-23518c19a1d4-kube-api-access-xxb5m\") pod \"a4eaec2c-f215-4fb2-9d82-23518c19a1d4\" (UID: \"a4eaec2c-f215-4fb2-9d82-23518c19a1d4\") "
Jul 02 19:54:58.767769 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:58.767697    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4eaec2c-f215-4fb2-9d82-23518c19a1d4-tmp-dir\") pod \"a4eaec2c-f215-4fb2-9d82-23518c19a1d4\" (UID: \"a4eaec2c-f215-4fb2-9d82-23518c19a1d4\") "
Jul 02 19:54:58.767769 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:58.767725    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a4eaec2c-f215-4fb2-9d82-23518c19a1d4-home\") pod \"a4eaec2c-f215-4fb2-9d82-23518c19a1d4\" (UID: \"a4eaec2c-f215-4fb2-9d82-23518c19a1d4\") "
Jul 02 19:54:58.767769 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:58.767754    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a4eaec2c-f215-4fb2-9d82-23518c19a1d4-dshm\") pod \"a4eaec2c-f215-4fb2-9d82-23518c19a1d4\" (UID: \"a4eaec2c-f215-4fb2-9d82-23518c19a1d4\") "
Jul 02 19:54:58.768057 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:58.767903    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4eaec2c-f215-4fb2-9d82-23518c19a1d4-model-cache" (OuterVolumeSpecName: "model-cache") pod "a4eaec2c-f215-4fb2-9d82-23518c19a1d4" (UID: "a4eaec2c-f215-4fb2-9d82-23518c19a1d4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:54:58.768057 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:58.768033    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4eaec2c-f215-4fb2-9d82-23518c19a1d4-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a4eaec2c-f215-4fb2-9d82-23518c19a1d4" (UID: "a4eaec2c-f215-4fb2-9d82-23518c19a1d4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:54:58.768057 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:58.768056    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a4eaec2c-f215-4fb2-9d82-23518c19a1d4-model-cache\") on node \"ip-10-0-143-38.ec2.internal\" DevicePath \"\""
Jul 02 19:54:58.768214 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:58.768053    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4eaec2c-f215-4fb2-9d82-23518c19a1d4-home" (OuterVolumeSpecName: "home") pod "a4eaec2c-f215-4fb2-9d82-23518c19a1d4" (UID: "a4eaec2c-f215-4fb2-9d82-23518c19a1d4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:54:58.769961 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:58.769931    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4eaec2c-f215-4fb2-9d82-23518c19a1d4-dshm" (OuterVolumeSpecName: "dshm") pod "a4eaec2c-f215-4fb2-9d82-23518c19a1d4" (UID: "a4eaec2c-f215-4fb2-9d82-23518c19a1d4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:54:58.770069 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:58.769976    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4eaec2c-f215-4fb2-9d82-23518c19a1d4-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a4eaec2c-f215-4fb2-9d82-23518c19a1d4" (UID: "a4eaec2c-f215-4fb2-9d82-23518c19a1d4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:54:58.770069 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:58.769996    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4eaec2c-f215-4fb2-9d82-23518c19a1d4-kube-api-access-xxb5m" (OuterVolumeSpecName: "kube-api-access-xxb5m") pod "a4eaec2c-f215-4fb2-9d82-23518c19a1d4" (UID: "a4eaec2c-f215-4fb2-9d82-23518c19a1d4"). InnerVolumeSpecName "kube-api-access-xxb5m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:54:58.868624 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:58.868592    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4eaec2c-f215-4fb2-9d82-23518c19a1d4-tmp-dir\") on node \"ip-10-0-143-38.ec2.internal\" DevicePath \"\""
Jul 02 19:54:58.868624 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:58.868619    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a4eaec2c-f215-4fb2-9d82-23518c19a1d4-home\") on node \"ip-10-0-143-38.ec2.internal\" DevicePath \"\""
Jul 02 19:54:58.868624 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:58.868627    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a4eaec2c-f215-4fb2-9d82-23518c19a1d4-dshm\") on node \"ip-10-0-143-38.ec2.internal\" DevicePath \"\""
Jul 02 19:54:58.868841 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:58.868636    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4eaec2c-f215-4fb2-9d82-23518c19a1d4-tls-certs\") on node \"ip-10-0-143-38.ec2.internal\" DevicePath \"\""
Jul 02 19:54:58.868841 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:58.868646    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xxb5m\" (UniqueName: \"kubernetes.io/projected/a4eaec2c-f215-4fb2-9d82-23518c19a1d4-kube-api-access-xxb5m\") on node \"ip-10-0-143-38.ec2.internal\" DevicePath \"\""
Jul 02 19:54:58.933665 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:58.933577    2562 generic.go:356] "Generic (PLEG): container finished" podID="a4eaec2c-f215-4fb2-9d82-23518c19a1d4" containerID="ff3aebf76fc486f557deb423347683b15d02225047b181e119d537d413c6a9e4" exitCode=0
Jul 02 19:54:58.933665 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:58.933622    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f9d728/sub-test-model-f9d728-kserve-bcf89b7ff-8pfmm"
Jul 02 19:54:58.933874 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:58.933662    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f9d728/sub-test-model-f9d728-kserve-bcf89b7ff-8pfmm" event={"ID":"a4eaec2c-f215-4fb2-9d82-23518c19a1d4","Type":"ContainerDied","Data":"ff3aebf76fc486f557deb423347683b15d02225047b181e119d537d413c6a9e4"}
Jul 02 19:54:58.933874 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:58.933706    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f9d728/sub-test-model-f9d728-kserve-bcf89b7ff-8pfmm" event={"ID":"a4eaec2c-f215-4fb2-9d82-23518c19a1d4","Type":"ContainerDied","Data":"882d06cd84a87c4511b81117ff98dc1056f9e9ad816e9ead0b1e0b7c1f35224b"}
Jul 02 19:54:58.933874 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:58.933727    2562 scope.go:117] "RemoveContainer" containerID="ff3aebf76fc486f557deb423347683b15d02225047b181e119d537d413c6a9e4"
Jul 02 19:54:58.943040 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:58.943022    2562 scope.go:117] "RemoveContainer" containerID="ff3aebf76fc486f557deb423347683b15d02225047b181e119d537d413c6a9e4"
Jul 02 19:54:58.943302 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:54:58.943284    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff3aebf76fc486f557deb423347683b15d02225047b181e119d537d413c6a9e4\": container with ID starting with ff3aebf76fc486f557deb423347683b15d02225047b181e119d537d413c6a9e4 not found: ID does not exist" containerID="ff3aebf76fc486f557deb423347683b15d02225047b181e119d537d413c6a9e4"
Jul 02 19:54:58.943358 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:58.943308    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff3aebf76fc486f557deb423347683b15d02225047b181e119d537d413c6a9e4"} err="failed to get container status \"ff3aebf76fc486f557deb423347683b15d02225047b181e119d537d413c6a9e4\": rpc error: code = NotFound desc = could not find container \"ff3aebf76fc486f557deb423347683b15d02225047b181e119d537d413c6a9e4\": container with ID starting with ff3aebf76fc486f557deb423347683b15d02225047b181e119d537d413c6a9e4 not found: ID does not exist"
Jul 02 19:54:58.955134 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:58.955113    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f9d728/sub-test-model-f9d728-kserve-bcf89b7ff-8pfmm"]
Jul 02 19:54:58.965712 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:54:58.963120    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-f9d728/sub-test-model-f9d728-kserve-bcf89b7ff-8pfmm"]
Jul 02 19:55:00.118353 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:55:00.118316    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4eaec2c-f215-4fb2-9d82-23518c19a1d4" path="/var/lib/kubelet/pods/a4eaec2c-f215-4fb2-9d82-23518c19a1d4/volumes"
Jul 02 19:55:00.266067 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:55:00.266033    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:55:00.367062 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:55:00.367034    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:55:08.543117 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:55:08.543017    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:55:08.643056 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:55:08.643024    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:55:12.302040 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:55:12.302005    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-f9d728/rate-test-model-f9d728-kserve-59d9f55579-bgg52"]
Jul 02 19:55:12.302584 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:55:12.302424    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4eaec2c-f215-4fb2-9d82-23518c19a1d4" containerName="main"
Jul 02 19:55:12.302584 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:55:12.302439    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4eaec2c-f215-4fb2-9d82-23518c19a1d4" containerName="main"
Jul 02 19:55:12.302584 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:55:12.302463    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7" containerName="main"
Jul 02 19:55:12.302584 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:55:12.302472    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7" containerName="main"
Jul 02 19:55:12.302584 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:55:12.302556    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="19e6c5f2-34f4-4ff7-b7e4-f9ce4a9b42d7" containerName="main"
Jul 02 19:55:12.302584 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:55:12.302568    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4eaec2c-f215-4fb2-9d82-23518c19a1d4" containerName="main"
Jul 02 19:55:12.307261 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:55:12.307246    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f9d728/rate-test-model-f9d728-kserve-59d9f55579-bgg52"
Jul 02 19:55:12.310164 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:55:12.310143    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f9d728\"/\"openshift-service-ca.crt\""
Jul 02 19:55:12.311415 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:55:12.311397    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f9d728\"/\"kube-root-ca.crt\""
Jul 02 19:55:12.311537 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:55:12.311507    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f9d728\"/\"rate-test-model-f9d728-kserve-self-signed-certs\""
Jul 02 19:55:12.311537 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:55:12.311525    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f9d728\"/\"default-dockercfg-c59xm\""
Jul 02 19:55:12.315507 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:55:12.315478    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f9d728/rate-test-model-f9d728-kserve-59d9f55579-bgg52"]
Jul 02 19:55:12.329453 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:55:12.329423    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:55:12.395798 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:55:12.395761    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/24c88999-d67c-4bb5-b270-dae096064865-home\") pod \"rate-test-model-f9d728-kserve-59d9f55579-bgg52\" (UID: \"24c88999-d67c-4bb5-b270-dae096064865\") " pod="ai-tenant-e2e-shared-b-f9d728/rate-test-model-f9d728-kserve-59d9f55579-bgg52"
Jul 02 19:55:12.395798 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:55:12.395799    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24c88999-d67c-4bb5-b270-dae096064865-tls-certs\") pod \"rate-test-model-f9d728-kserve-59d9f55579-bgg52\" (UID: \"24c88999-d67c-4bb5-b270-dae096064865\") " pod="ai-tenant-e2e-shared-b-f9d728/rate-test-model-f9d728-kserve-59d9f55579-bgg52"
Jul 02 19:55:12.396039 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:55:12.395840    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhsvk\" (UniqueName: \"kubernetes.io/projected/24c88999-d67c-4bb5-b270-dae096064865-kube-api-access-lhsvk\") pod \"rate-test-model-f9d728-kserve-59d9f55579-bgg52\" (UID: \"24c88999-d67c-4bb5-b270-dae096064865\") " pod="ai-tenant-e2e-shared-b-f9d728/rate-test-model-f9d728-kserve-59d9f55579-bgg52"
Jul 02 19:55:12.396039 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:55:12.395887    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24c88999-d67c-4bb5-b270-dae096064865-tmp-dir\") pod \"rate-test-model-f9d728-kserve-59d9f55579-bgg52\" (UID: \"24c88999-d67c-4bb5-b270-dae096064865\") " pod="ai-tenant-e2e-shared-b-f9d728/rate-test-model-f9d728-kserve-59d9f55579-bgg52"
Jul 02 19:55:12.396039 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:55:12.395955    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/24c88999-d67c-4bb5-b270-dae096064865-dshm\") pod \"rate-test-model-f9d728-kserve-59d9f55579-bgg52\" (UID: \"24c88999-d67c-4bb5-b270-dae096064865\") " pod="ai-tenant-e2e-shared-b-f9d728/rate-test-model-f9d728-kserve-59d9f55579-bgg52"
Jul 02 19:55:12.396039 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:55:12.395982    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/24c88999-d67c-4bb5-b270-dae096064865-model-cache\") pod \"rate-test-model-f9d728-kserve-59d9f55579-bgg52\" (UID: \"24c88999-d67c-4bb5-b270-dae096064865\") " pod="ai-tenant-e2e-shared-b-f9d728/rate-test-model-f9d728-kserve-59d9f55579-bgg52"
Jul 02 19:55:12.497111 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:55:12.497070    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/24c88999-d67c-4bb5-b270-dae096064865-home\") pod \"rate-test-model-f9d728-kserve-59d9f55579-bgg52\" (UID: \"24c88999-d67c-4bb5-b270-dae096064865\") " pod="ai-tenant-e2e-shared-b-f9d728/rate-test-model-f9d728-kserve-59d9f55579-bgg52"
Jul 02 19:55:12.497111 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:55:12.497110    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24c88999-d67c-4bb5-b270-dae096064865-tls-certs\") pod \"rate-test-model-f9d728-kserve-59d9f55579-bgg52\" (UID: \"24c88999-d67c-4bb5-b270-dae096064865\") " pod="ai-tenant-e2e-shared-b-f9d728/rate-test-model-f9d728-kserve-59d9f55579-bgg52"
Jul 02 19:55:12.497364 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:55:12.497246    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhsvk\" (UniqueName: \"kubernetes.io/projected/24c88999-d67c-4bb5-b270-dae096064865-kube-api-access-lhsvk\") pod \"rate-test-model-f9d728-kserve-59d9f55579-bgg52\" (UID: \"24c88999-d67c-4bb5-b270-dae096064865\") " pod="ai-tenant-e2e-shared-b-f9d728/rate-test-model-f9d728-kserve-59d9f55579-bgg52"
Jul 02 19:55:12.497364 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:55:12.497287    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24c88999-d67c-4bb5-b270-dae096064865-tmp-dir\") pod \"rate-test-model-f9d728-kserve-59d9f55579-bgg52\" (UID: \"24c88999-d67c-4bb5-b270-dae096064865\") " pod="ai-tenant-e2e-shared-b-f9d728/rate-test-model-f9d728-kserve-59d9f55579-bgg52"
Jul 02 19:55:12.497364 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:55:12.497316    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/24c88999-d67c-4bb5-b270-dae096064865-dshm\") pod \"rate-test-model-f9d728-kserve-59d9f55579-bgg52\" (UID: \"24c88999-d67c-4bb5-b270-dae096064865\") " pod="ai-tenant-e2e-shared-b-f9d728/rate-test-model-f9d728-kserve-59d9f55579-bgg52"
Jul 02 19:55:12.497364 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:55:12.497351    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/24c88999-d67c-4bb5-b270-dae096064865-model-cache\") pod \"rate-test-model-f9d728-kserve-59d9f55579-bgg52\" (UID: \"24c88999-d67c-4bb5-b270-dae096064865\") " pod="ai-tenant-e2e-shared-b-f9d728/rate-test-model-f9d728-kserve-59d9f55579-bgg52"
Jul 02 19:55:12.497581 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:55:12.497502    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/24c88999-d67c-4bb5-b270-dae096064865-home\") pod \"rate-test-model-f9d728-kserve-59d9f55579-bgg52\" (UID: \"24c88999-d67c-4bb5-b270-dae096064865\") " pod="ai-tenant-e2e-shared-b-f9d728/rate-test-model-f9d728-kserve-59d9f55579-bgg52"
Jul 02 19:55:12.497627 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:55:12.497597    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24c88999-d67c-4bb5-b270-dae096064865-tmp-dir\") pod \"rate-test-model-f9d728-kserve-59d9f55579-bgg52\" (UID: \"24c88999-d67c-4bb5-b270-dae096064865\") " pod="ai-tenant-e2e-shared-b-f9d728/rate-test-model-f9d728-kserve-59d9f55579-bgg52"
Jul 02 19:55:12.497733 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:55:12.497710    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/24c88999-d67c-4bb5-b270-dae096064865-model-cache\") pod \"rate-test-model-f9d728-kserve-59d9f55579-bgg52\" (UID: \"24c88999-d67c-4bb5-b270-dae096064865\") " pod="ai-tenant-e2e-shared-b-f9d728/rate-test-model-f9d728-kserve-59d9f55579-bgg52"
Jul 02 19:55:12.499561 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:55:12.499541    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/24c88999-d67c-4bb5-b270-dae096064865-dshm\") pod \"rate-test-model-f9d728-kserve-59d9f55579-bgg52\" (UID: \"24c88999-d67c-4bb5-b270-dae096064865\") " pod="ai-tenant-e2e-shared-b-f9d728/rate-test-model-f9d728-kserve-59d9f55579-bgg52"
Jul 02 19:55:12.499826 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:55:12.499809    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24c88999-d67c-4bb5-b270-dae096064865-tls-certs\") pod \"rate-test-model-f9d728-kserve-59d9f55579-bgg52\" (UID: \"24c88999-d67c-4bb5-b270-dae096064865\") " pod="ai-tenant-e2e-shared-b-f9d728/rate-test-model-f9d728-kserve-59d9f55579-bgg52"
Jul 02 19:55:12.505737 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:55:12.505712    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhsvk\" (UniqueName: \"kubernetes.io/projected/24c88999-d67c-4bb5-b270-dae096064865-kube-api-access-lhsvk\") pod \"rate-test-model-f9d728-kserve-59d9f55579-bgg52\" (UID: \"24c88999-d67c-4bb5-b270-dae096064865\") " pod="ai-tenant-e2e-shared-b-f9d728/rate-test-model-f9d728-kserve-59d9f55579-bgg52"
Jul 02 19:55:12.616785 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:55:12.616680    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f9d728/rate-test-model-f9d728-kserve-59d9f55579-bgg52"
Jul 02 19:55:12.747820 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:55:12.747793    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f9d728/rate-test-model-f9d728-kserve-59d9f55579-bgg52"]
Jul 02 19:55:12.749892 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:55:12.749865    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod24c88999_d67c_4bb5_b270_dae096064865.slice/crio-9569c95b3f72dc0f7abbf281044050a189dd4ba9c6f72f3196314b21184ced26 WatchSource:0}: Error finding container 9569c95b3f72dc0f7abbf281044050a189dd4ba9c6f72f3196314b21184ced26: Status 404 returned error can't find the container with id 9569c95b3f72dc0f7abbf281044050a189dd4ba9c6f72f3196314b21184ced26
Jul 02 19:55:12.998857 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:55:12.998822    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f9d728/rate-test-model-f9d728-kserve-59d9f55579-bgg52" event={"ID":"24c88999-d67c-4bb5-b270-dae096064865","Type":"ContainerStarted","Data":"228ef59474604480a06e9492b21c89aa2ac8084338d7825e43329e8816c73bfb"}
Jul 02 19:55:12.999053 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:55:12.998869    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f9d728/rate-test-model-f9d728-kserve-59d9f55579-bgg52" event={"ID":"24c88999-d67c-4bb5-b270-dae096064865","Type":"ContainerStarted","Data":"9569c95b3f72dc0f7abbf281044050a189dd4ba9c6f72f3196314b21184ced26"}
Jul 02 19:55:13.016778 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:55:13.016720    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-f9d728/rate-test-model-f9d728-kserve-59d9f55579-bgg52" podStartSLOduration=1.016702546 podStartE2EDuration="1.016702546s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:55:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:55:13.016230258 +0000 UTC m=+2609.380300170" watchObservedRunningTime="2026-07-02 19:55:13.016702546 +0000 UTC m=+2609.380772461"
Jul 02 19:55:22.617477 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:55:22.617434    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-f9d728/rate-test-model-f9d728-kserve-59d9f55579-bgg52"
Jul 02 19:55:22.617954 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:55:22.617584    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-f9d728/rate-test-model-f9d728-kserve-59d9f55579-bgg52"
Jul 02 19:55:22.629963 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:55:22.629944    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-f9d728/rate-test-model-f9d728-kserve-59d9f55579-bgg52"
Jul 02 19:55:23.057291 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:55:23.057258    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-f9d728/rate-test-model-f9d728-kserve-59d9f55579-bgg52"
Jul 02 19:55:54.045244 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:55:54.045203    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-2fca4d/rate-test-model-2fca4d-kserve-5b8cfd847f-h26x7"]
Jul 02 19:55:54.071107 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:55:54.071071    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:55:54.883958 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:55:54.883925    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f9d728/rate-test-model-f9d728-kserve-59d9f55579-bgg52"]
Jul 02 19:55:54.909864 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:55:54.909835    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:55:55.935131 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:55:55.935095    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:55:56.327084 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:55:56.327052    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:55:56.429327 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:55:56.429297    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:55:56.530166 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:55:56.530135    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:55:56.615327 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:55:56.615250    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:56:01.399726 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:01.399694    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:56:06.182121 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:06.182083    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:56:06.282550 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:06.282520    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:56:09.065761 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:09.065715    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-2fca4d/rate-test-model-2fca4d-kserve-5b8cfd847f-h26x7" podUID="5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3" containerName="main" containerID="cri-o://f57d73dd50cb97d8a87ecc79ede635adb213ef1a67c8faf739290e760db10762" gracePeriod=45
Jul 02 19:56:09.259117 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:09.259084    2562 generic.go:356] "Generic (PLEG): container finished" podID="5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3" containerID="f57d73dd50cb97d8a87ecc79ede635adb213ef1a67c8faf739290e760db10762" exitCode=0
Jul 02 19:56:09.259286 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:09.259178    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-2fca4d/rate-test-model-2fca4d-kserve-5b8cfd847f-h26x7" event={"ID":"5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3","Type":"ContainerDied","Data":"f57d73dd50cb97d8a87ecc79ede635adb213ef1a67c8faf739290e760db10762"}
Jul 02 19:56:09.313014 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:09.312985    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-2fca4d/rate-test-model-2fca4d-kserve-5b8cfd847f-h26x7"
Jul 02 19:56:09.422154 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:09.422072    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3-tmp-dir\") pod \"5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3\" (UID: \"5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3\") "
Jul 02 19:56:09.422310 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:09.422170    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3-dshm\") pod \"5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3\" (UID: \"5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3\") "
Jul 02 19:56:09.422310 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:09.422190    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pzp4p\" (UniqueName: \"kubernetes.io/projected/5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3-kube-api-access-pzp4p\") pod \"5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3\" (UID: \"5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3\") "
Jul 02 19:56:09.422310 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:09.422206    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3-tls-certs\") pod \"5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3\" (UID: \"5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3\") "
Jul 02 19:56:09.422310 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:09.422262    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3-model-cache\") pod \"5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3\" (UID: \"5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3\") "
Jul 02 19:56:09.422310 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:09.422285    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3-home\") pod \"5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3\" (UID: \"5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3\") "
Jul 02 19:56:09.422547 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:09.422386    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3" (UID: "5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:56:09.422607 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:09.422561    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3-model-cache" (OuterVolumeSpecName: "model-cache") pod "5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3" (UID: "5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:56:09.422662 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:09.422608    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3-home" (OuterVolumeSpecName: "home") pod "5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3" (UID: "5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:56:09.422662 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:09.422652    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3-model-cache\") on node \"ip-10-0-143-38.ec2.internal\" DevicePath \"\""
Jul 02 19:56:09.422731 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:09.422666    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3-tmp-dir\") on node \"ip-10-0-143-38.ec2.internal\" DevicePath \"\""
Jul 02 19:56:09.424481 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:09.424462    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3-dshm" (OuterVolumeSpecName: "dshm") pod "5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3" (UID: "5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:56:09.424481 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:09.424466    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3" (UID: "5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:56:09.424595 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:09.424546    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3-kube-api-access-pzp4p" (OuterVolumeSpecName: "kube-api-access-pzp4p") pod "5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3" (UID: "5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3"). InnerVolumeSpecName "kube-api-access-pzp4p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:56:09.523636 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:09.523594    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3-tls-certs\") on node \"ip-10-0-143-38.ec2.internal\" DevicePath \"\""
Jul 02 19:56:09.523636 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:09.523629    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3-home\") on node \"ip-10-0-143-38.ec2.internal\" DevicePath \"\""
Jul 02 19:56:09.523636 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:09.523637    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3-dshm\") on node \"ip-10-0-143-38.ec2.internal\" DevicePath \"\""
Jul 02 19:56:09.523636 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:09.523645    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pzp4p\" (UniqueName: \"kubernetes.io/projected/5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3-kube-api-access-pzp4p\") on node \"ip-10-0-143-38.ec2.internal\" DevicePath \"\""
Jul 02 19:56:09.910035 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:09.909996    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-f9d728/rate-test-model-f9d728-kserve-59d9f55579-bgg52" podUID="24c88999-d67c-4bb5-b270-dae096064865" containerName="main" containerID="cri-o://228ef59474604480a06e9492b21c89aa2ac8084338d7825e43329e8816c73bfb" gracePeriod=45
Jul 02 19:56:10.148530 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:10.148505    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f9d728/rate-test-model-f9d728-kserve-59d9f55579-bgg52"
Jul 02 19:56:10.230247 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:10.230216    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/24c88999-d67c-4bb5-b270-dae096064865-home\") pod \"24c88999-d67c-4bb5-b270-dae096064865\" (UID: \"24c88999-d67c-4bb5-b270-dae096064865\") "
Jul 02 19:56:10.230426 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:10.230287    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24c88999-d67c-4bb5-b270-dae096064865-tmp-dir\") pod \"24c88999-d67c-4bb5-b270-dae096064865\" (UID: \"24c88999-d67c-4bb5-b270-dae096064865\") "
Jul 02 19:56:10.230426 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:10.230309    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/24c88999-d67c-4bb5-b270-dae096064865-dshm\") pod \"24c88999-d67c-4bb5-b270-dae096064865\" (UID: \"24c88999-d67c-4bb5-b270-dae096064865\") "
Jul 02 19:56:10.230426 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:10.230327    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/24c88999-d67c-4bb5-b270-dae096064865-model-cache\") pod \"24c88999-d67c-4bb5-b270-dae096064865\" (UID: \"24c88999-d67c-4bb5-b270-dae096064865\") "
Jul 02 19:56:10.230426 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:10.230368    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lhsvk\" (UniqueName: \"kubernetes.io/projected/24c88999-d67c-4bb5-b270-dae096064865-kube-api-access-lhsvk\") pod \"24c88999-d67c-4bb5-b270-dae096064865\" (UID: \"24c88999-d67c-4bb5-b270-dae096064865\") "
Jul 02 19:56:10.230426 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:10.230405    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24c88999-d67c-4bb5-b270-dae096064865-tls-certs\") pod \"24c88999-d67c-4bb5-b270-dae096064865\" (UID: \"24c88999-d67c-4bb5-b270-dae096064865\") "
Jul 02 19:56:10.230693 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:10.230502    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24c88999-d67c-4bb5-b270-dae096064865-home" (OuterVolumeSpecName: "home") pod "24c88999-d67c-4bb5-b270-dae096064865" (UID: "24c88999-d67c-4bb5-b270-dae096064865"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:56:10.230693 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:10.230584    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24c88999-d67c-4bb5-b270-dae096064865-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "24c88999-d67c-4bb5-b270-dae096064865" (UID: "24c88999-d67c-4bb5-b270-dae096064865"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:56:10.230693 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:10.230601    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24c88999-d67c-4bb5-b270-dae096064865-model-cache" (OuterVolumeSpecName: "model-cache") pod "24c88999-d67c-4bb5-b270-dae096064865" (UID: "24c88999-d67c-4bb5-b270-dae096064865"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:56:10.230826 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:10.230734    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/24c88999-d67c-4bb5-b270-dae096064865-home\") on node \"ip-10-0-143-38.ec2.internal\" DevicePath \"\""
Jul 02 19:56:10.230826 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:10.230752    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24c88999-d67c-4bb5-b270-dae096064865-tmp-dir\") on node \"ip-10-0-143-38.ec2.internal\" DevicePath \"\""
Jul 02 19:56:10.230826 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:10.230765    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/24c88999-d67c-4bb5-b270-dae096064865-model-cache\") on node \"ip-10-0-143-38.ec2.internal\" DevicePath \"\""
Jul 02 19:56:10.232631 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:10.232611    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24c88999-d67c-4bb5-b270-dae096064865-dshm" (OuterVolumeSpecName: "dshm") pod "24c88999-d67c-4bb5-b270-dae096064865" (UID: "24c88999-d67c-4bb5-b270-dae096064865"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:56:10.232738 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:10.232631    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24c88999-d67c-4bb5-b270-dae096064865-kube-api-access-lhsvk" (OuterVolumeSpecName: "kube-api-access-lhsvk") pod "24c88999-d67c-4bb5-b270-dae096064865" (UID: "24c88999-d67c-4bb5-b270-dae096064865"). InnerVolumeSpecName "kube-api-access-lhsvk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:56:10.232738 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:10.232649    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24c88999-d67c-4bb5-b270-dae096064865-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "24c88999-d67c-4bb5-b270-dae096064865" (UID: "24c88999-d67c-4bb5-b270-dae096064865"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:56:10.264470 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:10.264438    2562 generic.go:356] "Generic (PLEG): container finished" podID="24c88999-d67c-4bb5-b270-dae096064865" containerID="228ef59474604480a06e9492b21c89aa2ac8084338d7825e43329e8816c73bfb" exitCode=0
Jul 02 19:56:10.264624 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:10.264488    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f9d728/rate-test-model-f9d728-kserve-59d9f55579-bgg52"
Jul 02 19:56:10.264624 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:10.264529    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f9d728/rate-test-model-f9d728-kserve-59d9f55579-bgg52" event={"ID":"24c88999-d67c-4bb5-b270-dae096064865","Type":"ContainerDied","Data":"228ef59474604480a06e9492b21c89aa2ac8084338d7825e43329e8816c73bfb"}
Jul 02 19:56:10.264624 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:10.264575    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f9d728/rate-test-model-f9d728-kserve-59d9f55579-bgg52" event={"ID":"24c88999-d67c-4bb5-b270-dae096064865","Type":"ContainerDied","Data":"9569c95b3f72dc0f7abbf281044050a189dd4ba9c6f72f3196314b21184ced26"}
Jul 02 19:56:10.264624 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:10.264595    2562 scope.go:117] "RemoveContainer" containerID="228ef59474604480a06e9492b21c89aa2ac8084338d7825e43329e8816c73bfb"
Jul 02 19:56:10.265970 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:10.265943    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-2fca4d/rate-test-model-2fca4d-kserve-5b8cfd847f-h26x7" event={"ID":"5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3","Type":"ContainerDied","Data":"42b007573969c2173cc474dc277ece0be9eb71a6a1dc95a5d8826275396227bd"}
Jul 02 19:56:10.266044 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:10.265994    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-2fca4d/rate-test-model-2fca4d-kserve-5b8cfd847f-h26x7"
Jul 02 19:56:10.275226 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:10.275110    2562 scope.go:117] "RemoveContainer" containerID="228ef59474604480a06e9492b21c89aa2ac8084338d7825e43329e8816c73bfb"
Jul 02 19:56:10.278083 ip-10-0-143-38 kubenswrapper[2562]: E0702 19:56:10.278058    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"228ef59474604480a06e9492b21c89aa2ac8084338d7825e43329e8816c73bfb\": container with ID starting with 228ef59474604480a06e9492b21c89aa2ac8084338d7825e43329e8816c73bfb not found: ID does not exist" containerID="228ef59474604480a06e9492b21c89aa2ac8084338d7825e43329e8816c73bfb"
Jul 02 19:56:10.278183 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:10.278088    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"228ef59474604480a06e9492b21c89aa2ac8084338d7825e43329e8816c73bfb"} err="failed to get container status \"228ef59474604480a06e9492b21c89aa2ac8084338d7825e43329e8816c73bfb\": rpc error: code = NotFound desc = could not find container \"228ef59474604480a06e9492b21c89aa2ac8084338d7825e43329e8816c73bfb\": container with ID starting with 228ef59474604480a06e9492b21c89aa2ac8084338d7825e43329e8816c73bfb not found: ID does not exist"
Jul 02 19:56:10.278183 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:10.278107    2562 scope.go:117] "RemoveContainer" containerID="f57d73dd50cb97d8a87ecc79ede635adb213ef1a67c8faf739290e760db10762"
Jul 02 19:56:10.284656 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:10.284634    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-2fca4d/rate-test-model-2fca4d-kserve-5b8cfd847f-h26x7"]
Jul 02 19:56:10.289287 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:10.289268    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-2fca4d/rate-test-model-2fca4d-kserve-5b8cfd847f-h26x7"]
Jul 02 19:56:10.301622 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:10.301601    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f9d728/rate-test-model-f9d728-kserve-59d9f55579-bgg52"]
Jul 02 19:56:10.305310 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:10.305289    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-f9d728/rate-test-model-f9d728-kserve-59d9f55579-bgg52"]
Jul 02 19:56:10.332211 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:10.332190    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/24c88999-d67c-4bb5-b270-dae096064865-dshm\") on node \"ip-10-0-143-38.ec2.internal\" DevicePath \"\""
Jul 02 19:56:10.332290 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:10.332213    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lhsvk\" (UniqueName: \"kubernetes.io/projected/24c88999-d67c-4bb5-b270-dae096064865-kube-api-access-lhsvk\") on node \"ip-10-0-143-38.ec2.internal\" DevicePath \"\""
Jul 02 19:56:10.332290 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:10.332225    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24c88999-d67c-4bb5-b270-dae096064865-tls-certs\") on node \"ip-10-0-143-38.ec2.internal\" DevicePath \"\""
Jul 02 19:56:12.118225 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:12.118194    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24c88999-d67c-4bb5-b270-dae096064865" path="/var/lib/kubelet/pods/24c88999-d67c-4bb5-b270-dae096064865/volumes"
Jul 02 19:56:12.118603 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:12.118555    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3" path="/var/lib/kubelet/pods/5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3/volumes"
Jul 02 19:56:33.206392 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:33.206352    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:56:35.611887 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:35.611801    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:56:40.513715 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:40.513684    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:56:40.614929 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:40.614880    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:56:40.799222 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:40.799137    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:56:41.006100 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:41.006071    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:56:44.181618 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:44.181590    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lgt7t_38beee50-e2c9-489e-91cb-f1bfad99fabf/ovn-acl-logging/0.log"
Jul 02 19:56:44.190139 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:44.190120    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lgt7t_38beee50-e2c9-489e-91cb-f1bfad99fabf/ovn-acl-logging/0.log"
Jul 02 19:56:47.080297 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:47.080270    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6974d4f959-w4pqq_c55e7418-d422-4508-acf6-dcbe576431f4/copy-manifests/0.log"
Jul 02 19:56:47.087400 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:47.087378    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6974d4f959-w4pqq_c55e7418-d422-4508-acf6-dcbe576431f4/manager/0.log"
Jul 02 19:56:48.684101 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:48.684075    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-tf79h_d4de94f9-8c78-4ab0-b796-3803518e58a5/manager/0.log"
Jul 02 19:56:48.793230 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:48.793197    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-d46vz_697e2b89-9737-49e5-a9ad-0fdd3d076cc2/kuadrant-console-plugin/0.log"
Jul 02 19:56:49.268774 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:49.268748    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-mbxdb_814747b5-bdef-49ca-9961-91d7b57d8299/manager/0.log"
Jul 02 19:56:49.960895 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:49.960869    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-f9f996d75-s7vnm_d2383b06-9801-4c35-ac1f-aa34dd7075f1/kube-auth-proxy/0.log"
Jul 02 19:56:50.197388 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:50.197356    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-nsqst_000ad09b-8cf8-4ddf-a643-1743c1a8c0db/payload-pre-processing/0.log"
Jul 02 19:56:50.423030 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:50.422935    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7b6dc76c65-jtd7c_9df21515-928e-4ce4-a97f-b90af84dbd02/router/0.log"
Jul 02 19:56:50.869523 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:50.869487    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-6mp4g_c92b556f-3fa5-4f8b-b682-eed2a5cfd3c6/main/0.log"
Jul 02 19:56:51.203234 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:51.203213    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-gkrj4_bcf9348c-6bef-4076-b2da-32e22342f762/main/0.log"
Jul 02 19:56:51.318508 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:51.318476    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-5c46x_9692d427-dbdd-43ac-bd9a-17a46639e871/main/0.log"
Jul 02 19:56:55.609172 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:55.609142    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:56:55.709994 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:55.709961    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log" limit=1024
Jul 02 19:56:58.524843 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:58.524813    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-58jxn_b4bcbbc3-c3ea-4e9d-ba69-9312e20b21cd/global-pull-secret-syncer/0.log"
Jul 02 19:56:58.664113 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:58.664080    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-4pjcm_cf087cb5-556e-4491-89d6-09e0b08db2b7/konnectivity-agent/0.log"
Jul 02 19:56:58.801958 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:56:58.801864    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-38.ec2.internal_fccf9d5a8864f519f8e3c7a4a069b572/haproxy/0.log"
Jul 02 19:57:03.107315 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:57:03.107286    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-tf79h_d4de94f9-8c78-4ab0-b796-3803518e58a5/manager/0.log"
Jul 02 19:57:03.145372 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:57:03.145340    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-d46vz_697e2b89-9737-49e5-a9ad-0fdd3d076cc2/kuadrant-console-plugin/0.log"
Jul 02 19:57:03.472180 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:57:03.472153    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-mbxdb_814747b5-bdef-49ca-9961-91d7b57d8299/manager/0.log"
Jul 02 19:57:05.443560 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:57:05.443520    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-vfd6h_acf32f4f-6cfd-40a3-8579-d62ea69d5cb6/cluster-monitoring-operator/0.log"
Jul 02 19:57:05.565823 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:57:05.565786    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-775789cf48-d69j6_fecf4dfd-9dec-486a-96a8-7bbf7abb8a2b/metrics-server/0.log"
Jul 02 19:57:05.641657 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:57:05.641569    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-br7gk_8a069263-cccc-4c90-a48d-19fdf10b52c1/node-exporter/0.log"
Jul 02 19:57:05.664563 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:57:05.664545    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-br7gk_8a069263-cccc-4c90-a48d-19fdf10b52c1/kube-rbac-proxy/0.log"
Jul 02 19:57:05.688340 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:57:05.688318    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-br7gk_8a069263-cccc-4c90-a48d-19fdf10b52c1/init-textfile/0.log"
Jul 02 19:57:05.868094 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:57:05.868052    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-878hv_5e6701a0-1b56-4a92-a3c9-cd4d7db150c2/kube-rbac-proxy-main/0.log"
Jul 02 19:57:05.889127 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:57:05.889096    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-878hv_5e6701a0-1b56-4a92-a3c9-cd4d7db150c2/kube-rbac-proxy-self/0.log"
Jul 02 19:57:05.910048 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:57:05.909974    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-878hv_5e6701a0-1b56-4a92-a3c9-cd4d7db150c2/openshift-state-metrics/0.log"
Jul 02 19:57:05.975832 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:57:05.975802    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4f935b0c-72d3-4c82-85d1-89b5eb356167/prometheus/0.log"
Jul 02 19:57:05.996892 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:57:05.996871    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4f935b0c-72d3-4c82-85d1-89b5eb356167/config-reloader/0.log"
Jul 02 19:57:06.017127 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:57:06.017102    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4f935b0c-72d3-4c82-85d1-89b5eb356167/thanos-sidecar/0.log"
Jul 02 19:57:06.042103 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:57:06.042083    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4f935b0c-72d3-4c82-85d1-89b5eb356167/kube-rbac-proxy-web/0.log"
Jul 02 19:57:06.062583 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:57:06.062563    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4f935b0c-72d3-4c82-85d1-89b5eb356167/kube-rbac-proxy/0.log"
Jul 02 19:57:06.084271 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:57:06.084246    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4f935b0c-72d3-4c82-85d1-89b5eb356167/kube-rbac-proxy-thanos/0.log"
Jul 02 19:57:06.108026 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:57:06.108005    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4f935b0c-72d3-4c82-85d1-89b5eb356167/init-config-reloader/0.log"
Jul 02 19:57:09.052391 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:57:09.052333    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-xzntd/perf-node-gather-daemonset-t9ljq"]
Jul 02 19:57:09.052859 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:57:09.052695    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24c88999-d67c-4bb5-b270-dae096064865" containerName="main"
Jul 02 19:57:09.052859 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:57:09.052705    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="24c88999-d67c-4bb5-b270-dae096064865" containerName="main"
Jul 02 19:57:09.052859 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:57:09.052715    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3" containerName="main"
Jul 02 19:57:09.052859 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:57:09.052720    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3" containerName="main"
Jul 02 19:57:09.052859 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:57:09.052774    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="24c88999-d67c-4bb5-b270-dae096064865" containerName="main"
Jul 02 19:57:09.052859 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:57:09.052783    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f99ca70-56ef-4fe4-bea5-6dc6c370b3f3" containerName="main"
Jul 02 19:57:09.055970 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:57:09.055948    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xzntd/perf-node-gather-daemonset-t9ljq"
Jul 02 19:57:09.058846 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:57:09.058823    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xzntd\"/\"openshift-service-ca.crt\""
Jul 02 19:57:09.059990 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:57:09.059974    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xzntd\"/\"kube-root-ca.crt\""
Jul 02 19:57:09.059990 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:57:09.059981    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-xzntd\"/\"default-dockercfg-d7pj2\""
Jul 02 19:57:09.065376 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:57:09.065354    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xzntd/perf-node-gather-daemonset-t9ljq"]
Jul 02 19:57:09.139716 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:57:09.139681    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/132c8215-edc3-45cc-aeb3-99ecff111eea-proc\") pod \"perf-node-gather-daemonset-t9ljq\" (UID: \"132c8215-edc3-45cc-aeb3-99ecff111eea\") " pod="openshift-must-gather-xzntd/perf-node-gather-daemonset-t9ljq"
Jul 02 19:57:09.139716 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:57:09.139719    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/132c8215-edc3-45cc-aeb3-99ecff111eea-podres\") pod \"perf-node-gather-daemonset-t9ljq\" (UID: \"132c8215-edc3-45cc-aeb3-99ecff111eea\") " pod="openshift-must-gather-xzntd/perf-node-gather-daemonset-t9ljq"
Jul 02 19:57:09.139955 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:57:09.139742    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/132c8215-edc3-45cc-aeb3-99ecff111eea-lib-modules\") pod \"perf-node-gather-daemonset-t9ljq\" (UID: \"132c8215-edc3-45cc-aeb3-99ecff111eea\") " pod="openshift-must-gather-xzntd/perf-node-gather-daemonset-t9ljq"
Jul 02 19:57:09.139955 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:57:09.139762    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmpfk\" (UniqueName: \"kubernetes.io/projected/132c8215-edc3-45cc-aeb3-99ecff111eea-kube-api-access-wmpfk\") pod \"perf-node-gather-daemonset-t9ljq\" (UID: \"132c8215-edc3-45cc-aeb3-99ecff111eea\") " pod="openshift-must-gather-xzntd/perf-node-gather-daemonset-t9ljq"
Jul 02 19:57:09.139955 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:57:09.139808    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/132c8215-edc3-45cc-aeb3-99ecff111eea-sys\") pod \"perf-node-gather-daemonset-t9ljq\" (UID: \"132c8215-edc3-45cc-aeb3-99ecff111eea\") " pod="openshift-must-gather-xzntd/perf-node-gather-daemonset-t9ljq"
Jul 02 19:57:09.241133 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:57:09.241089    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/132c8215-edc3-45cc-aeb3-99ecff111eea-sys\") pod \"perf-node-gather-daemonset-t9ljq\" (UID: \"132c8215-edc3-45cc-aeb3-99ecff111eea\") " pod="openshift-must-gather-xzntd/perf-node-gather-daemonset-t9ljq"
Jul 02 19:57:09.241327 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:57:09.241173    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/132c8215-edc3-45cc-aeb3-99ecff111eea-proc\") pod \"perf-node-gather-daemonset-t9ljq\" (UID: \"132c8215-edc3-45cc-aeb3-99ecff111eea\") " pod="openshift-must-gather-xzntd/perf-node-gather-daemonset-t9ljq"
Jul 02 19:57:09.241327 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:57:09.241213    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/132c8215-edc3-45cc-aeb3-99ecff111eea-podres\") pod \"perf-node-gather-daemonset-t9ljq\" (UID: \"132c8215-edc3-45cc-aeb3-99ecff111eea\") " pod="openshift-must-gather-xzntd/perf-node-gather-daemonset-t9ljq"
Jul 02 19:57:09.241327 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:57:09.241219    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/132c8215-edc3-45cc-aeb3-99ecff111eea-sys\") pod \"perf-node-gather-daemonset-t9ljq\" (UID: \"132c8215-edc3-45cc-aeb3-99ecff111eea\") " pod="openshift-must-gather-xzntd/perf-node-gather-daemonset-t9ljq"
Jul 02 19:57:09.241327 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:57:09.241265    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/132c8215-edc3-45cc-aeb3-99ecff111eea-lib-modules\") pod \"perf-node-gather-daemonset-t9ljq\" (UID: \"132c8215-edc3-45cc-aeb3-99ecff111eea\") " pod="openshift-must-gather-xzntd/perf-node-gather-daemonset-t9ljq"
Jul 02 19:57:09.241327 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:57:09.241296    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/132c8215-edc3-45cc-aeb3-99ecff111eea-proc\") pod \"perf-node-gather-daemonset-t9ljq\" (UID: \"132c8215-edc3-45cc-aeb3-99ecff111eea\") " pod="openshift-must-gather-xzntd/perf-node-gather-daemonset-t9ljq"
Jul 02 19:57:09.241327 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:57:09.241300    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmpfk\" (UniqueName: \"kubernetes.io/projected/132c8215-edc3-45cc-aeb3-99ecff111eea-kube-api-access-wmpfk\") pod \"perf-node-gather-daemonset-t9ljq\" (UID: \"132c8215-edc3-45cc-aeb3-99ecff111eea\") " pod="openshift-must-gather-xzntd/perf-node-gather-daemonset-t9ljq"
Jul 02 19:57:09.241584 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:57:09.241348    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/132c8215-edc3-45cc-aeb3-99ecff111eea-podres\") pod \"perf-node-gather-daemonset-t9ljq\" (UID: \"132c8215-edc3-45cc-aeb3-99ecff111eea\") " pod="openshift-must-gather-xzntd/perf-node-gather-daemonset-t9ljq"
Jul 02 19:57:09.241584 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:57:09.241441    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/132c8215-edc3-45cc-aeb3-99ecff111eea-lib-modules\") pod \"perf-node-gather-daemonset-t9ljq\" (UID: \"132c8215-edc3-45cc-aeb3-99ecff111eea\") " pod="openshift-must-gather-xzntd/perf-node-gather-daemonset-t9ljq"
Jul 02 19:57:09.249382 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:57:09.249354    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmpfk\" (UniqueName: \"kubernetes.io/projected/132c8215-edc3-45cc-aeb3-99ecff111eea-kube-api-access-wmpfk\") pod \"perf-node-gather-daemonset-t9ljq\" (UID: \"132c8215-edc3-45cc-aeb3-99ecff111eea\") " pod="openshift-must-gather-xzntd/perf-node-gather-daemonset-t9ljq"
Jul 02 19:57:09.366593 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:57:09.366508    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xzntd/perf-node-gather-daemonset-t9ljq"
Jul 02 19:57:09.504977 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:57:09.504951    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xzntd/perf-node-gather-daemonset-t9ljq"]
Jul 02 19:57:09.507354 ip-10-0-143-38 kubenswrapper[2562]: W0702 19:57:09.507324    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod132c8215_edc3_45cc_aeb3_99ecff111eea.slice/crio-8f334fc9c3dfaba88cbea786fbeec05260da2778f8417bc735421a58c83b3f4b WatchSource:0}: Error finding container 8f334fc9c3dfaba88cbea786fbeec05260da2778f8417bc735421a58c83b3f4b: Status 404 returned error can't find the container with id 8f334fc9c3dfaba88cbea786fbeec05260da2778f8417bc735421a58c83b3f4b
Jul 02 19:57:09.536879 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:57:09.536852    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xzntd/perf-node-gather-daemonset-t9ljq" event={"ID":"132c8215-edc3-45cc-aeb3-99ecff111eea","Type":"ContainerStarted","Data":"8f334fc9c3dfaba88cbea786fbeec05260da2778f8417bc735421a58c83b3f4b"}
Jul 02 19:57:10.542826 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:57:10.542793    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xzntd/perf-node-gather-daemonset-t9ljq" event={"ID":"132c8215-edc3-45cc-aeb3-99ecff111eea","Type":"ContainerStarted","Data":"8aef55f5f3662329cf9acaaaf7c0787b5d2ed35454efa9032d92d70fe40bacbd"}
Jul 02 19:57:10.543233 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:57:10.542946    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-xzntd/perf-node-gather-daemonset-t9ljq"
Jul 02 19:57:10.563811 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:57:10.563759    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-xzntd/perf-node-gather-daemonset-t9ljq" podStartSLOduration=1.563743459 podStartE2EDuration="1.563743459s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:57:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:57:10.562430279 +0000 UTC m=+2726.926500192" watchObservedRunningTime="2026-07-02 19:57:10.563743459 +0000 UTC m=+2726.927813372"
Jul 02 19:57:10.851468 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:57:10.851387    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bdfpb_f923f505-7d21-406b-ae68-e3cb0606b23c/dns/0.log"
Jul 02 19:57:10.872415 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:57:10.872391    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bdfpb_f923f505-7d21-406b-ae68-e3cb0606b23c/kube-rbac-proxy/0.log"
Jul 02 19:57:10.967382 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:57:10.967349    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9mhh9_d7c935ff-227d-4302-879d-c1a1f01755a9/dns-node-resolver/0.log"
Jul 02 19:57:11.555784 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:57:11.555757    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6rmk4_21bc43fc-481b-4b52-a8e3-5ae352981994/node-ca/0.log"
Jul 02 19:57:12.746210 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:57:12.746165    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-f9f996d75-s7vnm_d2383b06-9801-4c35-ac1f-aa34dd7075f1/kube-auth-proxy/0.log"
Jul 02 19:57:12.850175 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:57:12.850137    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-nsqst_000ad09b-8cf8-4ddf-a643-1743c1a8c0db/payload-pre-processing/0.log"
Jul 02 19:57:12.938162 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:57:12.938135    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7b6dc76c65-jtd7c_9df21515-928e-4ce4-a97f-b90af84dbd02/router/0.log"
Jul 02 19:57:13.672336 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:57:13.672311    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pl552_186d4a7b-65a2-4613-92bf-5bbeee5f6a56/serve-healthcheck-canary/0.log"
Jul 02 19:57:14.328495 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:57:14.328471    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-q2bp9_477be61a-e59f-4190-b987-3f5d23690fcd/kube-rbac-proxy/0.log"
Jul 02 19:57:14.348669 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:57:14.348647    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-q2bp9_477be61a-e59f-4190-b987-3f5d23690fcd/exporter/0.log"
Jul 02 19:57:14.369678 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:57:14.369659    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-q2bp9_477be61a-e59f-4190-b987-3f5d23690fcd/extractor/0.log"
Jul 02 19:57:16.557662 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:57:16.557632    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-xzntd/perf-node-gather-daemonset-t9ljq"
Jul 02 19:57:17.148720 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:57:17.148691    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6974d4f959-w4pqq_c55e7418-d422-4508-acf6-dcbe576431f4/manager/0.log"
Jul 02 19:57:17.173613 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:57:17.173590    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6974d4f959-w4pqq_c55e7418-d422-4508-acf6-dcbe576431f4/copy-manifests/0.log"
Jul 02 19:57:18.689534 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:57:18.689500    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5d5f586fb-tgb8j_4621dadf-d7d2-45fd-b892-c9083827885f/manager/0.log"
Jul 02 19:57:19.597758 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:57:19.597671    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-f9f996d75-s7vnm_d2383b06-9801-4c35-ac1f-aa34dd7075f1/kube-auth-proxy/0.log"
Jul 02 19:57:19.674308 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:57:19.674284    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-nsqst_000ad09b-8cf8-4ddf-a643-1743c1a8c0db/payload-pre-processing/0.log"
Jul 02 19:57:19.743749 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:57:19.743717    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7b6dc76c65-jtd7c_9df21515-928e-4ce4-a97f-b90af84dbd02/router/0.log"
Jul 02 19:57:21.131333 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:57:21.131302    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-f9f996d75-s7vnm_d2383b06-9801-4c35-ac1f-aa34dd7075f1/kube-auth-proxy/0.log"
Jul 02 19:57:21.216191 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:57:21.216155    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-nsqst_000ad09b-8cf8-4ddf-a643-1743c1a8c0db/payload-pre-processing/0.log"
Jul 02 19:57:21.277745 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:57:21.277710    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7b6dc76c65-jtd7c_9df21515-928e-4ce4-a97f-b90af84dbd02/router/0.log"
Jul 02 19:57:23.835745 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:57:23.835715    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-7n6qk_fc445393-c33c-40c3-8b18-8e103f1229a5/migrator/0.log"
Jul 02 19:57:23.856144 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:57:23.856121    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-7n6qk_fc445393-c33c-40c3-8b18-8e103f1229a5/graceful-termination/0.log"
Jul 02 19:57:25.531363 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:57:25.531341    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qw5fs_2fad0b2e-a705-44f4-91d1-d04cc9eec1e5/kube-multus-additional-cni-plugins/0.log"
Jul 02 19:57:25.555879 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:57:25.555852    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qw5fs_2fad0b2e-a705-44f4-91d1-d04cc9eec1e5/egress-router-binary-copy/0.log"
Jul 02 19:57:25.578672 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:57:25.578646    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qw5fs_2fad0b2e-a705-44f4-91d1-d04cc9eec1e5/cni-plugins/0.log"
Jul 02 19:57:25.598714 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:57:25.598686    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qw5fs_2fad0b2e-a705-44f4-91d1-d04cc9eec1e5/bond-cni-plugin/0.log"
Jul 02 19:57:25.619784 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:57:25.619759    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qw5fs_2fad0b2e-a705-44f4-91d1-d04cc9eec1e5/routeoverride-cni/0.log"
Jul 02 19:57:25.639084 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:57:25.639062    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qw5fs_2fad0b2e-a705-44f4-91d1-d04cc9eec1e5/whereabouts-cni-bincopy/0.log"
Jul 02 19:57:25.660180 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:57:25.660154    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qw5fs_2fad0b2e-a705-44f4-91d1-d04cc9eec1e5/whereabouts-cni/0.log"
Jul 02 19:57:25.743648 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:57:25.743624    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-pxrmb_24385f8e-c947-4df0-bd2a-10f2562a4a7b/kube-multus/0.log"
Jul 02 19:57:25.763431 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:57:25.763405    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2b9th_d0e53e82-59ae-4430-9470-2648eb4eafb4/network-metrics-daemon/0.log"
Jul 02 19:57:25.783451 ip-10-0-143-38 kubenswrapper[2562]: I0702 19:57:25.783376    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2b9th_d0e53e82-59ae-4430-9470-2648eb4eafb4/kube-rbac-proxy/0.log"