Jul 02 17:08:30.101385 ip-10-0-143-67 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 02 17:08:30.101396 ip-10-0-143-67 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 02 17:08:30.101403 ip-10-0-143-67 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 02 17:08:30.101604 ip-10-0-143-67 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 02 17:08:40.168294 ip-10-0-143-67 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 02 17:08:40.168311 ip-10-0-143-67 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 4d0616450cb8447ca35cc22f8262c790 --
Jul 02 17:10:43.432275 ip-10-0-143-67 systemd[1]: Starting Kubernetes Kubelet...
Jul 02 17:10:45.167670 ip-10-0-143-67 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 02 17:10:45.167670 ip-10-0-143-67 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 02 17:10:45.167670 ip-10-0-143-67 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 02 17:10:45.167670 ip-10-0-143-67 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 02 17:10:45.167670 ip-10-0-143-67 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 02 17:10:45.167670 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.095486    2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 02 17:10:45.167670 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101410    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 17:10:45.167670 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101421    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 17:10:45.167670 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101425    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 17:10:45.167670 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101429    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 17:10:45.167670 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101433    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 17:10:45.167670 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101436    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 17:10:45.167670 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101439    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 17:10:45.167670 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101442    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 17:10:45.168590 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101444    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 17:10:45.168590 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101447    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 17:10:45.168590 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101451    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 17:10:45.168590 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101453    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 17:10:45.168590 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101456    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 17:10:45.168590 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101458    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 17:10:45.168590 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101461    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 17:10:45.168590 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101465    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 17:10:45.168590 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101469    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 17:10:45.168590 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101473    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 17:10:45.168590 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101476    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 17:10:45.168590 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101478    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 17:10:45.168590 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101481    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 17:10:45.168590 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101484    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 17:10:45.168590 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101487    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 17:10:45.168590 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101490    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 17:10:45.168590 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101492    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 17:10:45.168590 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101495    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 17:10:45.168590 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101498    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 17:10:45.169228 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101501    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 17:10:45.169228 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101503    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 17:10:45.169228 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101506    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 17:10:45.169228 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101508    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 17:10:45.169228 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101511    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 17:10:45.169228 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101513    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 17:10:45.169228 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101517    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 17:10:45.169228 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101519    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 17:10:45.169228 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101522    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 17:10:45.169228 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101524    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 17:10:45.169228 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101527    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 17:10:45.169228 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101530    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 17:10:45.169228 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101532    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 17:10:45.169228 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101535    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 17:10:45.169228 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101538    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 17:10:45.169228 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101540    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 17:10:45.169228 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101543    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 17:10:45.169228 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101545    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 17:10:45.169228 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101547    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 17:10:45.169807 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101550    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 17:10:45.169807 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101552    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 17:10:45.169807 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101555    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 17:10:45.169807 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101560    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 17:10:45.169807 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101563    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 17:10:45.169807 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101566    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 17:10:45.169807 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101569    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 17:10:45.169807 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101571    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 17:10:45.169807 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101574    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 17:10:45.169807 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101578    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 17:10:45.169807 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101580    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 17:10:45.169807 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101583    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 17:10:45.169807 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101586    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 17:10:45.169807 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101588    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 17:10:45.169807 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101591    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 17:10:45.169807 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101593    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 17:10:45.169807 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101596    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 17:10:45.169807 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101599    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 17:10:45.169807 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101601    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 17:10:45.170364 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101604    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 17:10:45.170364 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101606    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 17:10:45.170364 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101609    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 17:10:45.170364 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101611    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 17:10:45.170364 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101613    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 17:10:45.170364 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101617    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 17:10:45.170364 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101620    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 17:10:45.170364 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101623    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 17:10:45.170364 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101625    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 17:10:45.170364 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101629    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 17:10:45.170364 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101633    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 17:10:45.170364 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101636    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 17:10:45.170364 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101638    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 17:10:45.170364 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101641    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 17:10:45.170364 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101644    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 17:10:45.170364 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101647    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 17:10:45.170364 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101649    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 17:10:45.170364 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101652    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 17:10:45.170364 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101655    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 17:10:45.170364 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101657    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 17:10:45.171275 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101659    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 17:10:45.171275 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101662    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 17:10:45.171275 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101665    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 17:10:45.171275 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101667    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 17:10:45.171275 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101670    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 17:10:45.171275 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101672    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 17:10:45.171275 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101675    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 17:10:45.171275 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101677    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 17:10:45.171275 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101679    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 17:10:45.171275 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101682    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 17:10:45.171275 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101685    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 17:10:45.171275 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101687    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 17:10:45.171275 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101690    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 17:10:45.171275 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.101692    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 17:10:45.171275 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102421    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 17:10:45.171275 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102428    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 17:10:45.171275 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102432    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 17:10:45.171275 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102435    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 17:10:45.171275 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102438    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 17:10:45.171275 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102441    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 17:10:45.171788 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102444    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 17:10:45.171788 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102446    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 17:10:45.171788 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102449    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 17:10:45.171788 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102452    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 17:10:45.171788 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102454    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 17:10:45.171788 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102457    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 17:10:45.171788 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102460    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 17:10:45.171788 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102462    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 17:10:45.171788 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102464    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 17:10:45.171788 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102467    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 17:10:45.171788 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102470    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 17:10:45.171788 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102473    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 17:10:45.171788 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102477    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 17:10:45.171788 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102481    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 17:10:45.171788 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102485    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 17:10:45.171788 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102489    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 17:10:45.171788 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102491    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 17:10:45.171788 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102494    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 17:10:45.171788 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102497    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 17:10:45.172438 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102500    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 17:10:45.172438 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102502    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 17:10:45.172438 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102505    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 17:10:45.172438 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102508    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 17:10:45.172438 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102511    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 17:10:45.172438 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102513    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 17:10:45.172438 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102516    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 17:10:45.172438 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102518    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 17:10:45.172438 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102521    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 17:10:45.172438 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102525    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 17:10:45.172438 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102529    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 17:10:45.172438 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102532    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 17:10:45.172438 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102534    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 17:10:45.172438 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102537    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 17:10:45.172438 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102540    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 17:10:45.172438 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102543    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 17:10:45.172438 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102546    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 17:10:45.172438 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102548    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 17:10:45.172438 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102552    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 17:10:45.172438 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102554    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 17:10:45.172968 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102557    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 17:10:45.172968 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102560    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 17:10:45.172968 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102562    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 17:10:45.172968 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102565    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 17:10:45.172968 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102567    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 17:10:45.172968 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102570    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 17:10:45.172968 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102572    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 17:10:45.172968 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102575    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 17:10:45.172968 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102578    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 17:10:45.172968 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102581    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 17:10:45.172968 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102583    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 17:10:45.172968 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102586    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 17:10:45.172968 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102588    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 17:10:45.172968 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102591    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 17:10:45.172968 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102594    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 17:10:45.172968 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102596    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 17:10:45.172968 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102599    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 17:10:45.172968 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102602    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 17:10:45.172968 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102604    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 17:10:45.172968 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102607    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 17:10:45.243073 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102610    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 17:10:45.243073 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102612    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 17:10:45.243073 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102614    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 17:10:45.243073 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102617    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 17:10:45.243073 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102619    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 17:10:45.243073 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102622    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 17:10:45.243073 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102625    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 17:10:45.243073 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102628    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 17:10:45.243073 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102631    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 17:10:45.243073 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102634    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 17:10:45.243073 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102637    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 17:10:45.243073 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102640    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 17:10:45.243073 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102643    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 17:10:45.243073 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102645    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 17:10:45.243073 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102648    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 17:10:45.243073 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102650    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 17:10:45.243073 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102653    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 17:10:45.243073 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102656    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 17:10:45.243073 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102659    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 17:10:45.243073 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102661    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 17:10:45.202788 ip-10-0-143-67 systemd[1]: Started Kubernetes Kubelet.
Jul 02 17:10:45.246044 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102664    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 17:10:45.246044 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102666    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 17:10:45.246044 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102669    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 17:10:45.246044 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102671    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 17:10:45.246044 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102674    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 17:10:45.246044 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102676    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 17:10:45.246044 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102679    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 17:10:45.246044 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102681    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 17:10:45.246044 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102684    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 17:10:45.246044 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102688    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 17:10:45.246044 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102691    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 17:10:45.246044 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102694    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 17:10:45.246044 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102696    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 17:10:45.246044 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.102699    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 17:10:45.246044 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103106    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 17:10:45.246044 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103111    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 17:10:45.246044 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103115    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 17:10:45.246044 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103118    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 17:10:45.246044 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103122    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 17:10:45.246671 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103125    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 17:10:45.246671 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103127    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 17:10:45.246671 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103130    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 17:10:45.246671 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103133    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 17:10:45.246671 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103135    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 17:10:45.246671 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103138    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 17:10:45.246671 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103141    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 17:10:45.246671 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103144    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 17:10:45.246671 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103146    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 17:10:45.246671 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103149    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 17:10:45.246671 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103151    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 17:10:45.246671 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103154    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 17:10:45.246671 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103157    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 17:10:45.246671 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103159    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 17:10:45.246671 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103162    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 17:10:45.246671 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103168    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 17:10:45.246671 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103171    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 17:10:45.246671 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103173    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 17:10:45.246671 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103176    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 17:10:45.246671 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103179    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 17:10:45.247311 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103181    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 17:10:45.247311 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103184    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 17:10:45.247311 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103186    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 17:10:45.247311 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103189    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 17:10:45.247311 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103192    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 17:10:45.247311 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103194    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 17:10:45.247311 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103197    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 17:10:45.247311 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103199    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 17:10:45.247311 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103202    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 17:10:45.247311 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103204    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 17:10:45.247311 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103207    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 17:10:45.247311 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103209    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 17:10:45.247311 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103213    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 17:10:45.247311 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103215    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 17:10:45.247311 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103218    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 17:10:45.247311 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103222    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 17:10:45.247311 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103225    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 17:10:45.247311 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103228    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 17:10:45.247311 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103230    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 17:10:45.247987 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103233    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 17:10:45.247987 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103235    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 17:10:45.247987 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103238    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 17:10:45.247987 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103240    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 17:10:45.247987 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103244    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 17:10:45.247987 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103247    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 17:10:45.247987 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103249    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 17:10:45.247987 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103252    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 17:10:45.247987 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103255    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 17:10:45.247987 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103258    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 17:10:45.247987 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103261    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 17:10:45.247987 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103263    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 17:10:45.247987 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103266    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 17:10:45.247987 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103268    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 17:10:45.247987 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103271    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 17:10:45.247987 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103275    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 17:10:45.247987 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103279    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 17:10:45.247987 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103281    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 17:10:45.247987 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103284    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 17:10:45.247987 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103287    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 17:10:45.248606 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103290    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 17:10:45.248606 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103292    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 17:10:45.248606 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103295    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 17:10:45.248606 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103297    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 17:10:45.248606 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103299    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 17:10:45.248606 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103302    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 17:10:45.248606 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103305    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 17:10:45.248606 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103307    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 17:10:45.248606 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103310    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 17:10:45.248606 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103312    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 17:10:45.248606 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103315    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 17:10:45.248606 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103317    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 17:10:45.248606 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103320    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 17:10:45.248606 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103322    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 17:10:45.248606 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103325    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 17:10:45.248606 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103328    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 17:10:45.248606 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103333    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 17:10:45.248606 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103337    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 17:10:45.248606 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103340    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 17:10:45.249218 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103342    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 17:10:45.249218 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103346    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 17:10:45.249218 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103349    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 17:10:45.249218 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103352    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 17:10:45.249218 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103354    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 17:10:45.249218 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103358    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 17:10:45.249218 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103361    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 17:10:45.249218 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103363    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 17:10:45.249218 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103366    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 17:10:45.249218 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103368    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 17:10:45.249218 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103371    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 17:10:45.249218 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103373    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 17:10:45.249218 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103376    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 17:10:45.249218 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103378    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 17:10:45.249218 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103381    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 17:10:45.249218 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.103383    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 17:10:45.249218 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103458    2578 flags.go:64] FLAG: --address="0.0.0.0"
Jul 02 17:10:45.249218 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103465    2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 02 17:10:45.249218 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103471    2578 flags.go:64] FLAG: --anonymous-auth="true"
Jul 02 17:10:45.249218 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103476    2578 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 02 17:10:45.249904 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103481    2578 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 02 17:10:45.249904 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103484    2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 02 17:10:45.249904 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103488    2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 02 17:10:45.249904 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103492    2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 02 17:10:45.249904 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103495    2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 02 17:10:45.249904 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103498    2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 02 17:10:45.249904 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103501    2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 02 17:10:45.249904 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103505    2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 02 17:10:45.249904 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103508    2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 02 17:10:45.249904 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103512    2578 flags.go:64] FLAG: --cgroup-root=""
Jul 02 17:10:45.249904 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103515    2578 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 02 17:10:45.249904 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103518    2578 flags.go:64] FLAG: --client-ca-file=""
Jul 02 17:10:45.249904 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103521    2578 flags.go:64] FLAG: --cloud-provider="external"
Jul 02 17:10:45.249904 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103525    2578 flags.go:64] FLAG: --cluster-dns="[]"
Jul 02 17:10:45.249904 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103530    2578 flags.go:64] FLAG: --cluster-domain=""
Jul 02 17:10:45.249904 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103532    2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 02 17:10:45.249904 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103535    2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 02 17:10:45.249904 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103538    2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 02 17:10:45.249904 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103541    2578 flags.go:64] FLAG: --container-log-max-files="5"
Jul 02 17:10:45.249904 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103545    2578 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 02 17:10:45.249904 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103548    2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 02 17:10:45.249904 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103551    2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 02 17:10:45.249904 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103554    2578 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 02 17:10:45.250587 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103557    2578 flags.go:64] FLAG: --contention-profiling="false"
Jul 02 17:10:45.250587 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103560    2578 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 02 17:10:45.250587 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103562    2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 02 17:10:45.250587 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103565    2578 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 02 17:10:45.250587 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103568    2578 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 02 17:10:45.250587 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103572    2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 02 17:10:45.250587 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103575    2578 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 02 17:10:45.250587 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103578    2578 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 02 17:10:45.250587 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103581    2578 flags.go:64] FLAG: --enable-load-reader="false"
Jul 02 17:10:45.250587 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103584    2578 flags.go:64] FLAG: --enable-server="true"
Jul 02 17:10:45.250587 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103587    2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 02 17:10:45.250587 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103591    2578 flags.go:64] FLAG: --event-burst="100"
Jul 02 17:10:45.250587 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103594    2578 flags.go:64] FLAG: --event-qps="50"
Jul 02 17:10:45.250587 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103597    2578 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 02 17:10:45.250587 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103600    2578 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 02 17:10:45.250587 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103603    2578 flags.go:64] FLAG: --eviction-hard=""
Jul 02 17:10:45.250587 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103607    2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 02 17:10:45.250587 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103610    2578 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 02 17:10:45.250587 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103615    2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 02 17:10:45.250587 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103617    2578 flags.go:64] FLAG: --eviction-soft=""
Jul 02 17:10:45.250587 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103620    2578 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 02 17:10:45.250587 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103623    2578 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 02 17:10:45.250587 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103628    2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 02 17:10:45.250587 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103630    2578 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 02 17:10:45.250587 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103633    2578 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 02 17:10:45.251382 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103636    2578 flags.go:64] FLAG: --fail-swap-on="true"
Jul 02 17:10:45.251382 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103639    2578 flags.go:64] FLAG: --feature-gates=""
Jul 02 17:10:45.251382 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103642    2578 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 02 17:10:45.251382 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103645    2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 02 17:10:45.251382 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103648    2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 02 17:10:45.251382 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103651    2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 02 17:10:45.251382 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103654    2578 flags.go:64] FLAG: --healthz-port="10248"
Jul 02 17:10:45.251382 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103657    2578 flags.go:64] FLAG: --help="false"
Jul 02 17:10:45.251382 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103660    2578 flags.go:64] FLAG: --hostname-override="ip-10-0-143-67.ec2.internal"
Jul 02 17:10:45.251382 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103663    2578 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 02 17:10:45.251382 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103666    2578 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 02 17:10:45.251382 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103668    2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 02 17:10:45.251382 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103672    2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 02 17:10:45.251382 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103675    2578 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 02 17:10:45.251382 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103678    2578 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 02 17:10:45.251382 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103680    2578 flags.go:64] FLAG: --image-service-endpoint=""
Jul 02 17:10:45.251382 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103683    2578 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 02 17:10:45.251382 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103686    2578 flags.go:64] FLAG: --kube-api-burst="100"
Jul 02 17:10:45.251382 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103689    2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 02 17:10:45.251382 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103692    2578 flags.go:64] FLAG: --kube-api-qps="50"
Jul 02 17:10:45.251382 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103695    2578 flags.go:64] FLAG: --kube-reserved=""
Jul 02 17:10:45.251382 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103698    2578 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 02 17:10:45.251382 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103700    2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 02 17:10:45.251382 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103703    2578 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 02 17:10:45.252046 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103706    2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 02 17:10:45.252046 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103711    2578 flags.go:64] FLAG: --lock-file=""
Jul 02 17:10:45.252046 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103713    2578 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 02 17:10:45.252046 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103716    2578 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 02 17:10:45.252046 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103719    2578 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 02 17:10:45.252046 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103725    2578 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 02 17:10:45.252046 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103728    2578 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 02 17:10:45.252046 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103731    2578 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 02 17:10:45.252046 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103734    2578 flags.go:64] FLAG: --logging-format="text"
Jul 02 17:10:45.252046 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103736    2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 02 17:10:45.252046 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103740    2578 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 02 17:10:45.252046 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103743    2578 flags.go:64] FLAG: --manifest-url=""
Jul 02 17:10:45.252046 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103745    2578 flags.go:64] FLAG: --manifest-url-header=""
Jul 02 17:10:45.252046 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103749    2578 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 02 17:10:45.252046 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103752    2578 flags.go:64] FLAG: --max-open-files="1000000"
Jul 02 17:10:45.252046 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103757    2578 flags.go:64] FLAG: --max-pods="110"
Jul 02 17:10:45.252046 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103759    2578 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 02 17:10:45.252046 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103762    2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 02 17:10:45.252046 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103765    2578 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 02 17:10:45.252046 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103768    2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 02 17:10:45.252046 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103771    2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 02 17:10:45.252046 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103774    2578 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 02 17:10:45.252046 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103776    2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 02 17:10:45.252046 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103783    2578 flags.go:64] FLAG: --node-status-max-images="50"
Jul 02 17:10:45.252046 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103786    2578 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 02 17:10:45.252789 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103789    2578 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 02 17:10:45.252789 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103792    2578 flags.go:64] FLAG: --pod-cidr=""
Jul 02 17:10:45.252789 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103796    2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a2632cd31d78133be7b5fb6999469b2acf9b98d077c7f6ae5d0d94083d76b04"
Jul 02 17:10:45.252789 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103801    2578 flags.go:64] FLAG: --pod-manifest-path=""
Jul 02 17:10:45.252789 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103804    2578 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 02 17:10:45.252789 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103807    2578 flags.go:64] FLAG: --pods-per-core="0"
Jul 02 17:10:45.252789 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103810    2578 flags.go:64] FLAG: --port="10250"
Jul 02 17:10:45.252789 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103813    2578 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 02 17:10:45.252789 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103817    2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08edc0f7bccb2e190"
Jul 02 17:10:45.252789 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103820    2578 flags.go:64] FLAG: --qos-reserved=""
Jul 02 17:10:45.252789 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103823    2578 flags.go:64] FLAG: --read-only-port="10255"
Jul 02 17:10:45.252789 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103826    2578 flags.go:64] FLAG: --register-node="true"
Jul 02 17:10:45.252789 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103829    2578 flags.go:64] FLAG: --register-with-taints=""
Jul 02 17:10:45.252789 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103834    2578 flags.go:64] FLAG: --registry-burst="10"
Jul 02 17:10:45.252789 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103836    2578 flags.go:64] FLAG: --registry-qps="5"
Jul 02 17:10:45.252789 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103839    2578 flags.go:64] FLAG: --reserved-cpus=""
Jul 02 17:10:45.252789 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103842    2578 flags.go:64] FLAG: --reserved-memory=""
Jul 02 17:10:45.252789 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103846    2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 02 17:10:45.252789 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103849    2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 02 17:10:45.252789 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103852    2578 flags.go:64] FLAG: --rotate-certificates="false"
Jul 02 17:10:45.252789 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103855    2578 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 02 17:10:45.252789 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103857    2578 flags.go:64] FLAG: --runonce="false"
Jul 02 17:10:45.252789 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103860    2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 02 17:10:45.252789 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103863    2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 02 17:10:45.252789 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103866    2578 flags.go:64] FLAG: --seccomp-default="false"
Jul 02 17:10:45.253496 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103869    2578 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 02 17:10:45.253496 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103872    2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 02 17:10:45.253496 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103874    2578 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 02 17:10:45.253496 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103878    2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 02 17:10:45.253496 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103881    2578 flags.go:64] FLAG: --storage-driver-password="root"
Jul 02 17:10:45.253496 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103884    2578 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 02 17:10:45.253496 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103887    2578 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 02 17:10:45.253496 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103890    2578 flags.go:64] FLAG: --storage-driver-user="root"
Jul 02 17:10:45.253496 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103892    2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 02 17:10:45.253496 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103895    2578 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 02 17:10:45.253496 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103898    2578 flags.go:64] FLAG: --system-cgroups=""
Jul 02 17:10:45.253496 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103901    2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 02 17:10:45.253496 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103907    2578 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 02 17:10:45.253496 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103909    2578 flags.go:64] FLAG: --tls-cert-file=""
Jul 02 17:10:45.253496 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103912    2578 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 02 17:10:45.253496 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103918    2578 flags.go:64] FLAG: --tls-min-version=""
Jul 02 17:10:45.253496 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103921    2578 flags.go:64] FLAG: --tls-private-key-file=""
Jul 02 17:10:45.253496 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103924    2578 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 02 17:10:45.253496 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103926    2578 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 02 17:10:45.253496 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103929    2578 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 02 17:10:45.253496 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103933    2578 flags.go:64] FLAG: --v="2"
Jul 02 17:10:45.253496 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103937    2578 flags.go:64] FLAG: --version="false"
Jul 02 17:10:45.253496 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103941    2578 flags.go:64] FLAG: --vmodule=""
Jul 02 17:10:45.253496 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103944    2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 02 17:10:45.253496 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.103947    2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 02 17:10:45.254351 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104086    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 17:10:45.254351 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104091    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 17:10:45.254351 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104094    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 17:10:45.254351 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104097    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 17:10:45.254351 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104100    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 17:10:45.254351 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104104    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 17:10:45.254351 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104106    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 17:10:45.254351 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104109    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 17:10:45.254351 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104112    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 17:10:45.254351 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104115    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 17:10:45.254351 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104117    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 17:10:45.254351 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104122    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 17:10:45.254351 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104125    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 17:10:45.254351 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104128    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 17:10:45.254351 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104130    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 17:10:45.254351 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104133    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 17:10:45.254351 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104136    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 17:10:45.254351 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104138    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 17:10:45.254351 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104141    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 17:10:45.254351 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104144    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 17:10:45.255220 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104147    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 17:10:45.255220 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104149    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 17:10:45.255220 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104154    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 17:10:45.255220 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104156    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 17:10:45.255220 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104159    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 17:10:45.255220 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104161    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 17:10:45.255220 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104164    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 17:10:45.255220 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104168    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 17:10:45.255220 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104170    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 17:10:45.255220 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104173    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 17:10:45.255220 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104175    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 17:10:45.255220 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104178    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 17:10:45.255220 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104181    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 17:10:45.255220 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104183    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 17:10:45.255220 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104186    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 17:10:45.255220 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104189    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 17:10:45.255220 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104191    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 17:10:45.255220 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104194    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 17:10:45.255220 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104196    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 17:10:45.255220 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104199    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 17:10:45.256302 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104201    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 17:10:45.256302 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104203    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 17:10:45.256302 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104206    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 17:10:45.256302 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104208    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 17:10:45.256302 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104211    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 17:10:45.256302 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104213    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 17:10:45.256302 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104216    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 17:10:45.256302 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104218    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 17:10:45.256302 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104221    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 17:10:45.256302 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104223    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 17:10:45.256302 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104226    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 17:10:45.256302 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104229    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 17:10:45.256302 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104231    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 17:10:45.256302 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104234    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 17:10:45.256302 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104238    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 17:10:45.256302 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104240    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 17:10:45.256302 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104244    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 17:10:45.256302 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104247    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 17:10:45.256302 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104249    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 17:10:45.256930 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104253    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 17:10:45.256930 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104256    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 17:10:45.256930 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104259    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 17:10:45.256930 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104261    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 17:10:45.256930 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104264    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 17:10:45.256930 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104266    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 17:10:45.256930 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104269    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 17:10:45.256930 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104271    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 17:10:45.256930 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104274    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 17:10:45.256930 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104276    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 17:10:45.256930 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104279    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 17:10:45.256930 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104282    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 17:10:45.256930 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104284    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 17:10:45.256930 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104286    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 17:10:45.256930 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104289    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 17:10:45.256930 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104291    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 17:10:45.256930 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104294    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 17:10:45.256930 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104296    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 17:10:45.256930 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104299    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 17:10:45.256930 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104301    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 17:10:45.257572 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104303    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 17:10:45.257572 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104306    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 17:10:45.257572 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104309    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 17:10:45.257572 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104311    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 17:10:45.257572 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104314    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 17:10:45.257572 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104317    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 17:10:45.257572 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104319    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 17:10:45.257572 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104324    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 17:10:45.257572 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104326    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 17:10:45.257572 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104330    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 17:10:45.257572 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104333    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 17:10:45.257572 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104336    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 17:10:45.257572 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104341    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 17:10:45.257572 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104344    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 17:10:45.257572 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104346    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 17:10:45.257572 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104349    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 17:10:45.257572 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104351    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 17:10:45.257572 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104354    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 17:10:45.257572 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104356    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 17:10:45.257572 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.104359    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 17:10:45.317606 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.104920    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 02 17:10:45.317606 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.111625    2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 02 17:10:45.317606 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.111639    2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 02 17:10:45.317606 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.112513    2578 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 02 17:10:45.317606 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.112521    2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 02 17:10:45.317606 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112601    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 17:10:45.317606 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112608    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 17:10:45.317606 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112612    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 17:10:45.317606 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112615    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 17:10:45.317606 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112618    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 17:10:45.317606 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112621    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 17:10:45.317606 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112624    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 17:10:45.317606 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112627    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 17:10:45.317606 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112630    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 17:10:45.318191 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112632    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 17:10:45.318191 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112635    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 17:10:45.318191 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112638    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 17:10:45.318191 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112642    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 17:10:45.318191 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112645    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 17:10:45.318191 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112648    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 17:10:45.318191 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112650    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 17:10:45.318191 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112653    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 17:10:45.318191 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112655    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 17:10:45.318191 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112658    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 17:10:45.318191 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112662    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 17:10:45.318191 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112666    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 17:10:45.318191 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112669    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 17:10:45.318191 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112672    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 17:10:45.318191 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112674    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 17:10:45.318191 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112677    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 17:10:45.318191 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112680    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 17:10:45.318191 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112682    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 17:10:45.318191 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112685    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 17:10:45.318191 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112688    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 17:10:45.319200 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112690    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 17:10:45.319200 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112693    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 17:10:45.319200 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112696    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 17:10:45.319200 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112698    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 17:10:45.319200 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112701    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 17:10:45.319200 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112704    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 17:10:45.319200 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112707    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 17:10:45.319200 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112709    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 17:10:45.319200 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112712    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 17:10:45.319200 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112714    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 17:10:45.319200 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112717    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 17:10:45.319200 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112720    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 17:10:45.319200 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112722    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 17:10:45.319200 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112725    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 17:10:45.319200 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112727    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 17:10:45.319200 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112730    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 17:10:45.319200 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112733    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 17:10:45.319200 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112735    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 17:10:45.319200 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112738    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 17:10:45.319200 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112740    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 17:10:45.319885 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112743    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 17:10:45.319885 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112745    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 17:10:45.319885 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112748    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 17:10:45.319885 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112750    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 17:10:45.319885 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112753    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 17:10:45.319885 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112756    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 17:10:45.319885 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112761    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 17:10:45.319885 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112764    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 17:10:45.319885 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112766    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 17:10:45.319885 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112769    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 17:10:45.319885 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112771    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 17:10:45.319885 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112774    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 17:10:45.319885 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112777    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 17:10:45.319885 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112779    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 17:10:45.319885 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112782    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 17:10:45.319885 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112785    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 17:10:45.319885 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112787    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 17:10:45.319885 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112790    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 17:10:45.319885 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112793    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 17:10:45.319885 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112796    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 17:10:45.320504 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112798    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 17:10:45.320504 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112801    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 17:10:45.320504 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112803    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 17:10:45.320504 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112806    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 17:10:45.320504 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112810    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 17:10:45.320504 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112813    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 17:10:45.320504 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112817    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 17:10:45.320504 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112820    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 17:10:45.320504 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112822    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 17:10:45.320504 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112825    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 17:10:45.320504 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112828    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 17:10:45.320504 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112831    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 17:10:45.320504 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112833    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 17:10:45.320504 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112836    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 17:10:45.320504 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112838    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 17:10:45.320504 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112840    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 17:10:45.320504 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112843    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 17:10:45.320504 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112845    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 17:10:45.320504 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112849    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 17:10:45.320504 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112852    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 17:10:45.321797 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112855    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 17:10:45.321797 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112858    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 17:10:45.321797 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112861    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 17:10:45.321797 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112864    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 17:10:45.321797 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112866    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 17:10:45.321797 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112868    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 17:10:45.321797 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112873    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 17:10:45.321797 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112875    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 17:10:45.321797 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112878    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 17:10:45.321797 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.112880    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 17:10:45.321797 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.112886    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 02 17:10:45.321797 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113006    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 17:10:45.321797 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113010    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 17:10:45.321797 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113026    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 17:10:45.321797 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113030    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 17:10:45.322704 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113033    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 17:10:45.322704 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113036    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 17:10:45.322704 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113038    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 17:10:45.322704 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113041    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 17:10:45.322704 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113044    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 17:10:45.322704 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113046    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 17:10:45.322704 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113048    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 17:10:45.322704 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113052    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 17:10:45.322704 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113055    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 17:10:45.322704 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113058    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 17:10:45.322704 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113061    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 17:10:45.322704 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113066    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 17:10:45.322704 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113070    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 17:10:45.322704 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113073    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 17:10:45.322704 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113076    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 17:10:45.322704 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113078    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 17:10:45.322704 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113082    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 17:10:45.322704 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113085    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 17:10:45.322704 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113088    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 17:10:45.322704 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113090    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 17:10:45.324874 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113093    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 17:10:45.324874 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113095    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 17:10:45.324874 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113098    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 17:10:45.324874 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113102    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 17:10:45.324874 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113104    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 17:10:45.324874 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113107    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 17:10:45.324874 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113110    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 17:10:45.324874 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113112    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 17:10:45.324874 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113115    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 17:10:45.324874 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113117    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 17:10:45.324874 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113120    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 17:10:45.324874 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113122    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 17:10:45.324874 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113125    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 17:10:45.324874 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113127    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 17:10:45.324874 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113130    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 17:10:45.324874 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113132    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 17:10:45.324874 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113135    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 17:10:45.324874 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113137    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 17:10:45.324874 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113139    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 17:10:45.324874 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113142    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 17:10:45.325524 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113145    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 17:10:45.325524 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113147    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 17:10:45.325524 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113150    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 17:10:45.325524 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113152    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 17:10:45.325524 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113155    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 17:10:45.325524 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113157    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 17:10:45.325524 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113160    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 17:10:45.325524 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113162    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 17:10:45.325524 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113166    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 17:10:45.325524 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113169    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 17:10:45.325524 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113171    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 17:10:45.325524 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113174    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 17:10:45.325524 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113176    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 17:10:45.325524 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113179    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 17:10:45.325524 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113181    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 17:10:45.325524 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113186    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 17:10:45.325524 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113189    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 17:10:45.325524 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113193    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 17:10:45.325524 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113196    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 17:10:45.326790 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113199    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 17:10:45.326790 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113202    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 17:10:45.326790 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113205    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 17:10:45.326790 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113207    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 17:10:45.326790 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113210    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 17:10:45.326790 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113213    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 17:10:45.326790 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113215    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 17:10:45.326790 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113218    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 17:10:45.326790 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113220    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 17:10:45.326790 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113223    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 17:10:45.326790 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113225    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 17:10:45.326790 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113228    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 17:10:45.326790 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113231    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 17:10:45.326790 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113233    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 17:10:45.326790 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113236    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 17:10:45.326790 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113238    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 17:10:45.326790 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113241    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 17:10:45.326790 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113243    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 17:10:45.326790 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113246    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 17:10:45.326790 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113248    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 17:10:45.327437 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113251    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 17:10:45.327437 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113254    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 17:10:45.327437 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113257    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 17:10:45.327437 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113259    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 17:10:45.327437 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113262    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 17:10:45.327437 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113264    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 17:10:45.327437 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113267    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 17:10:45.327437 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113270    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 17:10:45.327437 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113273    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 17:10:45.327437 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113276    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 17:10:45.327437 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113279    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 17:10:45.327437 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113281    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 17:10:45.327437 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113284    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 17:10:45.327437 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113286    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 17:10:45.327437 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113289    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 17:10:45.327437 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:45.113291    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 17:10:45.328295 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.113296    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 02 17:10:45.328295 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.113398    2578 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 02 17:10:45.328295 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.115238    2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 02 17:10:45.328295 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.116525    2578 server.go:1019] "Starting client certificate rotation"
Jul 02 17:10:45.328295 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.116635    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 02 17:10:45.328295 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.116673    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 02 17:10:45.328295 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.119217    2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 02 17:10:45.328295 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.126221    2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 02 17:10:45.328295 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.148428    2578 log.go:25] "Validated CRI v1 runtime API"
Jul 02 17:10:45.328295 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.148901    2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 02 17:10:45.328295 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.150493    2578 log.go:25] "Validated CRI v1 image API"
Jul 02 17:10:45.328295 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.151320    2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 02 17:10:45.328718 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.155567    2578 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 8921272c-8888-445b-a9da-625f333a2b6e:/dev/nvme0n1p4 d5dbfb54-ea3c-466c-9462-ffb4aed520b3:/dev/nvme0n1p3]
Jul 02 17:10:45.328718 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.155587    2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 02 17:10:45.329998 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.160978    2578 manager.go:216] Machine: {Timestamp:2026-07-02 17:10:45.159684953 +0000 UTC m=+0.349387606 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3089145 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2559f209c95f19181d1a3405cc7fed SystemUUID:ec2559f2-09c9-5f19-181d-1a3405cc7fed BootID:4d061645-0cb8-447c-a35c-c22f8262c790 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:3e:35:9e:98:69 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:3e:35:9e:98:69 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:96:95:02:96:d3:73 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 02 17:10:45.329998 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.161088    2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 02 17:10:45.329998 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.161201    2578 manager.go:232] Version: {KernelVersion:5.14.0-570.124.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260623-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 02 17:10:45.329998 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.169457    2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 02 17:10:45.329998 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.169485    2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-67.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 02 17:10:45.329998 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.170215    2578 topology_manager.go:138] "Creating topology manager with none policy"
Jul 02 17:10:45.329998 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.170225    2578 container_manager_linux.go:309] "Creating device plugin manager"
Jul 02 17:10:45.329998 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.170233    2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 02 17:10:45.329998 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.170800    2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 02 17:10:45.329998 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.172154    2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 02 17:10:45.329998 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.175221    2578 state_mem.go:36] "Initialized new in-memory state store"
Jul 02 17:10:45.329998 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.175329    2578 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 02 17:10:45.329998 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.175355    2578 kubelet.go:486] "Attempting to sync node with API server"
Jul 02 17:10:45.329998 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.175365    2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 02 17:10:45.329998 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.175380    2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 02 17:10:45.329998 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.175389    2578 kubelet.go:398] "Adding apiserver pod source"
Jul 02 17:10:45.329998 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.175417    2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 02 17:10:45.329998 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.175888    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 02 17:10:45.330628 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.175915    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 02 17:10:45.330628 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.185139    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-27wjw"
Jul 02 17:10:45.330628 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.186899    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-27wjw"
Jul 02 17:10:45.330628 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.187950    2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 02 17:10:45.330628 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.189191    2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 02 17:10:45.330628 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.189219    2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 02 17:10:45.330628 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.189815    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 02 17:10:45.330628 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.189836    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 02 17:10:45.330628 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.189843    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 02 17:10:45.330628 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.189849    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 02 17:10:45.330628 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.189858    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 02 17:10:45.330628 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.189865    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 02 17:10:45.330628 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.197883    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 02 17:10:45.330628 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.197894    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 02 17:10:45.330628 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.197905    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 02 17:10:45.330628 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.197917    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 02 17:10:45.330628 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.197931    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 02 17:10:45.330628 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.197944    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 02 17:10:45.330628 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:10:45.198138    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-67.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 02 17:10:45.330628 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:10:45.198208    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 02 17:10:45.330628 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.198786    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 02 17:10:45.330628 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.198795    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 02 17:10:45.330628 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.201975    2578 server.go:1268] "Started kubelet"
Jul 02 17:10:45.330628 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.202095    2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 02 17:10:45.330628 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.202219    2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 02 17:10:45.330628 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.202278    2578 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 02 17:10:45.330628 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.204036    2578 server.go:310] "Adding debug handlers to kubelet server"
Jul 02 17:10:45.330628 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.205774    2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 02 17:10:45.330628 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.206090    2578 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-143-67.ec2.internal" not found
Jul 02 17:10:45.330628 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:10:45.208959    2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 02 17:10:45.330628 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.212240    2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 02 17:10:45.330628 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.212243    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 02 17:10:45.330628 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:10:45.212336    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-67.ec2.internal\" not found"
Jul 02 17:10:45.330628 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.212670    2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 02 17:10:45.330628 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.212675    2578 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 02 17:10:45.330628 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.212705    2578 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 02 17:10:45.330628 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.212776    2578 reconstruct.go:97] "Volume reconstruction finished"
Jul 02 17:10:45.330628 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.212785    2578 reconciler.go:29] "Reconciler: start to sync state"
Jul 02 17:10:45.330628 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.213097    2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 02 17:10:45.330628 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.213109    2578 factory.go:55] Registering systemd factory
Jul 02 17:10:45.330628 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.213120    2578 factory.go:223] Registration of the systemd container factory successfully
Jul 02 17:10:45.330628 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.213286    2578 factory.go:153] Registering CRI-O factory
Jul 02 17:10:45.330628 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.213296    2578 factory.go:223] Registration of the crio container factory successfully
Jul 02 17:10:45.330628 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.213314    2578 factory.go:103] Registering Raw factory
Jul 02 17:10:45.330628 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.213329    2578 manager.go:1196] Started watching for new ooms in manager
Jul 02 17:10:45.330628 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.213876    2578 manager.go:349] Starting recovery of all containers
Jul 02 17:10:45.330628 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.216982    2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 17:10:45.330628 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:10:45.221600    2578 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-143-67.ec2.internal\" not found" node="ip-10-0-143-67.ec2.internal"
Jul 02 17:10:45.331925 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.226680    2578 manager.go:354] Recovery completed
Jul 02 17:10:45.331925 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.227776    2578 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-143-67.ec2.internal" not found
Jul 02 17:10:45.331925 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.231854    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 17:10:45.331925 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.235973    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-67.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 17:10:45.331925 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.236001    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-67.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 17:10:45.331925 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.236032    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-67.ec2.internal" event="NodeHasSufficientPID"
Jul 02 17:10:45.331925 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.236518    2578 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 02 17:10:45.331925 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.236529    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 17:10:45.331925 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.236529    2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 02 17:10:45.331925 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.236605    2578 state_mem.go:36] "Initialized new in-memory state store"
Jul 02 17:10:45.331925 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.237665    2578 policy_none.go:49] "None policy: Start"
Jul 02 17:10:45.331925 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.237677    2578 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 02 17:10:45.331925 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.237686    2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 02 17:10:45.331925 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.238579    2578 policy_none.go:47] "Start"
Jul 02 17:10:45.331925 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.238882    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-67.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 17:10:45.331925 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.239112    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-67.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 17:10:45.331925 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.239323    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-67.ec2.internal" event="NodeHasSufficientPID"
Jul 02 17:10:45.331925 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.294690    2578 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-143-67.ec2.internal" not found
Jul 02 17:10:45.331925 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:10:45.312664    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-67.ec2.internal\" not found"
Jul 02 17:10:45.397911 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.352710    2578 manager.go:337] "Starting Device Plugin manager"
Jul 02 17:10:45.397911 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:10:45.352742    2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 02 17:10:45.397911 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.352755    2578 server.go:87] "Starting device plugin registration server"
Jul 02 17:10:45.397911 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.353076    2578 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 02 17:10:45.397911 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.353089    2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 02 17:10:45.397911 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.353178    2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 02 17:10:45.397911 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.353279    2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 02 17:10:45.397911 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.353287    2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 02 17:10:45.397911 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:10:45.354480    2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 02 17:10:45.397911 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:10:45.354522    2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-67.ec2.internal\" not found"
Jul 02 17:10:45.477309 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.453442    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 17:10:45.477309 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.455637    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-67.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 17:10:45.477309 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.455663    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-67.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 17:10:45.477309 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.455673    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-67.ec2.internal" event="NodeHasSufficientPID"
Jul 02 17:10:45.477309 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.455700    2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-67.ec2.internal"
Jul 02 17:10:45.477309 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.465394    2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-67.ec2.internal"
Jul 02 17:10:45.477309 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:10:45.465417    2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-67.ec2.internal\": node \"ip-10-0-143-67.ec2.internal\" not found"
Jul 02 17:10:45.493098 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.482457    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 02 17:10:45.493098 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.489485    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 02 17:10:45.493098 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.489532    2578 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 02 17:10:45.493098 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.489561    2578 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 02 17:10:45.493098 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:10:45.489602    2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 02 17:10:45.493098 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.492264    2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 17:10:45.558981 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:10:45.522435    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-67.ec2.internal\" not found"
Jul 02 17:10:45.680619 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.590337    2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-67.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-67.ec2.internal"]
Jul 02 17:10:45.680619 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.590427    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 17:10:45.680619 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.598225    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-67.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 17:10:45.680619 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.598260    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-67.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 17:10:45.680619 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.598272    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-67.ec2.internal" event="NodeHasSufficientPID"
Jul 02 17:10:45.680619 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.599631    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 17:10:45.680619 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.599761    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-67.ec2.internal"
Jul 02 17:10:45.680619 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.599790    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 17:10:45.680619 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.600382    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-67.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 17:10:45.680619 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.600409    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-67.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 17:10:45.680619 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.600418    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-67.ec2.internal" event="NodeHasSufficientPID"
Jul 02 17:10:45.680619 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.600385    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-67.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 17:10:45.680619 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.600469    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-67.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 17:10:45.680619 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.600478    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-67.ec2.internal" event="NodeHasSufficientPID"
Jul 02 17:10:45.680619 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.601462    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-67.ec2.internal"
Jul 02 17:10:45.680619 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.601486    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 17:10:45.680619 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.602116    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-67.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 17:10:45.680619 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.602143    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-67.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 17:10:45.680619 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.602153    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-67.ec2.internal" event="NodeHasSufficientPID"
Jul 02 17:10:45.680619 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:10:45.622986    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-67.ec2.internal\" not found"
Jul 02 17:10:45.680619 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.623082    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ffc3b6c26cb60d94275aa594f7eb9639-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-67.ec2.internal\" (UID: \"ffc3b6c26cb60d94275aa594f7eb9639\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-67.ec2.internal"
Jul 02 17:10:45.680619 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.623108    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ffc3b6c26cb60d94275aa594f7eb9639-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-67.ec2.internal\" (UID: \"ffc3b6c26cb60d94275aa594f7eb9639\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-67.ec2.internal"
Jul 02 17:10:45.680619 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.623130    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6a1d014754611bbab3feb2df8e5c006f-config\") pod \"kube-apiserver-proxy-ip-10-0-143-67.ec2.internal\" (UID: \"6a1d014754611bbab3feb2df8e5c006f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-67.ec2.internal"
Jul 02 17:10:45.680619 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:10:45.631639    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-67.ec2.internal\" not found" node="ip-10-0-143-67.ec2.internal"
Jul 02 17:10:45.680619 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:10:45.635785    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-67.ec2.internal\" not found" node="ip-10-0-143-67.ec2.internal"
Jul 02 17:10:45.774172 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:10:45.723384    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-67.ec2.internal\" not found"
Jul 02 17:10:45.774172 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.723474    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6a1d014754611bbab3feb2df8e5c006f-config\") pod \"kube-apiserver-proxy-ip-10-0-143-67.ec2.internal\" (UID: \"6a1d014754611bbab3feb2df8e5c006f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-67.ec2.internal"
Jul 02 17:10:45.774172 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.723431    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6a1d014754611bbab3feb2df8e5c006f-config\") pod \"kube-apiserver-proxy-ip-10-0-143-67.ec2.internal\" (UID: \"6a1d014754611bbab3feb2df8e5c006f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-67.ec2.internal"
Jul 02 17:10:45.774172 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.723519    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ffc3b6c26cb60d94275aa594f7eb9639-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-67.ec2.internal\" (UID: \"ffc3b6c26cb60d94275aa594f7eb9639\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-67.ec2.internal"
Jul 02 17:10:45.774172 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.723536    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ffc3b6c26cb60d94275aa594f7eb9639-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-67.ec2.internal\" (UID: \"ffc3b6c26cb60d94275aa594f7eb9639\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-67.ec2.internal"
Jul 02 17:10:45.774172 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.723562    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ffc3b6c26cb60d94275aa594f7eb9639-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-67.ec2.internal\" (UID: \"ffc3b6c26cb60d94275aa594f7eb9639\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-67.ec2.internal"
Jul 02 17:10:45.774172 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.723584    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ffc3b6c26cb60d94275aa594f7eb9639-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-67.ec2.internal\" (UID: \"ffc3b6c26cb60d94275aa594f7eb9639\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-67.ec2.internal"
Jul 02 17:10:45.847629 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:10:45.833205    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-67.ec2.internal\" not found"
Jul 02 17:10:45.940481 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.934179    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-67.ec2.internal"
Jul 02 17:10:45.940481 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:10:45.934203    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-67.ec2.internal\" not found"
Jul 02 17:10:45.940481 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:45.940394    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-67.ec2.internal"
Jul 02 17:10:46.035380 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:10:46.035307    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-67.ec2.internal\" not found"
Jul 02 17:10:46.115660 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.115628    2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 02 17:10:46.115800 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.115781    2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 02 17:10:46.115857 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.115831    2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 02 17:10:46.135128 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.135106    2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 17:10:46.176291 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.176264    2578 apiserver.go:52] "Watching apiserver"
Jul 02 17:10:46.182399 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.182378    2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 17:10:46.184612 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.184596    2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 02 17:10:46.185520 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.185500    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l852t","openshift-image-registry/node-ca-cr9bq","openshift-multus/multus-additional-cni-plugins-87dbx","openshift-network-diagnostics/network-check-target-p5sdw","openshift-network-operator/iptables-alerter-tcwxf","kube-system/global-pull-secret-syncer-cwjw5","kube-system/konnectivity-agent-bvtjp","openshift-cluster-node-tuning-operator/tuned-wkl8x","openshift-dns/node-resolver-vfd4d","openshift-multus/multus-kbqsq","openshift-multus/network-metrics-daemon-g67j2","openshift-ovn-kubernetes/ovnkube-node-62g9m"]
Jul 02 17:10:46.186938 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.186924    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l852t"
Jul 02 17:10:46.187846 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.187827    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cr9bq"
Jul 02 17:10:46.188920 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.188902    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-87dbx"
Jul 02 17:10:46.189555 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.189538    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 02 17:10:46.189555 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.189554    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 02 17:10:46.189681 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.189584    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-6jk7w\""
Jul 02 17:10:46.189859 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.189845    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 02 17:10:46.190057 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.190044    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p5sdw"
Jul 02 17:10:46.190128 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:10:46.190092    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p5sdw" podUID="fb3341a1-f14e-40be-8591-28a12d33716b"
Jul 02 17:10:46.190128 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.190078    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-01 17:05:45 +0000 UTC" deadline="2028-04-19 04:33:52.754622412 +0000 UTC"
Jul 02 17:10:46.190128 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.190122    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15755h23m6.564504105s"
Jul 02 17:10:46.190295 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.190184    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 02 17:10:46.190295 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.190199    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 02 17:10:46.190367 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.190324    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 02 17:10:46.190424 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.190410    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-kp6n2\""
Jul 02 17:10:46.191092 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.191079    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tcwxf"
Jul 02 17:10:46.191264 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.191243    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 02 17:10:46.191391 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.191373    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 02 17:10:46.191537 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.191525    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 02 17:10:46.191801 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.191787    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 02 17:10:46.191869 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.191802    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 02 17:10:46.192223 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.192204    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cwjw5"
Jul 02 17:10:46.192308 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:10:46.192262    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cwjw5" podUID="5ac2c336-c8a9-484a-83df-60182dc9faf5"
Jul 02 17:10:46.192424 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.192413    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-8bn7z\""
Jul 02 17:10:46.193219 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.193206    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 02 17:10:46.193310 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.193296    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 02 17:10:46.193489 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.193475    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bvtjp"
Jul 02 17:10:46.193856 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.193840    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-t4w6d\""
Jul 02 17:10:46.193914 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.193858    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 02 17:10:46.194431 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.194419    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wkl8x"
Jul 02 17:10:46.195405 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.195391    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vfd4d"
Jul 02 17:10:46.195927 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.195913    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-2qcf4\""
Jul 02 17:10:46.196000 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.195952    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 02 17:10:46.196059 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.196007    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 02 17:10:46.196525 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.196509    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kbqsq"
Jul 02 17:10:46.196608 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.196589    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 02 17:10:46.196891 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.196875    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 02 17:10:46.196959 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.196907    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-862jn\""
Jul 02 17:10:46.197959 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.197940    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 02 17:10:46.198069 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.197944    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 02 17:10:46.198069 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.198066    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g67j2"
Jul 02 17:10:46.198175 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:10:46.198135    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g67j2" podUID="d1d3526d-01f3-4e77-a78e-ac8954a7a207"
Jul 02 17:10:46.198223 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.198212    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-zc567\""
Jul 02 17:10:46.198727 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.198704    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 02 17:10:46.198807 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.198703    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-tshjw\""
Jul 02 17:10:46.199175 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.199162    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-62g9m"
Jul 02 17:10:46.203895 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.201681    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 02 17:10:46.203895 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.201789    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 02 17:10:46.203895 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.202151    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 02 17:10:46.203895 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.202430    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 02 17:10:46.203895 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.202495    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 02 17:10:46.203895 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.202704    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 02 17:10:46.203895 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.202945    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-lpbjg\""
Jul 02 17:10:46.212391 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.212368    2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-67.ec2.internal"
Jul 02 17:10:46.212490 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.212397    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 02 17:10:46.213593 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.213574    2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 02 17:10:46.232291 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.232270    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 02 17:10:46.232381 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.232294    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-67.ec2.internal"]
Jul 02 17:10:46.232381 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.232336    2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-67.ec2.internal"
Jul 02 17:10:46.234929 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.234913    2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 02 17:10:46.235031 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.234938    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/de6a6072-1ba3-44d4-8fbd-4e332b70d7a5-serviceca\") pod \"node-ca-cr9bq\" (UID: \"de6a6072-1ba3-44d4-8fbd-4e332b70d7a5\") " pod="openshift-image-registry/node-ca-cr9bq"
Jul 02 17:10:46.235031 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.234963    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2d56f816-270b-4962-b1f0-2e5b8acdb3ce-os-release\") pod \"multus-additional-cni-plugins-87dbx\" (UID: \"2d56f816-270b-4962-b1f0-2e5b8acdb3ce\") " pod="openshift-multus/multus-additional-cni-plugins-87dbx"
Jul 02 17:10:46.235031 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.234987    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/31c6d25a-09ab-4af9-bda6-e98f486b8f6f-etc-sysctl-d\") pod \"tuned-wkl8x\" (UID: \"31c6d25a-09ab-4af9-bda6-e98f486b8f6f\") " pod="openshift-cluster-node-tuning-operator/tuned-wkl8x"
Jul 02 17:10:46.235172 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.235051    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2djdv\" (UniqueName: \"kubernetes.io/projected/8f4635ce-bab5-4ebd-8db9-2837729fd121-kube-api-access-2djdv\") pod \"multus-kbqsq\" (UID: \"8f4635ce-bab5-4ebd-8db9-2837729fd121\") " pod="openshift-multus/multus-kbqsq"
Jul 02 17:10:46.235172 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.235080    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d6628590-1cf7-4a61-9350-539f3ae7ed91-run-systemd\") pod \"ovnkube-node-62g9m\" (UID: \"d6628590-1cf7-4a61-9350-539f3ae7ed91\") " pod="openshift-ovn-kubernetes/ovnkube-node-62g9m"
Jul 02 17:10:46.235172 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.235106    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d6628590-1cf7-4a61-9350-539f3ae7ed91-host-cni-bin\") pod \"ovnkube-node-62g9m\" (UID: \"d6628590-1cf7-4a61-9350-539f3ae7ed91\") " pod="openshift-ovn-kubernetes/ovnkube-node-62g9m"
Jul 02 17:10:46.235172 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.235127    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ab1d35cf-6b41-4851-9bf6-3f0de96ef752-socket-dir\") pod \"aws-ebs-csi-driver-node-l852t\" (UID: \"ab1d35cf-6b41-4851-9bf6-3f0de96ef752\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l852t"
Jul 02 17:10:46.235172 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.235142    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5n68w\" (UniqueName: \"kubernetes.io/projected/fb0fdece-96ab-471d-87e5-89e41822fd53-kube-api-access-5n68w\") pod \"node-resolver-vfd4d\" (UID: \"fb0fdece-96ab-471d-87e5-89e41822fd53\") " pod="openshift-dns/node-resolver-vfd4d"
Jul 02 17:10:46.235172 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.235157    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/31c6d25a-09ab-4af9-bda6-e98f486b8f6f-run\") pod \"tuned-wkl8x\" (UID: \"31c6d25a-09ab-4af9-bda6-e98f486b8f6f\") " pod="openshift-cluster-node-tuning-operator/tuned-wkl8x"
Jul 02 17:10:46.235334 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.235178    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8f4635ce-bab5-4ebd-8db9-2837729fd121-cni-binary-copy\") pod \"multus-kbqsq\" (UID: \"8f4635ce-bab5-4ebd-8db9-2837729fd121\") " pod="openshift-multus/multus-kbqsq"
Jul 02 17:10:46.235334 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.235204    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8f4635ce-bab5-4ebd-8db9-2837729fd121-multus-socket-dir-parent\") pod \"multus-kbqsq\" (UID: \"8f4635ce-bab5-4ebd-8db9-2837729fd121\") " pod="openshift-multus/multus-kbqsq"
Jul 02 17:10:46.235334 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.235228    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f4635ce-bab5-4ebd-8db9-2837729fd121-host-var-lib-kubelet\") pod \"multus-kbqsq\" (UID: \"8f4635ce-bab5-4ebd-8db9-2837729fd121\") " pod="openshift-multus/multus-kbqsq"
Jul 02 17:10:46.235334 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.235256    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8f4635ce-bab5-4ebd-8db9-2837729fd121-multus-conf-dir\") pod \"multus-kbqsq\" (UID: \"8f4635ce-bab5-4ebd-8db9-2837729fd121\") " pod="openshift-multus/multus-kbqsq"
Jul 02 17:10:46.235334 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.235276    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d6628590-1cf7-4a61-9350-539f3ae7ed91-run-ovn\") pod \"ovnkube-node-62g9m\" (UID: \"d6628590-1cf7-4a61-9350-539f3ae7ed91\") " pod="openshift-ovn-kubernetes/ovnkube-node-62g9m"
Jul 02 17:10:46.235334 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.235292    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d6628590-1cf7-4a61-9350-539f3ae7ed91-env-overrides\") pod \"ovnkube-node-62g9m\" (UID: \"d6628590-1cf7-4a61-9350-539f3ae7ed91\") " pod="openshift-ovn-kubernetes/ovnkube-node-62g9m"
Jul 02 17:10:46.235334 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.235307    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/31c6d25a-09ab-4af9-bda6-e98f486b8f6f-var-lib-kubelet\") pod \"tuned-wkl8x\" (UID: \"31c6d25a-09ab-4af9-bda6-e98f486b8f6f\") " pod="openshift-cluster-node-tuning-operator/tuned-wkl8x"
Jul 02 17:10:46.235524 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.235335    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8f4635ce-bab5-4ebd-8db9-2837729fd121-multus-cni-dir\") pod \"multus-kbqsq\" (UID: \"8f4635ce-bab5-4ebd-8db9-2837729fd121\") " pod="openshift-multus/multus-kbqsq"
Jul 02 17:10:46.235524 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.235374    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d6628590-1cf7-4a61-9350-539f3ae7ed91-ovnkube-config\") pod \"ovnkube-node-62g9m\" (UID: \"d6628590-1cf7-4a61-9350-539f3ae7ed91\") " pod="openshift-ovn-kubernetes/ovnkube-node-62g9m"
Jul 02 17:10:46.235524 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.235393    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ab1d35cf-6b41-4851-9bf6-3f0de96ef752-kubelet-dir\") pod \"aws-ebs-csi-driver-node-l852t\" (UID: \"ab1d35cf-6b41-4851-9bf6-3f0de96ef752\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l852t"
Jul 02 17:10:46.235524 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.235412    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpl9k\" (UniqueName: \"kubernetes.io/projected/ab1d35cf-6b41-4851-9bf6-3f0de96ef752-kube-api-access-kpl9k\") pod \"aws-ebs-csi-driver-node-l852t\" (UID: \"ab1d35cf-6b41-4851-9bf6-3f0de96ef752\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l852t"
Jul 02 17:10:46.235524 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.235433    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5ac2c336-c8a9-484a-83df-60182dc9faf5-kubelet-config\") pod \"global-pull-secret-syncer-cwjw5\" (UID: \"5ac2c336-c8a9-484a-83df-60182dc9faf5\") " pod="kube-system/global-pull-secret-syncer-cwjw5"
Jul 02 17:10:46.235524 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.235452    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2d56f816-270b-4962-b1f0-2e5b8acdb3ce-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-87dbx\" (UID: \"2d56f816-270b-4962-b1f0-2e5b8acdb3ce\") " pod="openshift-multus/multus-additional-cni-plugins-87dbx"
Jul 02 17:10:46.235524 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.235467    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5g7t\" (UniqueName: \"kubernetes.io/projected/2d56f816-270b-4962-b1f0-2e5b8acdb3ce-kube-api-access-t5g7t\") pod \"multus-additional-cni-plugins-87dbx\" (UID: \"2d56f816-270b-4962-b1f0-2e5b8acdb3ce\") " pod="openshift-multus/multus-additional-cni-plugins-87dbx"
Jul 02 17:10:46.235524 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.235496    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d20bc45e-c1ca-4088-ab8a-4266d1c66c8c-konnectivity-ca\") pod \"konnectivity-agent-bvtjp\" (UID: \"d20bc45e-c1ca-4088-ab8a-4266d1c66c8c\") " pod="kube-system/konnectivity-agent-bvtjp"
Jul 02 17:10:46.235524 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.235509    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/31c6d25a-09ab-4af9-bda6-e98f486b8f6f-etc-tuned\") pod \"tuned-wkl8x\" (UID: \"31c6d25a-09ab-4af9-bda6-e98f486b8f6f\") " pod="openshift-cluster-node-tuning-operator/tuned-wkl8x"
Jul 02 17:10:46.235786 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.235530    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ac2c336-c8a9-484a-83df-60182dc9faf5-original-pull-secret\") pod \"global-pull-secret-syncer-cwjw5\" (UID: \"5ac2c336-c8a9-484a-83df-60182dc9faf5\") " pod="kube-system/global-pull-secret-syncer-cwjw5"
Jul 02 17:10:46.235786 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.235571    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2d56f816-270b-4962-b1f0-2e5b8acdb3ce-system-cni-dir\") pod \"multus-additional-cni-plugins-87dbx\" (UID: \"2d56f816-270b-4962-b1f0-2e5b8acdb3ce\") " pod="openshift-multus/multus-additional-cni-plugins-87dbx"
Jul 02 17:10:46.235786 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.235593    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/31c6d25a-09ab-4af9-bda6-e98f486b8f6f-lib-modules\") pod \"tuned-wkl8x\" (UID: \"31c6d25a-09ab-4af9-bda6-e98f486b8f6f\") " pod="openshift-cluster-node-tuning-operator/tuned-wkl8x"
Jul 02 17:10:46.235786 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.235607    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzdf8\" (UniqueName: \"kubernetes.io/projected/31c6d25a-09ab-4af9-bda6-e98f486b8f6f-kube-api-access-rzdf8\") pod \"tuned-wkl8x\" (UID: \"31c6d25a-09ab-4af9-bda6-e98f486b8f6f\") " pod="openshift-cluster-node-tuning-operator/tuned-wkl8x"
Jul 02 17:10:46.235786 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.235628    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8f4635ce-bab5-4ebd-8db9-2837729fd121-system-cni-dir\") pod \"multus-kbqsq\" (UID: \"8f4635ce-bab5-4ebd-8db9-2837729fd121\") " pod="openshift-multus/multus-kbqsq"
Jul 02 17:10:46.235786 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.235642    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8f4635ce-bab5-4ebd-8db9-2837729fd121-os-release\") pod \"multus-kbqsq\" (UID: \"8f4635ce-bab5-4ebd-8db9-2837729fd121\") " pod="openshift-multus/multus-kbqsq"
Jul 02 17:10:46.235786 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.235656    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d6628590-1cf7-4a61-9350-539f3ae7ed91-host-run-netns\") pod \"ovnkube-node-62g9m\" (UID: \"d6628590-1cf7-4a61-9350-539f3ae7ed91\") " pod="openshift-ovn-kubernetes/ovnkube-node-62g9m"
Jul 02 17:10:46.235786 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.235672    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d6628590-1cf7-4a61-9350-539f3ae7ed91-host-cni-netd\") pod \"ovnkube-node-62g9m\" (UID: \"d6628590-1cf7-4a61-9350-539f3ae7ed91\") " pod="openshift-ovn-kubernetes/ovnkube-node-62g9m"
Jul 02 17:10:46.235786 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.235699    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d6628590-1cf7-4a61-9350-539f3ae7ed91-ovnkube-script-lib\") pod \"ovnkube-node-62g9m\" (UID: \"d6628590-1cf7-4a61-9350-539f3ae7ed91\") " pod="openshift-ovn-kubernetes/ovnkube-node-62g9m"
Jul 02 17:10:46.235786 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.235723    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqh2q\" (UniqueName: \"kubernetes.io/projected/d1d3526d-01f3-4e77-a78e-ac8954a7a207-kube-api-access-sqh2q\") pod \"network-metrics-daemon-g67j2\" (UID: \"d1d3526d-01f3-4e77-a78e-ac8954a7a207\") " pod="openshift-multus/network-metrics-daemon-g67j2"
Jul 02 17:10:46.235786 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.235758    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fb0fdece-96ab-471d-87e5-89e41822fd53-hosts-file\") pod \"node-resolver-vfd4d\" (UID: \"fb0fdece-96ab-471d-87e5-89e41822fd53\") " pod="openshift-dns/node-resolver-vfd4d"
Jul 02 17:10:46.235786 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.235786    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fx86v\" (UniqueName: \"kubernetes.io/projected/de6a6072-1ba3-44d4-8fbd-4e332b70d7a5-kube-api-access-fx86v\") pod \"node-ca-cr9bq\" (UID: \"de6a6072-1ba3-44d4-8fbd-4e332b70d7a5\") " pod="openshift-image-registry/node-ca-cr9bq"
Jul 02 17:10:46.236118 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.235800    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2d56f816-270b-4962-b1f0-2e5b8acdb3ce-cnibin\") pod \"multus-additional-cni-plugins-87dbx\" (UID: \"2d56f816-270b-4962-b1f0-2e5b8acdb3ce\") " pod="openshift-multus/multus-additional-cni-plugins-87dbx"
Jul 02 17:10:46.236118 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.235814    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8f4635ce-bab5-4ebd-8db9-2837729fd121-host-run-netns\") pod \"multus-kbqsq\" (UID: \"8f4635ce-bab5-4ebd-8db9-2837729fd121\") " pod="openshift-multus/multus-kbqsq"
Jul 02 17:10:46.236118 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.235833    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1d3526d-01f3-4e77-a78e-ac8954a7a207-metrics-certs\") pod \"network-metrics-daemon-g67j2\" (UID: \"d1d3526d-01f3-4e77-a78e-ac8954a7a207\") " pod="openshift-multus/network-metrics-daemon-g67j2"
Jul 02 17:10:46.236118 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.235864    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6628590-1cf7-4a61-9350-539f3ae7ed91-host-run-ovn-kubernetes\") pod \"ovnkube-node-62g9m\" (UID: \"d6628590-1cf7-4a61-9350-539f3ae7ed91\") " pod="openshift-ovn-kubernetes/ovnkube-node-62g9m"
Jul 02 17:10:46.236118 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.235881    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2w8k6\" (UniqueName: \"kubernetes.io/projected/d6628590-1cf7-4a61-9350-539f3ae7ed91-kube-api-access-2w8k6\") pod \"ovnkube-node-62g9m\" (UID: \"d6628590-1cf7-4a61-9350-539f3ae7ed91\") " pod="openshift-ovn-kubernetes/ovnkube-node-62g9m"
Jul 02 17:10:46.236118 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.235897    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2d56f816-270b-4962-b1f0-2e5b8acdb3ce-tuning-conf-dir\") pod \"multus-additional-cni-plugins-87dbx\" (UID: \"2d56f816-270b-4962-b1f0-2e5b8acdb3ce\") " pod="openshift-multus/multus-additional-cni-plugins-87dbx"
Jul 02 17:10:46.236118 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.235910    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/31c6d25a-09ab-4af9-bda6-e98f486b8f6f-etc-systemd\") pod \"tuned-wkl8x\" (UID: \"31c6d25a-09ab-4af9-bda6-e98f486b8f6f\") " pod="openshift-cluster-node-tuning-operator/tuned-wkl8x"
Jul 02 17:10:46.236118 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.235925    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8f4635ce-bab5-4ebd-8db9-2837729fd121-host-run-multus-certs\") pod \"multus-kbqsq\" (UID: \"8f4635ce-bab5-4ebd-8db9-2837729fd121\") " pod="openshift-multus/multus-kbqsq"
Jul 02 17:10:46.236118 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.235940    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d6628590-1cf7-4a61-9350-539f3ae7ed91-host-slash\") pod \"ovnkube-node-62g9m\" (UID: \"d6628590-1cf7-4a61-9350-539f3ae7ed91\") " pod="openshift-ovn-kubernetes/ovnkube-node-62g9m"
Jul 02 17:10:46.236118 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.235955    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d6628590-1cf7-4a61-9350-539f3ae7ed91-var-lib-openvswitch\") pod \"ovnkube-node-62g9m\" (UID: \"d6628590-1cf7-4a61-9350-539f3ae7ed91\") " pod="openshift-ovn-kubernetes/ovnkube-node-62g9m"
Jul 02 17:10:46.236118 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.235969    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d6628590-1cf7-4a61-9350-539f3ae7ed91-etc-openvswitch\") pod \"ovnkube-node-62g9m\" (UID: \"d6628590-1cf7-4a61-9350-539f3ae7ed91\") " pod="openshift-ovn-kubernetes/ovnkube-node-62g9m"
Jul 02 17:10:46.236118 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.235992    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ab1d35cf-6b41-4851-9bf6-3f0de96ef752-device-dir\") pod \"aws-ebs-csi-driver-node-l852t\" (UID: \"ab1d35cf-6b41-4851-9bf6-3f0de96ef752\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l852t"
Jul 02 17:10:46.236118 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.236032    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/31c6d25a-09ab-4af9-bda6-e98f486b8f6f-etc-sysconfig\") pod \"tuned-wkl8x\" (UID: \"31c6d25a-09ab-4af9-bda6-e98f486b8f6f\") " pod="openshift-cluster-node-tuning-operator/tuned-wkl8x"
Jul 02 17:10:46.236118 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.236050    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ab1d35cf-6b41-4851-9bf6-3f0de96ef752-registration-dir\") pod \"aws-ebs-csi-driver-node-l852t\" (UID: \"ab1d35cf-6b41-4851-9bf6-3f0de96ef752\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l852t"
Jul 02 17:10:46.236118 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.236065    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/16a92923-d844-41d1-adee-c655f4a3ff8f-host-slash\") pod \"iptables-alerter-tcwxf\" (UID: \"16a92923-d844-41d1-adee-c655f4a3ff8f\") " pod="openshift-network-operator/iptables-alerter-tcwxf"
Jul 02 17:10:46.236118 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.236079    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2d56f816-270b-4962-b1f0-2e5b8acdb3ce-cni-binary-copy\") pod \"multus-additional-cni-plugins-87dbx\" (UID: \"2d56f816-270b-4962-b1f0-2e5b8acdb3ce\") " pod="openshift-multus/multus-additional-cni-plugins-87dbx"
Jul 02 17:10:46.236620 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.236118    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2d56f816-270b-4962-b1f0-2e5b8acdb3ce-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-87dbx\" (UID: \"2d56f816-270b-4962-b1f0-2e5b8acdb3ce\") " pod="openshift-multus/multus-additional-cni-plugins-87dbx"
Jul 02 17:10:46.236620 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.236143    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d6628590-1cf7-4a61-9350-539f3ae7ed91-node-log\") pod \"ovnkube-node-62g9m\" (UID: \"d6628590-1cf7-4a61-9350-539f3ae7ed91\") " pod="openshift-ovn-kubernetes/ovnkube-node-62g9m"
Jul 02 17:10:46.236620 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.236157    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ab1d35cf-6b41-4851-9bf6-3f0de96ef752-sys-fs\") pod \"aws-ebs-csi-driver-node-l852t\" (UID: \"ab1d35cf-6b41-4851-9bf6-3f0de96ef752\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l852t"
Jul 02 17:10:46.236620 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.236183    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2l4dr\" (UniqueName: \"kubernetes.io/projected/16a92923-d844-41d1-adee-c655f4a3ff8f-kube-api-access-2l4dr\") pod \"iptables-alerter-tcwxf\" (UID: \"16a92923-d844-41d1-adee-c655f4a3ff8f\") " pod="openshift-network-operator/iptables-alerter-tcwxf"
Jul 02 17:10:46.236620 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.236208    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5ac2c336-c8a9-484a-83df-60182dc9faf5-dbus\") pod \"global-pull-secret-syncer-cwjw5\" (UID: \"5ac2c336-c8a9-484a-83df-60182dc9faf5\") " pod="kube-system/global-pull-secret-syncer-cwjw5"
Jul 02 17:10:46.236620 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.236225    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/31c6d25a-09ab-4af9-bda6-e98f486b8f6f-etc-modprobe-d\") pod \"tuned-wkl8x\" (UID: \"31c6d25a-09ab-4af9-bda6-e98f486b8f6f\") " pod="openshift-cluster-node-tuning-operator/tuned-wkl8x"
Jul 02 17:10:46.236620 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.236244    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8f4635ce-bab5-4ebd-8db9-2837729fd121-hostroot\") pod \"multus-kbqsq\" (UID: \"8f4635ce-bab5-4ebd-8db9-2837729fd121\") " pod="openshift-multus/multus-kbqsq"
Jul 02 17:10:46.236620 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.236265    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8f4635ce-bab5-4ebd-8db9-2837729fd121-host-var-lib-cni-multus\") pod \"multus-kbqsq\" (UID: \"8f4635ce-bab5-4ebd-8db9-2837729fd121\") " pod="openshift-multus/multus-kbqsq"
Jul 02 17:10:46.236620 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.236294    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6628590-1cf7-4a61-9350-539f3ae7ed91-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-62g9m\" (UID: \"d6628590-1cf7-4a61-9350-539f3ae7ed91\") " pod="openshift-ovn-kubernetes/ovnkube-node-62g9m"
Jul 02 17:10:46.236620 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.236319    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d6628590-1cf7-4a61-9350-539f3ae7ed91-ovn-node-metrics-cert\") pod \"ovnkube-node-62g9m\" (UID: \"d6628590-1cf7-4a61-9350-539f3ae7ed91\") " pod="openshift-ovn-kubernetes/ovnkube-node-62g9m"
Jul 02 17:10:46.236620 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.236336    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d20bc45e-c1ca-4088-ab8a-4266d1c66c8c-agent-certs\") pod \"konnectivity-agent-bvtjp\" (UID: \"d20bc45e-c1ca-4088-ab8a-4266d1c66c8c\") " pod="kube-system/konnectivity-agent-bvtjp"
Jul 02 17:10:46.236620 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.236354    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8f4635ce-bab5-4ebd-8db9-2837729fd121-host-run-k8s-cni-cncf-io\") pod \"multus-kbqsq\" (UID: \"8f4635ce-bab5-4ebd-8db9-2837729fd121\") " pod="openshift-multus/multus-kbqsq"
Jul 02 17:10:46.236620 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.236370    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d6628590-1cf7-4a61-9350-539f3ae7ed91-log-socket\") pod \"ovnkube-node-62g9m\" (UID: \"d6628590-1cf7-4a61-9350-539f3ae7ed91\") " pod="openshift-ovn-kubernetes/ovnkube-node-62g9m"
Jul 02 17:10:46.236620 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.236389    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/31c6d25a-09ab-4af9-bda6-e98f486b8f6f-sys\") pod \"tuned-wkl8x\" (UID: \"31c6d25a-09ab-4af9-bda6-e98f486b8f6f\") " pod="openshift-cluster-node-tuning-operator/tuned-wkl8x"
Jul 02 17:10:46.236620 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.236410    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skvsn\" (UniqueName: \"kubernetes.io/projected/fb3341a1-f14e-40be-8591-28a12d33716b-kube-api-access-skvsn\") pod \"network-check-target-p5sdw\" (UID: \"fb3341a1-f14e-40be-8591-28a12d33716b\") " pod="openshift-network-diagnostics/network-check-target-p5sdw"
Jul 02 17:10:46.236620 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.236431    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/31c6d25a-09ab-4af9-bda6-e98f486b8f6f-etc-kubernetes\") pod \"tuned-wkl8x\" (UID: \"31c6d25a-09ab-4af9-bda6-e98f486b8f6f\") " pod="openshift-cluster-node-tuning-operator/tuned-wkl8x"
Jul 02 17:10:46.237188 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.236445    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8f4635ce-bab5-4ebd-8db9-2837729fd121-multus-daemon-config\") pod \"multus-kbqsq\" (UID: \"8f4635ce-bab5-4ebd-8db9-2837729fd121\") " pod="openshift-multus/multus-kbqsq"
Jul 02 17:10:46.237188 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.236466    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d6628590-1cf7-4a61-9350-539f3ae7ed91-run-openvswitch\") pod \"ovnkube-node-62g9m\" (UID: \"d6628590-1cf7-4a61-9350-539f3ae7ed91\") " pod="openshift-ovn-kubernetes/ovnkube-node-62g9m"
Jul 02 17:10:46.237188 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.236483    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ab1d35cf-6b41-4851-9bf6-3f0de96ef752-etc-selinux\") pod \"aws-ebs-csi-driver-node-l852t\" (UID: \"ab1d35cf-6b41-4851-9bf6-3f0de96ef752\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l852t"
Jul 02 17:10:46.237188 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.236515    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/16a92923-d844-41d1-adee-c655f4a3ff8f-iptables-alerter-script\") pod \"iptables-alerter-tcwxf\" (UID: \"16a92923-d844-41d1-adee-c655f4a3ff8f\") " pod="openshift-network-operator/iptables-alerter-tcwxf"
Jul 02 17:10:46.237188 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.236535    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/de6a6072-1ba3-44d4-8fbd-4e332b70d7a5-host\") pod \"node-ca-cr9bq\" (UID: \"de6a6072-1ba3-44d4-8fbd-4e332b70d7a5\") " pod="openshift-image-registry/node-ca-cr9bq"
Jul 02 17:10:46.237188 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.236551    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8f4635ce-bab5-4ebd-8db9-2837729fd121-cnibin\") pod \"multus-kbqsq\" (UID: \"8f4635ce-bab5-4ebd-8db9-2837729fd121\") " pod="openshift-multus/multus-kbqsq"
Jul 02 17:10:46.237188 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.236564    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/31c6d25a-09ab-4af9-bda6-e98f486b8f6f-host\") pod \"tuned-wkl8x\" (UID: \"31c6d25a-09ab-4af9-bda6-e98f486b8f6f\") " pod="openshift-cluster-node-tuning-operator/tuned-wkl8x"
Jul 02 17:10:46.237188 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.236578    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/31c6d25a-09ab-4af9-bda6-e98f486b8f6f-tmp\") pod \"tuned-wkl8x\" (UID: \"31c6d25a-09ab-4af9-bda6-e98f486b8f6f\") " pod="openshift-cluster-node-tuning-operator/tuned-wkl8x"
Jul 02 17:10:46.237188 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.236622    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f4635ce-bab5-4ebd-8db9-2837729fd121-etc-kubernetes\") pod \"multus-kbqsq\" (UID: \"8f4635ce-bab5-4ebd-8db9-2837729fd121\") " pod="openshift-multus/multus-kbqsq"
Jul 02 17:10:46.237188 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.236657    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6628590-1cf7-4a61-9350-539f3ae7ed91-host-kubelet\") pod \"ovnkube-node-62g9m\" (UID: \"d6628590-1cf7-4a61-9350-539f3ae7ed91\") " pod="openshift-ovn-kubernetes/ovnkube-node-62g9m"
Jul 02 17:10:46.237188 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.236682    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d6628590-1cf7-4a61-9350-539f3ae7ed91-systemd-units\") pod \"ovnkube-node-62g9m\" (UID: \"d6628590-1cf7-4a61-9350-539f3ae7ed91\") " pod="openshift-ovn-kubernetes/ovnkube-node-62g9m"
Jul 02 17:10:46.237188 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.236725    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/31c6d25a-09ab-4af9-bda6-e98f486b8f6f-etc-sysctl-conf\") pod \"tuned-wkl8x\" (UID: \"31c6d25a-09ab-4af9-bda6-e98f486b8f6f\") " pod="openshift-cluster-node-tuning-operator/tuned-wkl8x"
Jul 02 17:10:46.237188 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.236751    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8f4635ce-bab5-4ebd-8db9-2837729fd121-host-var-lib-cni-bin\") pod \"multus-kbqsq\" (UID: \"8f4635ce-bab5-4ebd-8db9-2837729fd121\") " pod="openshift-multus/multus-kbqsq"
Jul 02 17:10:46.237188 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.236769    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb0fdece-96ab-471d-87e5-89e41822fd53-tmp-dir\") pod \"node-resolver-vfd4d\" (UID: \"fb0fdece-96ab-471d-87e5-89e41822fd53\") " pod="openshift-dns/node-resolver-vfd4d"
Jul 02 17:10:46.239814 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.239797    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 02 17:10:46.239946 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.239929    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-143-67.ec2.internal"]
Jul 02 17:10:46.274446 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.274428    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-s4sqt"
Jul 02 17:10:46.291207 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.291168    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-s4sqt"
Jul 02 17:10:46.337303 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.337271    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ac2c336-c8a9-484a-83df-60182dc9faf5-original-pull-secret\") pod \"global-pull-secret-syncer-cwjw5\" (UID: \"5ac2c336-c8a9-484a-83df-60182dc9faf5\") " pod="kube-system/global-pull-secret-syncer-cwjw5"
Jul 02 17:10:46.337303 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.337309    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2d56f816-270b-4962-b1f0-2e5b8acdb3ce-system-cni-dir\") pod \"multus-additional-cni-plugins-87dbx\" (UID: \"2d56f816-270b-4962-b1f0-2e5b8acdb3ce\") " pod="openshift-multus/multus-additional-cni-plugins-87dbx"
Jul 02 17:10:46.337490 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.337326    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/31c6d25a-09ab-4af9-bda6-e98f486b8f6f-lib-modules\") pod \"tuned-wkl8x\" (UID: \"31c6d25a-09ab-4af9-bda6-e98f486b8f6f\") " pod="openshift-cluster-node-tuning-operator/tuned-wkl8x"
Jul 02 17:10:46.337490 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.337341    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzdf8\" (UniqueName: \"kubernetes.io/projected/31c6d25a-09ab-4af9-bda6-e98f486b8f6f-kube-api-access-rzdf8\") pod \"tuned-wkl8x\" (UID: \"31c6d25a-09ab-4af9-bda6-e98f486b8f6f\") " pod="openshift-cluster-node-tuning-operator/tuned-wkl8x"
Jul 02 17:10:46.337490 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.337358    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8f4635ce-bab5-4ebd-8db9-2837729fd121-system-cni-dir\") pod \"multus-kbqsq\" (UID: \"8f4635ce-bab5-4ebd-8db9-2837729fd121\") " pod="openshift-multus/multus-kbqsq"
Jul 02 17:10:46.337490 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.337397    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2d56f816-270b-4962-b1f0-2e5b8acdb3ce-system-cni-dir\") pod \"multus-additional-cni-plugins-87dbx\" (UID: \"2d56f816-270b-4962-b1f0-2e5b8acdb3ce\") " pod="openshift-multus/multus-additional-cni-plugins-87dbx"
Jul 02 17:10:46.337490 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.337427    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8f4635ce-bab5-4ebd-8db9-2837729fd121-os-release\") pod \"multus-kbqsq\" (UID: \"8f4635ce-bab5-4ebd-8db9-2837729fd121\") " pod="openshift-multus/multus-kbqsq"
Jul 02 17:10:46.337490 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:10:46.337455    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 17:10:46.337490 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.337460    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d6628590-1cf7-4a61-9350-539f3ae7ed91-host-run-netns\") pod \"ovnkube-node-62g9m\" (UID: \"d6628590-1cf7-4a61-9350-539f3ae7ed91\") " pod="openshift-ovn-kubernetes/ovnkube-node-62g9m"
Jul 02 17:10:46.337490 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.337483    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8f4635ce-bab5-4ebd-8db9-2837729fd121-system-cni-dir\") pod \"multus-kbqsq\" (UID: \"8f4635ce-bab5-4ebd-8db9-2837729fd121\") " pod="openshift-multus/multus-kbqsq"
Jul 02 17:10:46.337490 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.337490    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d6628590-1cf7-4a61-9350-539f3ae7ed91-host-cni-netd\") pod \"ovnkube-node-62g9m\" (UID: \"d6628590-1cf7-4a61-9350-539f3ae7ed91\") " pod="openshift-ovn-kubernetes/ovnkube-node-62g9m"
Jul 02 17:10:46.337912 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.337485    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/31c6d25a-09ab-4af9-bda6-e98f486b8f6f-lib-modules\") pod \"tuned-wkl8x\" (UID: \"31c6d25a-09ab-4af9-bda6-e98f486b8f6f\") " pod="openshift-cluster-node-tuning-operator/tuned-wkl8x"
Jul 02 17:10:46.337912 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.337514    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d6628590-1cf7-4a61-9350-539f3ae7ed91-ovnkube-script-lib\") pod \"ovnkube-node-62g9m\" (UID: \"d6628590-1cf7-4a61-9350-539f3ae7ed91\") " pod="openshift-ovn-kubernetes/ovnkube-node-62g9m"
Jul 02 17:10:46.337912 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.337522    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d6628590-1cf7-4a61-9350-539f3ae7ed91-host-run-netns\") pod \"ovnkube-node-62g9m\" (UID: \"d6628590-1cf7-4a61-9350-539f3ae7ed91\") " pod="openshift-ovn-kubernetes/ovnkube-node-62g9m"
Jul 02 17:10:46.337912 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:10:46.337533    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ac2c336-c8a9-484a-83df-60182dc9faf5-original-pull-secret podName:5ac2c336-c8a9-484a-83df-60182dc9faf5 nodeName:}" failed. No retries permitted until 2026-07-02 17:10:46.837509764 +0000 UTC m=+2.027212422 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5ac2c336-c8a9-484a-83df-60182dc9faf5-original-pull-secret") pod "global-pull-secret-syncer-cwjw5" (UID: "5ac2c336-c8a9-484a-83df-60182dc9faf5") : object "kube-system"/"original-pull-secret" not registered
Jul 02 17:10:46.337912 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.337531    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8f4635ce-bab5-4ebd-8db9-2837729fd121-os-release\") pod \"multus-kbqsq\" (UID: \"8f4635ce-bab5-4ebd-8db9-2837729fd121\") " pod="openshift-multus/multus-kbqsq"
Jul 02 17:10:46.337912 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.337572    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqh2q\" (UniqueName: \"kubernetes.io/projected/d1d3526d-01f3-4e77-a78e-ac8954a7a207-kube-api-access-sqh2q\") pod \"network-metrics-daemon-g67j2\" (UID: \"d1d3526d-01f3-4e77-a78e-ac8954a7a207\") " pod="openshift-multus/network-metrics-daemon-g67j2"
Jul 02 17:10:46.337912 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.337636    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d6628590-1cf7-4a61-9350-539f3ae7ed91-host-cni-netd\") pod \"ovnkube-node-62g9m\" (UID: \"d6628590-1cf7-4a61-9350-539f3ae7ed91\") " pod="openshift-ovn-kubernetes/ovnkube-node-62g9m"
Jul 02 17:10:46.337912 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.337642    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fb0fdece-96ab-471d-87e5-89e41822fd53-hosts-file\") pod \"node-resolver-vfd4d\" (UID: \"fb0fdece-96ab-471d-87e5-89e41822fd53\") " pod="openshift-dns/node-resolver-vfd4d"
Jul 02 17:10:46.337912 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.337673    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fx86v\" (UniqueName: \"kubernetes.io/projected/de6a6072-1ba3-44d4-8fbd-4e332b70d7a5-kube-api-access-fx86v\") pod \"node-ca-cr9bq\" (UID: \"de6a6072-1ba3-44d4-8fbd-4e332b70d7a5\") " pod="openshift-image-registry/node-ca-cr9bq"
Jul 02 17:10:46.337912 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.337699    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2d56f816-270b-4962-b1f0-2e5b8acdb3ce-cnibin\") pod \"multus-additional-cni-plugins-87dbx\" (UID: \"2d56f816-270b-4962-b1f0-2e5b8acdb3ce\") " pod="openshift-multus/multus-additional-cni-plugins-87dbx"
Jul 02 17:10:46.337912 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.337724    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8f4635ce-bab5-4ebd-8db9-2837729fd121-host-run-netns\") pod \"multus-kbqsq\" (UID: \"8f4635ce-bab5-4ebd-8db9-2837729fd121\") " pod="openshift-multus/multus-kbqsq"
Jul 02 17:10:46.337912 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.337738    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fb0fdece-96ab-471d-87e5-89e41822fd53-hosts-file\") pod \"node-resolver-vfd4d\" (UID: \"fb0fdece-96ab-471d-87e5-89e41822fd53\") " pod="openshift-dns/node-resolver-vfd4d"
Jul 02 17:10:46.337912 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.337748    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1d3526d-01f3-4e77-a78e-ac8954a7a207-metrics-certs\") pod \"network-metrics-daemon-g67j2\" (UID: \"d1d3526d-01f3-4e77-a78e-ac8954a7a207\") " pod="openshift-multus/network-metrics-daemon-g67j2"
Jul 02 17:10:46.337912 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.337771    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6628590-1cf7-4a61-9350-539f3ae7ed91-host-run-ovn-kubernetes\") pod \"ovnkube-node-62g9m\" (UID: \"d6628590-1cf7-4a61-9350-539f3ae7ed91\") " pod="openshift-ovn-kubernetes/ovnkube-node-62g9m"
Jul 02 17:10:46.337912 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.337788    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2d56f816-270b-4962-b1f0-2e5b8acdb3ce-cnibin\") pod \"multus-additional-cni-plugins-87dbx\" (UID: \"2d56f816-270b-4962-b1f0-2e5b8acdb3ce\") " pod="openshift-multus/multus-additional-cni-plugins-87dbx"
Jul 02 17:10:46.337912 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.337797    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2w8k6\" (UniqueName: \"kubernetes.io/projected/d6628590-1cf7-4a61-9350-539f3ae7ed91-kube-api-access-2w8k6\") pod \"ovnkube-node-62g9m\" (UID: \"d6628590-1cf7-4a61-9350-539f3ae7ed91\") " pod="openshift-ovn-kubernetes/ovnkube-node-62g9m"
Jul 02 17:10:46.337912 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.337803    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8f4635ce-bab5-4ebd-8db9-2837729fd121-host-run-netns\") pod \"multus-kbqsq\" (UID: \"8f4635ce-bab5-4ebd-8db9-2837729fd121\") " pod="openshift-multus/multus-kbqsq"
Jul 02 17:10:46.338591 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.337808    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6628590-1cf7-4a61-9350-539f3ae7ed91-host-run-ovn-kubernetes\") pod \"ovnkube-node-62g9m\" (UID: \"d6628590-1cf7-4a61-9350-539f3ae7ed91\") " pod="openshift-ovn-kubernetes/ovnkube-node-62g9m"
Jul 02 17:10:46.338591 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.337820    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2d56f816-270b-4962-b1f0-2e5b8acdb3ce-tuning-conf-dir\") pod \"multus-additional-cni-plugins-87dbx\" (UID: \"2d56f816-270b-4962-b1f0-2e5b8acdb3ce\") " pod="openshift-multus/multus-additional-cni-plugins-87dbx"
Jul 02 17:10:46.338591 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:10:46.337840    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 17:10:46.338591 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:10:46.337922    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1d3526d-01f3-4e77-a78e-ac8954a7a207-metrics-certs podName:d1d3526d-01f3-4e77-a78e-ac8954a7a207 nodeName:}" failed. No retries permitted until 2026-07-02 17:10:46.837907619 +0000 UTC m=+2.027610272 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d1d3526d-01f3-4e77-a78e-ac8954a7a207-metrics-certs") pod "network-metrics-daemon-g67j2" (UID: "d1d3526d-01f3-4e77-a78e-ac8954a7a207") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 17:10:46.338591 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.337966    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/31c6d25a-09ab-4af9-bda6-e98f486b8f6f-etc-systemd\") pod \"tuned-wkl8x\" (UID: \"31c6d25a-09ab-4af9-bda6-e98f486b8f6f\") " pod="openshift-cluster-node-tuning-operator/tuned-wkl8x"
Jul 02 17:10:46.338591 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.337968    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2d56f816-270b-4962-b1f0-2e5b8acdb3ce-tuning-conf-dir\") pod \"multus-additional-cni-plugins-87dbx\" (UID: \"2d56f816-270b-4962-b1f0-2e5b8acdb3ce\") " pod="openshift-multus/multus-additional-cni-plugins-87dbx"
Jul 02 17:10:46.338591 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.338007    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/31c6d25a-09ab-4af9-bda6-e98f486b8f6f-etc-systemd\") pod \"tuned-wkl8x\" (UID: \"31c6d25a-09ab-4af9-bda6-e98f486b8f6f\") " pod="openshift-cluster-node-tuning-operator/tuned-wkl8x"
Jul 02 17:10:46.338591 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.337999    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8f4635ce-bab5-4ebd-8db9-2837729fd121-host-run-multus-certs\") pod \"multus-kbqsq\" (UID: \"8f4635ce-bab5-4ebd-8db9-2837729fd121\") " pod="openshift-multus/multus-kbqsq"
Jul 02 17:10:46.338591 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.338049    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8f4635ce-bab5-4ebd-8db9-2837729fd121-host-run-multus-certs\") pod \"multus-kbqsq\" (UID: \"8f4635ce-bab5-4ebd-8db9-2837729fd121\") " pod="openshift-multus/multus-kbqsq"
Jul 02 17:10:46.338591 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.338050    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d6628590-1cf7-4a61-9350-539f3ae7ed91-host-slash\") pod \"ovnkube-node-62g9m\" (UID: \"d6628590-1cf7-4a61-9350-539f3ae7ed91\") " pod="openshift-ovn-kubernetes/ovnkube-node-62g9m"
Jul 02 17:10:46.338591 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.338071    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d6628590-1cf7-4a61-9350-539f3ae7ed91-host-slash\") pod \"ovnkube-node-62g9m\" (UID: \"d6628590-1cf7-4a61-9350-539f3ae7ed91\") " pod="openshift-ovn-kubernetes/ovnkube-node-62g9m"
Jul 02 17:10:46.338591 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.338075    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d6628590-1cf7-4a61-9350-539f3ae7ed91-var-lib-openvswitch\") pod \"ovnkube-node-62g9m\" (UID: \"d6628590-1cf7-4a61-9350-539f3ae7ed91\") " pod="openshift-ovn-kubernetes/ovnkube-node-62g9m"
Jul 02 17:10:46.338591 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.338101    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d6628590-1cf7-4a61-9350-539f3ae7ed91-ovnkube-script-lib\") pod \"ovnkube-node-62g9m\" (UID: \"d6628590-1cf7-4a61-9350-539f3ae7ed91\") " pod="openshift-ovn-kubernetes/ovnkube-node-62g9m"
Jul 02 17:10:46.338591 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.338116    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d6628590-1cf7-4a61-9350-539f3ae7ed91-etc-openvswitch\") pod \"ovnkube-node-62g9m\" (UID: \"d6628590-1cf7-4a61-9350-539f3ae7ed91\") " pod="openshift-ovn-kubernetes/ovnkube-node-62g9m"
Jul 02 17:10:46.338591 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.338104    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d6628590-1cf7-4a61-9350-539f3ae7ed91-var-lib-openvswitch\") pod \"ovnkube-node-62g9m\" (UID: \"d6628590-1cf7-4a61-9350-539f3ae7ed91\") " pod="openshift-ovn-kubernetes/ovnkube-node-62g9m"
Jul 02 17:10:46.338591 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.338135    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ab1d35cf-6b41-4851-9bf6-3f0de96ef752-device-dir\") pod \"aws-ebs-csi-driver-node-l852t\" (UID: \"ab1d35cf-6b41-4851-9bf6-3f0de96ef752\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l852t"
Jul 02 17:10:46.338591 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.338163    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ab1d35cf-6b41-4851-9bf6-3f0de96ef752-device-dir\") pod \"aws-ebs-csi-driver-node-l852t\" (UID: \"ab1d35cf-6b41-4851-9bf6-3f0de96ef752\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l852t"
Jul 02 17:10:46.339386 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.338164    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/31c6d25a-09ab-4af9-bda6-e98f486b8f6f-etc-sysconfig\") pod \"tuned-wkl8x\" (UID: \"31c6d25a-09ab-4af9-bda6-e98f486b8f6f\") " pod="openshift-cluster-node-tuning-operator/tuned-wkl8x"
Jul 02 17:10:46.339386 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.338177    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d6628590-1cf7-4a61-9350-539f3ae7ed91-etc-openvswitch\") pod \"ovnkube-node-62g9m\" (UID: \"d6628590-1cf7-4a61-9350-539f3ae7ed91\") " pod="openshift-ovn-kubernetes/ovnkube-node-62g9m"
Jul 02 17:10:46.339386 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.338191    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/31c6d25a-09ab-4af9-bda6-e98f486b8f6f-etc-sysconfig\") pod \"tuned-wkl8x\" (UID: \"31c6d25a-09ab-4af9-bda6-e98f486b8f6f\") " pod="openshift-cluster-node-tuning-operator/tuned-wkl8x"
Jul 02 17:10:46.339386 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.338189    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ab1d35cf-6b41-4851-9bf6-3f0de96ef752-registration-dir\") pod \"aws-ebs-csi-driver-node-l852t\" (UID: \"ab1d35cf-6b41-4851-9bf6-3f0de96ef752\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l852t"
Jul 02 17:10:46.339386 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.338210    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/16a92923-d844-41d1-adee-c655f4a3ff8f-host-slash\") pod \"iptables-alerter-tcwxf\" (UID: \"16a92923-d844-41d1-adee-c655f4a3ff8f\") " pod="openshift-network-operator/iptables-alerter-tcwxf"
Jul 02 17:10:46.339386 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.338231    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ab1d35cf-6b41-4851-9bf6-3f0de96ef752-registration-dir\") pod \"aws-ebs-csi-driver-node-l852t\" (UID: \"ab1d35cf-6b41-4851-9bf6-3f0de96ef752\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l852t"
Jul 02 17:10:46.339386 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.338236    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/16a92923-d844-41d1-adee-c655f4a3ff8f-host-slash\") pod \"iptables-alerter-tcwxf\" (UID: \"16a92923-d844-41d1-adee-c655f4a3ff8f\") " pod="openshift-network-operator/iptables-alerter-tcwxf"
Jul 02 17:10:46.339386 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.338253    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2d56f816-270b-4962-b1f0-2e5b8acdb3ce-cni-binary-copy\") pod \"multus-additional-cni-plugins-87dbx\" (UID: \"2d56f816-270b-4962-b1f0-2e5b8acdb3ce\") " pod="openshift-multus/multus-additional-cni-plugins-87dbx"
Jul 02 17:10:46.339386 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.338275    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2d56f816-270b-4962-b1f0-2e5b8acdb3ce-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-87dbx\" (UID: \"2d56f816-270b-4962-b1f0-2e5b8acdb3ce\") " pod="openshift-multus/multus-additional-cni-plugins-87dbx"
Jul 02 17:10:46.339386 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.338295    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d6628590-1cf7-4a61-9350-539f3ae7ed91-node-log\") pod \"ovnkube-node-62g9m\" (UID: \"d6628590-1cf7-4a61-9350-539f3ae7ed91\") " pod="openshift-ovn-kubernetes/ovnkube-node-62g9m"
Jul 02 17:10:46.339386 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.338310    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ab1d35cf-6b41-4851-9bf6-3f0de96ef752-sys-fs\") pod \"aws-ebs-csi-driver-node-l852t\" (UID: \"ab1d35cf-6b41-4851-9bf6-3f0de96ef752\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l852t"
Jul 02 17:10:46.339386 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.338334    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2l4dr\" (UniqueName: \"kubernetes.io/projected/16a92923-d844-41d1-adee-c655f4a3ff8f-kube-api-access-2l4dr\") pod \"iptables-alerter-tcwxf\" (UID: \"16a92923-d844-41d1-adee-c655f4a3ff8f\") " pod="openshift-network-operator/iptables-alerter-tcwxf"
Jul 02 17:10:46.339386 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.338357    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5ac2c336-c8a9-484a-83df-60182dc9faf5-dbus\") pod \"global-pull-secret-syncer-cwjw5\" (UID: \"5ac2c336-c8a9-484a-83df-60182dc9faf5\") " pod="kube-system/global-pull-secret-syncer-cwjw5"
Jul 02 17:10:46.339386 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.338363    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d6628590-1cf7-4a61-9350-539f3ae7ed91-node-log\") pod \"ovnkube-node-62g9m\" (UID: \"d6628590-1cf7-4a61-9350-539f3ae7ed91\") " pod="openshift-ovn-kubernetes/ovnkube-node-62g9m"
Jul 02 17:10:46.339386 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.338372    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ab1d35cf-6b41-4851-9bf6-3f0de96ef752-sys-fs\") pod \"aws-ebs-csi-driver-node-l852t\" (UID: \"ab1d35cf-6b41-4851-9bf6-3f0de96ef752\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l852t"
Jul 02 17:10:46.339386 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.338379    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/31c6d25a-09ab-4af9-bda6-e98f486b8f6f-etc-modprobe-d\") pod \"tuned-wkl8x\" (UID: \"31c6d25a-09ab-4af9-bda6-e98f486b8f6f\") " pod="openshift-cluster-node-tuning-operator/tuned-wkl8x"
Jul 02 17:10:46.339386 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.338411    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8f4635ce-bab5-4ebd-8db9-2837729fd121-hostroot\") pod \"multus-kbqsq\" (UID: \"8f4635ce-bab5-4ebd-8db9-2837729fd121\") " pod="openshift-multus/multus-kbqsq"
Jul 02 17:10:46.340207 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.338436    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8f4635ce-bab5-4ebd-8db9-2837729fd121-host-var-lib-cni-multus\") pod \"multus-kbqsq\" (UID: \"8f4635ce-bab5-4ebd-8db9-2837729fd121\") " pod="openshift-multus/multus-kbqsq"
Jul 02 17:10:46.340207 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.338440    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5ac2c336-c8a9-484a-83df-60182dc9faf5-dbus\") pod \"global-pull-secret-syncer-cwjw5\" (UID: \"5ac2c336-c8a9-484a-83df-60182dc9faf5\") " pod="kube-system/global-pull-secret-syncer-cwjw5"
Jul 02 17:10:46.340207 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.338462    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6628590-1cf7-4a61-9350-539f3ae7ed91-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-62g9m\" (UID: \"d6628590-1cf7-4a61-9350-539f3ae7ed91\") " pod="openshift-ovn-kubernetes/ovnkube-node-62g9m"
Jul 02 17:10:46.340207 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.338490    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d6628590-1cf7-4a61-9350-539f3ae7ed91-ovn-node-metrics-cert\") pod \"ovnkube-node-62g9m\" (UID: \"d6628590-1cf7-4a61-9350-539f3ae7ed91\") " pod="openshift-ovn-kubernetes/ovnkube-node-62g9m"
Jul 02 17:10:46.340207 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.338512    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d20bc45e-c1ca-4088-ab8a-4266d1c66c8c-agent-certs\") pod \"konnectivity-agent-bvtjp\" (UID: \"d20bc45e-c1ca-4088-ab8a-4266d1c66c8c\") " pod="kube-system/konnectivity-agent-bvtjp"
Jul 02 17:10:46.340207 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.338534    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8f4635ce-bab5-4ebd-8db9-2837729fd121-host-run-k8s-cni-cncf-io\") pod \"multus-kbqsq\" (UID: \"8f4635ce-bab5-4ebd-8db9-2837729fd121\") " pod="openshift-multus/multus-kbqsq"
Jul 02 17:10:46.340207 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.338566    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d6628590-1cf7-4a61-9350-539f3ae7ed91-log-socket\") pod \"ovnkube-node-62g9m\" (UID: \"d6628590-1cf7-4a61-9350-539f3ae7ed91\") " pod="openshift-ovn-kubernetes/ovnkube-node-62g9m"
Jul 02 17:10:46.340207 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.338594    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/31c6d25a-09ab-4af9-bda6-e98f486b8f6f-sys\") pod \"tuned-wkl8x\" (UID: \"31c6d25a-09ab-4af9-bda6-e98f486b8f6f\") " pod="openshift-cluster-node-tuning-operator/tuned-wkl8x"
Jul 02 17:10:46.340207 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.338610    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8f4635ce-bab5-4ebd-8db9-2837729fd121-hostroot\") pod \"multus-kbqsq\" (UID: \"8f4635ce-bab5-4ebd-8db9-2837729fd121\") " pod="openshift-multus/multus-kbqsq"
Jul 02 17:10:46.340207 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.338626    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skvsn\" (UniqueName: \"kubernetes.io/projected/fb3341a1-f14e-40be-8591-28a12d33716b-kube-api-access-skvsn\") pod \"network-check-target-p5sdw\" (UID: \"fb3341a1-f14e-40be-8591-28a12d33716b\") " pod="openshift-network-diagnostics/network-check-target-p5sdw"
Jul 02 17:10:46.340207 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.338651    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/31c6d25a-09ab-4af9-bda6-e98f486b8f6f-etc-kubernetes\") pod \"tuned-wkl8x\" (UID: \"31c6d25a-09ab-4af9-bda6-e98f486b8f6f\") " pod="openshift-cluster-node-tuning-operator/tuned-wkl8x"
Jul 02 17:10:46.340207 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.338651    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8f4635ce-bab5-4ebd-8db9-2837729fd121-host-var-lib-cni-multus\") pod \"multus-kbqsq\" (UID: \"8f4635ce-bab5-4ebd-8db9-2837729fd121\") " pod="openshift-multus/multus-kbqsq"
Jul 02 17:10:46.340207 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.338676    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8f4635ce-bab5-4ebd-8db9-2837729fd121-multus-daemon-config\") pod \"multus-kbqsq\" (UID: \"8f4635ce-bab5-4ebd-8db9-2837729fd121\") " pod="openshift-multus/multus-kbqsq"
Jul 02 17:10:46.340207 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.338710    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d6628590-1cf7-4a61-9350-539f3ae7ed91-run-openvswitch\") pod \"ovnkube-node-62g9m\" (UID: \"d6628590-1cf7-4a61-9350-539f3ae7ed91\") " pod="openshift-ovn-kubernetes/ovnkube-node-62g9m"
Jul 02 17:10:46.340207 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.338737    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ab1d35cf-6b41-4851-9bf6-3f0de96ef752-etc-selinux\") pod \"aws-ebs-csi-driver-node-l852t\" (UID: \"ab1d35cf-6b41-4851-9bf6-3f0de96ef752\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l852t"
Jul 02 17:10:46.340207 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.338760    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/16a92923-d844-41d1-adee-c655f4a3ff8f-iptables-alerter-script\") pod \"iptables-alerter-tcwxf\" (UID: \"16a92923-d844-41d1-adee-c655f4a3ff8f\") " pod="openshift-network-operator/iptables-alerter-tcwxf"
Jul 02 17:10:46.340207 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.338763    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2d56f816-270b-4962-b1f0-2e5b8acdb3ce-cni-binary-copy\") pod \"multus-additional-cni-plugins-87dbx\" (UID: \"2d56f816-270b-4962-b1f0-2e5b8acdb3ce\") " pod="openshift-multus/multus-additional-cni-plugins-87dbx"
Jul 02 17:10:46.340917 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.338781    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/de6a6072-1ba3-44d4-8fbd-4e332b70d7a5-host\") pod \"node-ca-cr9bq\" (UID: \"de6a6072-1ba3-44d4-8fbd-4e332b70d7a5\") " pod="openshift-image-registry/node-ca-cr9bq"
Jul 02 17:10:46.340917 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.338804    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8f4635ce-bab5-4ebd-8db9-2837729fd121-cnibin\") pod \"multus-kbqsq\" (UID: \"8f4635ce-bab5-4ebd-8db9-2837729fd121\") " pod="openshift-multus/multus-kbqsq"
Jul 02 17:10:46.340917 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.338821    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2d56f816-270b-4962-b1f0-2e5b8acdb3ce-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-87dbx\" (UID: \"2d56f816-270b-4962-b1f0-2e5b8acdb3ce\") " pod="openshift-multus/multus-additional-cni-plugins-87dbx"
Jul 02 17:10:46.340917 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.338833    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d6628590-1cf7-4a61-9350-539f3ae7ed91-run-openvswitch\") pod \"ovnkube-node-62g9m\" (UID: \"d6628590-1cf7-4a61-9350-539f3ae7ed91\") " pod="openshift-ovn-kubernetes/ovnkube-node-62g9m"
Jul 02 17:10:46.340917 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.338827    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/31c6d25a-09ab-4af9-bda6-e98f486b8f6f-host\") pod \"tuned-wkl8x\" (UID: \"31c6d25a-09ab-4af9-bda6-e98f486b8f6f\") " pod="openshift-cluster-node-tuning-operator/tuned-wkl8x"
Jul 02 17:10:46.340917 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.338876    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ab1d35cf-6b41-4851-9bf6-3f0de96ef752-etc-selinux\") pod \"aws-ebs-csi-driver-node-l852t\" (UID: \"ab1d35cf-6b41-4851-9bf6-3f0de96ef752\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l852t"
Jul 02 17:10:46.340917 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.338885    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/31c6d25a-09ab-4af9-bda6-e98f486b8f6f-host\") pod \"tuned-wkl8x\" (UID: \"31c6d25a-09ab-4af9-bda6-e98f486b8f6f\") " pod="openshift-cluster-node-tuning-operator/tuned-wkl8x"
Jul 02 17:10:46.340917 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.338879    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/31c6d25a-09ab-4af9-bda6-e98f486b8f6f-tmp\") pod \"tuned-wkl8x\" (UID: \"31c6d25a-09ab-4af9-bda6-e98f486b8f6f\") " pod="openshift-cluster-node-tuning-operator/tuned-wkl8x"
Jul 02 17:10:46.340917 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.338909    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8f4635ce-bab5-4ebd-8db9-2837729fd121-cnibin\") pod \"multus-kbqsq\" (UID: \"8f4635ce-bab5-4ebd-8db9-2837729fd121\") " pod="openshift-multus/multus-kbqsq"
Jul 02 17:10:46.340917 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.338926    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f4635ce-bab5-4ebd-8db9-2837729fd121-etc-kubernetes\") pod \"multus-kbqsq\" (UID: \"8f4635ce-bab5-4ebd-8db9-2837729fd121\") " pod="openshift-multus/multus-kbqsq"
Jul 02 17:10:46.340917 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.338929    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d6628590-1cf7-4a61-9350-539f3ae7ed91-log-socket\") pod \"ovnkube-node-62g9m\" (UID: \"d6628590-1cf7-4a61-9350-539f3ae7ed91\") " pod="openshift-ovn-kubernetes/ovnkube-node-62g9m"
Jul 02 17:10:46.340917 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.338947    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/de6a6072-1ba3-44d4-8fbd-4e332b70d7a5-host\") pod \"node-ca-cr9bq\" (UID: \"de6a6072-1ba3-44d4-8fbd-4e332b70d7a5\") " pod="openshift-image-registry/node-ca-cr9bq"
Jul 02 17:10:46.340917 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.338955    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6628590-1cf7-4a61-9350-539f3ae7ed91-host-kubelet\") pod \"ovnkube-node-62g9m\" (UID: \"d6628590-1cf7-4a61-9350-539f3ae7ed91\") " pod="openshift-ovn-kubernetes/ovnkube-node-62g9m"
Jul 02 17:10:46.340917 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.338961    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6628590-1cf7-4a61-9350-539f3ae7ed91-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-62g9m\" (UID: \"d6628590-1cf7-4a61-9350-539f3ae7ed91\") " pod="openshift-ovn-kubernetes/ovnkube-node-62g9m"
Jul 02 17:10:46.340917 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.339274    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6628590-1cf7-4a61-9350-539f3ae7ed91-host-kubelet\") pod \"ovnkube-node-62g9m\" (UID: \"d6628590-1cf7-4a61-9350-539f3ae7ed91\") " pod="openshift-ovn-kubernetes/ovnkube-node-62g9m"
Jul 02 17:10:46.340917 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.339278    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d6628590-1cf7-4a61-9350-539f3ae7ed91-systemd-units\") pod \"ovnkube-node-62g9m\" (UID: \"d6628590-1cf7-4a61-9350-539f3ae7ed91\") " pod="openshift-ovn-kubernetes/ovnkube-node-62g9m"
Jul 02 17:10:46.340917 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.339342    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/31c6d25a-09ab-4af9-bda6-e98f486b8f6f-etc-sysctl-conf\") pod \"tuned-wkl8x\" (UID: \"31c6d25a-09ab-4af9-bda6-e98f486b8f6f\") " pod="openshift-cluster-node-tuning-operator/tuned-wkl8x"
Jul 02 17:10:46.340917 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.339380    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8f4635ce-bab5-4ebd-8db9-2837729fd121-host-var-lib-cni-bin\") pod \"multus-kbqsq\" (UID: \"8f4635ce-bab5-4ebd-8db9-2837729fd121\") " pod="openshift-multus/multus-kbqsq"
Jul 02 17:10:46.341698 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.339405    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb0fdece-96ab-471d-87e5-89e41822fd53-tmp-dir\") pod \"node-resolver-vfd4d\" (UID: \"fb0fdece-96ab-471d-87e5-89e41822fd53\") " pod="openshift-dns/node-resolver-vfd4d"
Jul 02 17:10:46.341698 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.339427    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/31c6d25a-09ab-4af9-bda6-e98f486b8f6f-etc-kubernetes\") pod \"tuned-wkl8x\" (UID: \"31c6d25a-09ab-4af9-bda6-e98f486b8f6f\") " pod="openshift-cluster-node-tuning-operator/tuned-wkl8x"
Jul 02 17:10:46.341698 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.339457    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/de6a6072-1ba3-44d4-8fbd-4e332b70d7a5-serviceca\") pod \"node-ca-cr9bq\" (UID: \"de6a6072-1ba3-44d4-8fbd-4e332b70d7a5\") " pod="openshift-image-registry/node-ca-cr9bq"
Jul 02 17:10:46.341698 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.339467    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d6628590-1cf7-4a61-9350-539f3ae7ed91-systemd-units\") pod \"ovnkube-node-62g9m\" (UID: \"d6628590-1cf7-4a61-9350-539f3ae7ed91\") " pod="openshift-ovn-kubernetes/ovnkube-node-62g9m"
Jul 02 17:10:46.341698 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.339490    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2d56f816-270b-4962-b1f0-2e5b8acdb3ce-os-release\") pod \"multus-additional-cni-plugins-87dbx\" (UID: \"2d56f816-270b-4962-b1f0-2e5b8acdb3ce\") " pod="openshift-multus/multus-additional-cni-plugins-87dbx"
Jul 02 17:10:46.341698 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.339527    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/31c6d25a-09ab-4af9-bda6-e98f486b8f6f-etc-sysctl-d\") pod \"tuned-wkl8x\" (UID: \"31c6d25a-09ab-4af9-bda6-e98f486b8f6f\") " pod="openshift-cluster-node-tuning-operator/tuned-wkl8x"
Jul 02 17:10:46.341698 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.339558    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2djdv\" (UniqueName: \"kubernetes.io/projected/8f4635ce-bab5-4ebd-8db9-2837729fd121-kube-api-access-2djdv\") pod \"multus-kbqsq\" (UID: \"8f4635ce-bab5-4ebd-8db9-2837729fd121\") " pod="openshift-multus/multus-kbqsq"
Jul 02 17:10:46.341698 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.339585    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d6628590-1cf7-4a61-9350-539f3ae7ed91-run-systemd\") pod \"ovnkube-node-62g9m\" (UID: \"d6628590-1cf7-4a61-9350-539f3ae7ed91\") " pod="openshift-ovn-kubernetes/ovnkube-node-62g9m"
Jul 02 17:10:46.341698 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.339652    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8f4635ce-bab5-4ebd-8db9-2837729fd121-host-var-lib-cni-bin\") pod \"multus-kbqsq\" (UID: \"8f4635ce-bab5-4ebd-8db9-2837729fd121\") " pod="openshift-multus/multus-kbqsq"
Jul 02 17:10:46.341698 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.339660    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8f4635ce-bab5-4ebd-8db9-2837729fd121-host-run-k8s-cni-cncf-io\") pod \"multus-kbqsq\" (UID: \"8f4635ce-bab5-4ebd-8db9-2837729fd121\") " pod="openshift-multus/multus-kbqsq"
Jul 02 17:10:46.341698 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.339756    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8f4635ce-bab5-4ebd-8db9-2837729fd121-multus-daemon-config\") pod \"multus-kbqsq\" (UID: \"8f4635ce-bab5-4ebd-8db9-2837729fd121\") " pod="openshift-multus/multus-kbqsq"
Jul 02 17:10:46.341698 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.339834    2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 02 17:10:46.341698 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.339958    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb0fdece-96ab-471d-87e5-89e41822fd53-tmp-dir\") pod \"node-resolver-vfd4d\" (UID: \"fb0fdece-96ab-471d-87e5-89e41822fd53\") " pod="openshift-dns/node-resolver-vfd4d"
Jul 02 17:10:46.341698 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.340003    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/16a92923-d844-41d1-adee-c655f4a3ff8f-iptables-alerter-script\") pod \"iptables-alerter-tcwxf\" (UID: \"16a92923-d844-41d1-adee-c655f4a3ff8f\") " pod="openshift-network-operator/iptables-alerter-tcwxf"
Jul 02 17:10:46.341698 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.340093    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d6628590-1cf7-4a61-9350-539f3ae7ed91-run-systemd\") pod \"ovnkube-node-62g9m\" (UID: \"d6628590-1cf7-4a61-9350-539f3ae7ed91\") " pod="openshift-ovn-kubernetes/ovnkube-node-62g9m"
Jul 02 17:10:46.341698 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.338933    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/31c6d25a-09ab-4af9-bda6-e98f486b8f6f-sys\") pod \"tuned-wkl8x\" (UID: \"31c6d25a-09ab-4af9-bda6-e98f486b8f6f\") " pod="openshift-cluster-node-tuning-operator/tuned-wkl8x"
Jul 02 17:10:46.341698 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.340381    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/31c6d25a-09ab-4af9-bda6-e98f486b8f6f-etc-sysctl-conf\") pod \"tuned-wkl8x\" (UID: \"31c6d25a-09ab-4af9-bda6-e98f486b8f6f\") " pod="openshift-cluster-node-tuning-operator/tuned-wkl8x"
Jul 02 17:10:46.341698 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.340452    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2d56f816-270b-4962-b1f0-2e5b8acdb3ce-os-release\") pod \"multus-additional-cni-plugins-87dbx\" (UID: \"2d56f816-270b-4962-b1f0-2e5b8acdb3ce\") " pod="openshift-multus/multus-additional-cni-plugins-87dbx"
Jul 02 17:10:46.342570 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.340551    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/31c6d25a-09ab-4af9-bda6-e98f486b8f6f-etc-sysctl-d\") pod \"tuned-wkl8x\" (UID: \"31c6d25a-09ab-4af9-bda6-e98f486b8f6f\") " pod="openshift-cluster-node-tuning-operator/tuned-wkl8x"
Jul 02 17:10:46.342570 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.340715    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f4635ce-bab5-4ebd-8db9-2837729fd121-etc-kubernetes\") pod \"multus-kbqsq\" (UID: \"8f4635ce-bab5-4ebd-8db9-2837729fd121\") " pod="openshift-multus/multus-kbqsq"
Jul 02 17:10:46.342570 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.341170    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d6628590-1cf7-4a61-9350-539f3ae7ed91-host-cni-bin\") pod \"ovnkube-node-62g9m\" (UID: \"d6628590-1cf7-4a61-9350-539f3ae7ed91\") " pod="openshift-ovn-kubernetes/ovnkube-node-62g9m"
Jul 02 17:10:46.342570 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.341211    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ab1d35cf-6b41-4851-9bf6-3f0de96ef752-socket-dir\") pod \"aws-ebs-csi-driver-node-l852t\" (UID: \"ab1d35cf-6b41-4851-9bf6-3f0de96ef752\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l852t"
Jul 02 17:10:46.342570 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.341239    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5n68w\" (UniqueName: \"kubernetes.io/projected/fb0fdece-96ab-471d-87e5-89e41822fd53-kube-api-access-5n68w\") pod \"node-resolver-vfd4d\" (UID: \"fb0fdece-96ab-471d-87e5-89e41822fd53\") " pod="openshift-dns/node-resolver-vfd4d"
Jul 02 17:10:46.342570 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.341271    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/31c6d25a-09ab-4af9-bda6-e98f486b8f6f-run\") pod \"tuned-wkl8x\" (UID: \"31c6d25a-09ab-4af9-bda6-e98f486b8f6f\") " pod="openshift-cluster-node-tuning-operator/tuned-wkl8x"
Jul 02 17:10:46.342570 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.341305    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8f4635ce-bab5-4ebd-8db9-2837729fd121-cni-binary-copy\") pod \"multus-kbqsq\" (UID: \"8f4635ce-bab5-4ebd-8db9-2837729fd121\") " pod="openshift-multus/multus-kbqsq"
Jul 02 17:10:46.342570 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.341337    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8f4635ce-bab5-4ebd-8db9-2837729fd121-multus-socket-dir-parent\") pod \"multus-kbqsq\" (UID: \"8f4635ce-bab5-4ebd-8db9-2837729fd121\") " pod="openshift-multus/multus-kbqsq"
Jul 02 17:10:46.342570 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.341367    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f4635ce-bab5-4ebd-8db9-2837729fd121-host-var-lib-kubelet\") pod \"multus-kbqsq\" (UID: \"8f4635ce-bab5-4ebd-8db9-2837729fd121\") " pod="openshift-multus/multus-kbqsq"
Jul 02 17:10:46.342570 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.341394    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8f4635ce-bab5-4ebd-8db9-2837729fd121-multus-conf-dir\") pod \"multus-kbqsq\" (UID: \"8f4635ce-bab5-4ebd-8db9-2837729fd121\") " pod="openshift-multus/multus-kbqsq"
Jul 02 17:10:46.342570 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.341596    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d6628590-1cf7-4a61-9350-539f3ae7ed91-run-ovn\") pod \"ovnkube-node-62g9m\" (UID: \"d6628590-1cf7-4a61-9350-539f3ae7ed91\") " pod="openshift-ovn-kubernetes/ovnkube-node-62g9m"
Jul 02 17:10:46.342570 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.341631    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d6628590-1cf7-4a61-9350-539f3ae7ed91-env-overrides\") pod \"ovnkube-node-62g9m\" (UID: \"d6628590-1cf7-4a61-9350-539f3ae7ed91\") " pod="openshift-ovn-kubernetes/ovnkube-node-62g9m"
Jul 02 17:10:46.342570 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.341664    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/31c6d25a-09ab-4af9-bda6-e98f486b8f6f-var-lib-kubelet\") pod \"tuned-wkl8x\" (UID: \"31c6d25a-09ab-4af9-bda6-e98f486b8f6f\") " pod="openshift-cluster-node-tuning-operator/tuned-wkl8x"
Jul 02 17:10:46.342570 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.341668    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ab1d35cf-6b41-4851-9bf6-3f0de96ef752-socket-dir\") pod \"aws-ebs-csi-driver-node-l852t\" (UID: \"ab1d35cf-6b41-4851-9bf6-3f0de96ef752\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l852t"
Jul 02 17:10:46.342570 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.341693    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8f4635ce-bab5-4ebd-8db9-2837729fd121-multus-cni-dir\") pod \"multus-kbqsq\" (UID: \"8f4635ce-bab5-4ebd-8db9-2837729fd121\") " pod="openshift-multus/multus-kbqsq"
Jul 02 17:10:46.342570 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.341721    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d6628590-1cf7-4a61-9350-539f3ae7ed91-ovnkube-config\") pod \"ovnkube-node-62g9m\" (UID: \"d6628590-1cf7-4a61-9350-539f3ae7ed91\") " pod="openshift-ovn-kubernetes/ovnkube-node-62g9m"
Jul 02 17:10:46.342570 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.341752    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ab1d35cf-6b41-4851-9bf6-3f0de96ef752-kubelet-dir\") pod \"aws-ebs-csi-driver-node-l852t\" (UID: \"ab1d35cf-6b41-4851-9bf6-3f0de96ef752\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l852t"
Jul 02 17:10:46.343389 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.341788    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpl9k\" (UniqueName: \"kubernetes.io/projected/ab1d35cf-6b41-4851-9bf6-3f0de96ef752-kube-api-access-kpl9k\") pod \"aws-ebs-csi-driver-node-l852t\" (UID: \"ab1d35cf-6b41-4851-9bf6-3f0de96ef752\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l852t"
Jul 02 17:10:46.343389 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.341820    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5ac2c336-c8a9-484a-83df-60182dc9faf5-kubelet-config\") pod \"global-pull-secret-syncer-cwjw5\" (UID: \"5ac2c336-c8a9-484a-83df-60182dc9faf5\") " pod="kube-system/global-pull-secret-syncer-cwjw5"
Jul 02 17:10:46.343389 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.341864    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2d56f816-270b-4962-b1f0-2e5b8acdb3ce-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-87dbx\" (UID: \"2d56f816-270b-4962-b1f0-2e5b8acdb3ce\") " pod="openshift-multus/multus-additional-cni-plugins-87dbx"
Jul 02 17:10:46.343389 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.341900    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5g7t\" (UniqueName: \"kubernetes.io/projected/2d56f816-270b-4962-b1f0-2e5b8acdb3ce-kube-api-access-t5g7t\") pod \"multus-additional-cni-plugins-87dbx\" (UID: \"2d56f816-270b-4962-b1f0-2e5b8acdb3ce\") " pod="openshift-multus/multus-additional-cni-plugins-87dbx"
Jul 02 17:10:46.343389 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.341974    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d20bc45e-c1ca-4088-ab8a-4266d1c66c8c-konnectivity-ca\") pod \"konnectivity-agent-bvtjp\" (UID: \"d20bc45e-c1ca-4088-ab8a-4266d1c66c8c\") " pod="kube-system/konnectivity-agent-bvtjp"
Jul 02 17:10:46.343389 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.342008    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/31c6d25a-09ab-4af9-bda6-e98f486b8f6f-etc-tuned\") pod \"tuned-wkl8x\" (UID: \"31c6d25a-09ab-4af9-bda6-e98f486b8f6f\") " pod="openshift-cluster-node-tuning-operator/tuned-wkl8x"
Jul 02 17:10:46.343389 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.342292    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d6628590-1cf7-4a61-9350-539f3ae7ed91-env-overrides\") pod \"ovnkube-node-62g9m\" (UID: \"d6628590-1cf7-4a61-9350-539f3ae7ed91\") " pod="openshift-ovn-kubernetes/ovnkube-node-62g9m"
Jul 02 17:10:46.343389 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.342473    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/31c6d25a-09ab-4af9-bda6-e98f486b8f6f-etc-modprobe-d\") pod \"tuned-wkl8x\" (UID: \"31c6d25a-09ab-4af9-bda6-e98f486b8f6f\") " pod="openshift-cluster-node-tuning-operator/tuned-wkl8x"
Jul 02 17:10:46.343389 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.342495    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8f4635ce-bab5-4ebd-8db9-2837729fd121-multus-conf-dir\") pod \"multus-kbqsq\" (UID: \"8f4635ce-bab5-4ebd-8db9-2837729fd121\") " pod="openshift-multus/multus-kbqsq"
Jul 02 17:10:46.343389 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.342564    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8f4635ce-bab5-4ebd-8db9-2837729fd121-multus-socket-dir-parent\") pod \"multus-kbqsq\" (UID: \"8f4635ce-bab5-4ebd-8db9-2837729fd121\") " pod="openshift-multus/multus-kbqsq"
Jul 02 17:10:46.343389 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.342613    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f4635ce-bab5-4ebd-8db9-2837729fd121-host-var-lib-kubelet\") pod \"multus-kbqsq\" (UID: \"8f4635ce-bab5-4ebd-8db9-2837729fd121\") " pod="openshift-multus/multus-kbqsq"
Jul 02 17:10:46.343389 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.341501    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/31c6d25a-09ab-4af9-bda6-e98f486b8f6f-run\") pod \"tuned-wkl8x\" (UID: \"31c6d25a-09ab-4af9-bda6-e98f486b8f6f\") " pod="openshift-cluster-node-tuning-operator/tuned-wkl8x"
Jul 02 17:10:46.343389 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.342664    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/de6a6072-1ba3-44d4-8fbd-4e332b70d7a5-serviceca\") pod \"node-ca-cr9bq\" (UID: \"de6a6072-1ba3-44d4-8fbd-4e332b70d7a5\") " pod="openshift-image-registry/node-ca-cr9bq"
Jul 02 17:10:46.343389 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.341541    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d6628590-1cf7-4a61-9350-539f3ae7ed91-host-cni-bin\") pod \"ovnkube-node-62g9m\" (UID: \"d6628590-1cf7-4a61-9350-539f3ae7ed91\") " pod="openshift-ovn-kubernetes/ovnkube-node-62g9m"
Jul 02 17:10:46.343389 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.342865    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/31c6d25a-09ab-4af9-bda6-e98f486b8f6f-var-lib-kubelet\") pod \"tuned-wkl8x\" (UID: \"31c6d25a-09ab-4af9-bda6-e98f486b8f6f\") " pod="openshift-cluster-node-tuning-operator/tuned-wkl8x"
Jul 02 17:10:46.343389 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.342907    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5ac2c336-c8a9-484a-83df-60182dc9faf5-kubelet-config\") pod \"global-pull-secret-syncer-cwjw5\" (UID: \"5ac2c336-c8a9-484a-83df-60182dc9faf5\") " pod="kube-system/global-pull-secret-syncer-cwjw5"
Jul 02 17:10:46.343389 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.343138    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2d56f816-270b-4962-b1f0-2e5b8acdb3ce-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-87dbx\" (UID: \"2d56f816-270b-4962-b1f0-2e5b8acdb3ce\") " pod="openshift-multus/multus-additional-cni-plugins-87dbx"
Jul 02 17:10:46.344254 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.343207    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d6628590-1cf7-4a61-9350-539f3ae7ed91-run-ovn\") pod \"ovnkube-node-62g9m\" (UID: \"d6628590-1cf7-4a61-9350-539f3ae7ed91\") " pod="openshift-ovn-kubernetes/ovnkube-node-62g9m"
Jul 02 17:10:46.344254 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.343699    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8f4635ce-bab5-4ebd-8db9-2837729fd121-multus-cni-dir\") pod \"multus-kbqsq\" (UID: \"8f4635ce-bab5-4ebd-8db9-2837729fd121\") " pod="openshift-multus/multus-kbqsq"
Jul 02 17:10:46.344254 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.343978    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d6628590-1cf7-4a61-9350-539f3ae7ed91-ovnkube-config\") pod \"ovnkube-node-62g9m\" (UID: \"d6628590-1cf7-4a61-9350-539f3ae7ed91\") " pod="openshift-ovn-kubernetes/ovnkube-node-62g9m"
Jul 02 17:10:46.344540 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.344515    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d6628590-1cf7-4a61-9350-539f3ae7ed91-ovn-node-metrics-cert\") pod \"ovnkube-node-62g9m\" (UID: \"d6628590-1cf7-4a61-9350-539f3ae7ed91\") " pod="openshift-ovn-kubernetes/ovnkube-node-62g9m"
Jul 02 17:10:46.344666 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.344545    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/31c6d25a-09ab-4af9-bda6-e98f486b8f6f-tmp\") pod \"tuned-wkl8x\" (UID: \"31c6d25a-09ab-4af9-bda6-e98f486b8f6f\") " pod="openshift-cluster-node-tuning-operator/tuned-wkl8x"
Jul 02 17:10:46.344666 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.344564    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d20bc45e-c1ca-4088-ab8a-4266d1c66c8c-konnectivity-ca\") pod \"konnectivity-agent-bvtjp\" (UID: \"d20bc45e-c1ca-4088-ab8a-4266d1c66c8c\") " pod="kube-system/konnectivity-agent-bvtjp"
Jul 02 17:10:46.344666 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.344519    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8f4635ce-bab5-4ebd-8db9-2837729fd121-cni-binary-copy\") pod \"multus-kbqsq\" (UID: \"8f4635ce-bab5-4ebd-8db9-2837729fd121\") " pod="openshift-multus/multus-kbqsq"
Jul 02 17:10:46.344666 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.344636    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ab1d35cf-6b41-4851-9bf6-3f0de96ef752-kubelet-dir\") pod \"aws-ebs-csi-driver-node-l852t\" (UID: \"ab1d35cf-6b41-4851-9bf6-3f0de96ef752\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l852t"
Jul 02 17:10:46.345071 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.345051    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d20bc45e-c1ca-4088-ab8a-4266d1c66c8c-agent-certs\") pod \"konnectivity-agent-bvtjp\" (UID: \"d20bc45e-c1ca-4088-ab8a-4266d1c66c8c\") " pod="kube-system/konnectivity-agent-bvtjp"
Jul 02 17:10:46.345863 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.345846    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/31c6d25a-09ab-4af9-bda6-e98f486b8f6f-etc-tuned\") pod \"tuned-wkl8x\" (UID: \"31c6d25a-09ab-4af9-bda6-e98f486b8f6f\") " pod="openshift-cluster-node-tuning-operator/tuned-wkl8x"
Jul 02 17:10:46.350980 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.350960    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzdf8\" (UniqueName: \"kubernetes.io/projected/31c6d25a-09ab-4af9-bda6-e98f486b8f6f-kube-api-access-rzdf8\") pod \"tuned-wkl8x\" (UID: \"31c6d25a-09ab-4af9-bda6-e98f486b8f6f\") " pod="openshift-cluster-node-tuning-operator/tuned-wkl8x"
Jul 02 17:10:46.368900 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.368877    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fx86v\" (UniqueName: \"kubernetes.io/projected/de6a6072-1ba3-44d4-8fbd-4e332b70d7a5-kube-api-access-fx86v\") pod \"node-ca-cr9bq\" (UID: \"de6a6072-1ba3-44d4-8fbd-4e332b70d7a5\") " pod="openshift-image-registry/node-ca-cr9bq"
Jul 02 17:10:46.369498 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:10:46.369466    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 17:10:46.369498 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:10:46.369498    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 17:10:46.369628 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:10:46.369509    2578 projected.go:196] Error preparing data for projected volume kube-api-access-skvsn for pod openshift-network-diagnostics/network-check-target-p5sdw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 17:10:46.369628 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:10:46.369590    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fb3341a1-f14e-40be-8591-28a12d33716b-kube-api-access-skvsn podName:fb3341a1-f14e-40be-8591-28a12d33716b nodeName:}" failed. No retries permitted until 2026-07-02 17:10:46.869568192 +0000 UTC m=+2.059270832 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-skvsn" (UniqueName: "kubernetes.io/projected/fb3341a1-f14e-40be-8591-28a12d33716b-kube-api-access-skvsn") pod "network-check-target-p5sdw" (UID: "fb3341a1-f14e-40be-8591-28a12d33716b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 17:10:46.371637 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.371610    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2l4dr\" (UniqueName: \"kubernetes.io/projected/16a92923-d844-41d1-adee-c655f4a3ff8f-kube-api-access-2l4dr\") pod \"iptables-alerter-tcwxf\" (UID: \"16a92923-d844-41d1-adee-c655f4a3ff8f\") " pod="openshift-network-operator/iptables-alerter-tcwxf"
Jul 02 17:10:46.372764 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.372739    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpl9k\" (UniqueName: \"kubernetes.io/projected/ab1d35cf-6b41-4851-9bf6-3f0de96ef752-kube-api-access-kpl9k\") pod \"aws-ebs-csi-driver-node-l852t\" (UID: \"ab1d35cf-6b41-4851-9bf6-3f0de96ef752\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l852t"
Jul 02 17:10:46.373550 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.373528    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5n68w\" (UniqueName: \"kubernetes.io/projected/fb0fdece-96ab-471d-87e5-89e41822fd53-kube-api-access-5n68w\") pod \"node-resolver-vfd4d\" (UID: \"fb0fdece-96ab-471d-87e5-89e41822fd53\") " pod="openshift-dns/node-resolver-vfd4d"
Jul 02 17:10:46.374258 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.374239    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2djdv\" (UniqueName: \"kubernetes.io/projected/8f4635ce-bab5-4ebd-8db9-2837729fd121-kube-api-access-2djdv\") pod \"multus-kbqsq\" (UID: \"8f4635ce-bab5-4ebd-8db9-2837729fd121\") " pod="openshift-multus/multus-kbqsq"
Jul 02 17:10:46.374331 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.374314    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqh2q\" (UniqueName: \"kubernetes.io/projected/d1d3526d-01f3-4e77-a78e-ac8954a7a207-kube-api-access-sqh2q\") pod \"network-metrics-daemon-g67j2\" (UID: \"d1d3526d-01f3-4e77-a78e-ac8954a7a207\") " pod="openshift-multus/network-metrics-daemon-g67j2"
Jul 02 17:10:46.374734 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.374718    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2w8k6\" (UniqueName: \"kubernetes.io/projected/d6628590-1cf7-4a61-9350-539f3ae7ed91-kube-api-access-2w8k6\") pod \"ovnkube-node-62g9m\" (UID: \"d6628590-1cf7-4a61-9350-539f3ae7ed91\") " pod="openshift-ovn-kubernetes/ovnkube-node-62g9m"
Jul 02 17:10:46.382863 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.382846    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5g7t\" (UniqueName: \"kubernetes.io/projected/2d56f816-270b-4962-b1f0-2e5b8acdb3ce-kube-api-access-t5g7t\") pod \"multus-additional-cni-plugins-87dbx\" (UID: \"2d56f816-270b-4962-b1f0-2e5b8acdb3ce\") " pod="openshift-multus/multus-additional-cni-plugins-87dbx"
Jul 02 17:10:46.506835 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.506808    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l852t"
Jul 02 17:10:46.522325 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.522304    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cr9bq"
Jul 02 17:10:46.544337 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.544287    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-87dbx"
Jul 02 17:10:46.557873 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.557853    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tcwxf"
Jul 02 17:10:46.572467 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.572443    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bvtjp"
Jul 02 17:10:46.594299 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.594275    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wkl8x"
Jul 02 17:10:46.607896 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.607873    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vfd4d"
Jul 02 17:10:46.628751 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.628727    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kbqsq"
Jul 02 17:10:46.632444 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.632430    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-62g9m"
Jul 02 17:10:46.638751 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:46.638728    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a1d014754611bbab3feb2df8e5c006f.slice/crio-8e2ae1c458f5d0f133ee0c994cf3ab749580f6b300d2c635be852697b6eb1ff4 WatchSource:0}: Error finding container 8e2ae1c458f5d0f133ee0c994cf3ab749580f6b300d2c635be852697b6eb1ff4: Status 404 returned error can't find the container with id 8e2ae1c458f5d0f133ee0c994cf3ab749580f6b300d2c635be852697b6eb1ff4
Jul 02 17:10:46.639485 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:46.639466    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffc3b6c26cb60d94275aa594f7eb9639.slice/crio-43584e43acb0a0b77613fa486c06a17919f6fe5523f4b50b9e0f56a3657d4fba WatchSource:0}: Error finding container 43584e43acb0a0b77613fa486c06a17919f6fe5523f4b50b9e0f56a3657d4fba: Status 404 returned error can't find the container with id 43584e43acb0a0b77613fa486c06a17919f6fe5523f4b50b9e0f56a3657d4fba
Jul 02 17:10:46.640145 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:46.640128    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f4635ce_bab5_4ebd_8db9_2837729fd121.slice/crio-c910b17b610c873ba087c2cc816b625305859cc5ed20d773808cb906b0278cb0 WatchSource:0}: Error finding container c910b17b610c873ba087c2cc816b625305859cc5ed20d773808cb906b0278cb0: Status 404 returned error can't find the container with id c910b17b610c873ba087c2cc816b625305859cc5ed20d773808cb906b0278cb0
Jul 02 17:10:46.642004 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:46.641949    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6628590_1cf7_4a61_9350_539f3ae7ed91.slice/crio-252dbe3cdc1854b0ceb94b5b977ebb485c58af131cb730371a564b18906dc656 WatchSource:0}: Error finding container 252dbe3cdc1854b0ceb94b5b977ebb485c58af131cb730371a564b18906dc656: Status 404 returned error can't find the container with id 252dbe3cdc1854b0ceb94b5b977ebb485c58af131cb730371a564b18906dc656
Jul 02 17:10:46.644292 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.644277    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 17:10:46.845199 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.845174    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ac2c336-c8a9-484a-83df-60182dc9faf5-original-pull-secret\") pod \"global-pull-secret-syncer-cwjw5\" (UID: \"5ac2c336-c8a9-484a-83df-60182dc9faf5\") " pod="kube-system/global-pull-secret-syncer-cwjw5"
Jul 02 17:10:46.845341 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.845211    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1d3526d-01f3-4e77-a78e-ac8954a7a207-metrics-certs\") pod \"network-metrics-daemon-g67j2\" (UID: \"d1d3526d-01f3-4e77-a78e-ac8954a7a207\") " pod="openshift-multus/network-metrics-daemon-g67j2"
Jul 02 17:10:46.845341 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:10:46.845322    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 17:10:46.845445 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:10:46.845384    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1d3526d-01f3-4e77-a78e-ac8954a7a207-metrics-certs podName:d1d3526d-01f3-4e77-a78e-ac8954a7a207 nodeName:}" failed. No retries permitted until 2026-07-02 17:10:47.845366773 +0000 UTC m=+3.035069436 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d1d3526d-01f3-4e77-a78e-ac8954a7a207-metrics-certs") pod "network-metrics-daemon-g67j2" (UID: "d1d3526d-01f3-4e77-a78e-ac8954a7a207") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 17:10:46.845445 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:10:46.845406    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 17:10:46.845542 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:10:46.845480    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ac2c336-c8a9-484a-83df-60182dc9faf5-original-pull-secret podName:5ac2c336-c8a9-484a-83df-60182dc9faf5 nodeName:}" failed. No retries permitted until 2026-07-02 17:10:47.84545772 +0000 UTC m=+3.035160362 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5ac2c336-c8a9-484a-83df-60182dc9faf5-original-pull-secret") pod "global-pull-secret-syncer-cwjw5" (UID: "5ac2c336-c8a9-484a-83df-60182dc9faf5") : object "kube-system"/"original-pull-secret" not registered
Jul 02 17:10:46.845542 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:46.845498    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16a92923_d844_41d1_adee_c655f4a3ff8f.slice/crio-f0102f5468731a249c18b816d9dc9945b1765f699a14d5bdfb9b941002fe1159 WatchSource:0}: Error finding container f0102f5468731a249c18b816d9dc9945b1765f699a14d5bdfb9b941002fe1159: Status 404 returned error can't find the container with id f0102f5468731a249c18b816d9dc9945b1765f699a14d5bdfb9b941002fe1159
Jul 02 17:10:46.859733 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:46.859712    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab1d35cf_6b41_4851_9bf6_3f0de96ef752.slice/crio-d897e9a843c9cd04c5d70498027b2ce8cceb80c243b180229a78a2215b06657a WatchSource:0}: Error finding container d897e9a843c9cd04c5d70498027b2ce8cceb80c243b180229a78a2215b06657a: Status 404 returned error can't find the container with id d897e9a843c9cd04c5d70498027b2ce8cceb80c243b180229a78a2215b06657a
Jul 02 17:10:46.884950 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:46.884931    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde6a6072_1ba3_44d4_8fbd_4e332b70d7a5.slice/crio-62dd0442a747d590883eeb3771cda70e14c88da4de0d09c15997c357cc2d9903 WatchSource:0}: Error finding container 62dd0442a747d590883eeb3771cda70e14c88da4de0d09c15997c357cc2d9903: Status 404 returned error can't find the container with id 62dd0442a747d590883eeb3771cda70e14c88da4de0d09c15997c357cc2d9903
Jul 02 17:10:46.946453 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:46.946429    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skvsn\" (UniqueName: \"kubernetes.io/projected/fb3341a1-f14e-40be-8591-28a12d33716b-kube-api-access-skvsn\") pod \"network-check-target-p5sdw\" (UID: \"fb3341a1-f14e-40be-8591-28a12d33716b\") " pod="openshift-network-diagnostics/network-check-target-p5sdw"
Jul 02 17:10:46.946607 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:10:46.946590    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 17:10:46.946651 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:10:46.946610    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 17:10:46.946651 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:10:46.946621    2578 projected.go:196] Error preparing data for projected volume kube-api-access-skvsn for pod openshift-network-diagnostics/network-check-target-p5sdw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 17:10:46.946729 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:10:46.946676    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fb3341a1-f14e-40be-8591-28a12d33716b-kube-api-access-skvsn podName:fb3341a1-f14e-40be-8591-28a12d33716b nodeName:}" failed. No retries permitted until 2026-07-02 17:10:47.946662429 +0000 UTC m=+3.136365069 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-skvsn" (UniqueName: "kubernetes.io/projected/fb3341a1-f14e-40be-8591-28a12d33716b-kube-api-access-skvsn") pod "network-check-target-p5sdw" (UID: "fb3341a1-f14e-40be-8591-28a12d33716b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 17:10:46.965426 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:46.965400    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd20bc45e_c1ca_4088_ab8a_4266d1c66c8c.slice/crio-999f2a282b7151cc3eaa8f76bcabdfe264d58898a3f3b05de2cafc7b83e19c60 WatchSource:0}: Error finding container 999f2a282b7151cc3eaa8f76bcabdfe264d58898a3f3b05de2cafc7b83e19c60: Status 404 returned error can't find the container with id 999f2a282b7151cc3eaa8f76bcabdfe264d58898a3f3b05de2cafc7b83e19c60
Jul 02 17:10:46.996201 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:46.996173    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d56f816_270b_4962_b1f0_2e5b8acdb3ce.slice/crio-bee6de31f44871d1d5bb517ef794bf1cd7394a7e6e99a58c18e4fa2daef26438 WatchSource:0}: Error finding container bee6de31f44871d1d5bb517ef794bf1cd7394a7e6e99a58c18e4fa2daef26438: Status 404 returned error can't find the container with id bee6de31f44871d1d5bb517ef794bf1cd7394a7e6e99a58c18e4fa2daef26438
Jul 02 17:10:47.043582 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:10:47.043549    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31c6d25a_09ab_4af9_bda6_e98f486b8f6f.slice/crio-1f8afccab5f7a61dbf8752ee44444b8129e75fbe1e820ceb64558d54b29dba72 WatchSource:0}: Error finding container 1f8afccab5f7a61dbf8752ee44444b8129e75fbe1e820ceb64558d54b29dba72: Status 404 returned error can't find the container with id 1f8afccab5f7a61dbf8752ee44444b8129e75fbe1e820ceb64558d54b29dba72
Jul 02 17:10:47.081055 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:47.080984    2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 17:10:47.293314 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:47.293246    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 17:05:46 +0000 UTC" deadline="2028-01-14 11:43:23.645538062 +0000 UTC"
Jul 02 17:10:47.293314 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:47.293314    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13458h32m36.352228837s"
Jul 02 17:10:47.376574 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:47.376538    2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 17:10:47.492936 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:47.492852    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cwjw5"
Jul 02 17:10:47.493116 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:10:47.492973    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cwjw5" podUID="5ac2c336-c8a9-484a-83df-60182dc9faf5"
Jul 02 17:10:47.508500 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:47.508436    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tcwxf" event={"ID":"16a92923-d844-41d1-adee-c655f4a3ff8f","Type":"ContainerStarted","Data":"f0102f5468731a249c18b816d9dc9945b1765f699a14d5bdfb9b941002fe1159"}
Jul 02 17:10:47.519183 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:47.519148    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-62g9m" event={"ID":"d6628590-1cf7-4a61-9350-539f3ae7ed91","Type":"ContainerStarted","Data":"252dbe3cdc1854b0ceb94b5b977ebb485c58af131cb730371a564b18906dc656"}
Jul 02 17:10:47.535671 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:47.535640    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kbqsq" event={"ID":"8f4635ce-bab5-4ebd-8db9-2837729fd121","Type":"ContainerStarted","Data":"c910b17b610c873ba087c2cc816b625305859cc5ed20d773808cb906b0278cb0"}
Jul 02 17:10:47.554037 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:47.553943    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vfd4d" event={"ID":"fb0fdece-96ab-471d-87e5-89e41822fd53","Type":"ContainerStarted","Data":"27996c2cc5e0c9840c4d863c1d4b19047794cd08cfa208ba3f7e43a219a8d4cb"}
Jul 02 17:10:47.569771 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:47.569738    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wkl8x" event={"ID":"31c6d25a-09ab-4af9-bda6-e98f486b8f6f","Type":"ContainerStarted","Data":"1f8afccab5f7a61dbf8752ee44444b8129e75fbe1e820ceb64558d54b29dba72"}
Jul 02 17:10:47.586771 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:47.586736    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bvtjp" event={"ID":"d20bc45e-c1ca-4088-ab8a-4266d1c66c8c","Type":"ContainerStarted","Data":"999f2a282b7151cc3eaa8f76bcabdfe264d58898a3f3b05de2cafc7b83e19c60"}
Jul 02 17:10:47.594640 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:47.594611    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cr9bq" event={"ID":"de6a6072-1ba3-44d4-8fbd-4e332b70d7a5","Type":"ContainerStarted","Data":"62dd0442a747d590883eeb3771cda70e14c88da4de0d09c15997c357cc2d9903"}
Jul 02 17:10:47.602094 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:47.602061    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l852t" event={"ID":"ab1d35cf-6b41-4851-9bf6-3f0de96ef752","Type":"ContainerStarted","Data":"d897e9a843c9cd04c5d70498027b2ce8cceb80c243b180229a78a2215b06657a"}
Jul 02 17:10:47.614572 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:47.614547    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-67.ec2.internal" event={"ID":"6a1d014754611bbab3feb2df8e5c006f","Type":"ContainerStarted","Data":"8e2ae1c458f5d0f133ee0c994cf3ab749580f6b300d2c635be852697b6eb1ff4"}
Jul 02 17:10:47.631188 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:47.631160    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-67.ec2.internal" event={"ID":"ffc3b6c26cb60d94275aa594f7eb9639","Type":"ContainerStarted","Data":"43584e43acb0a0b77613fa486c06a17919f6fe5523f4b50b9e0f56a3657d4fba"}
Jul 02 17:10:47.642475 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:47.642446    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-87dbx" event={"ID":"2d56f816-270b-4962-b1f0-2e5b8acdb3ce","Type":"ContainerStarted","Data":"bee6de31f44871d1d5bb517ef794bf1cd7394a7e6e99a58c18e4fa2daef26438"}
Jul 02 17:10:47.855239 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:47.855155    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ac2c336-c8a9-484a-83df-60182dc9faf5-original-pull-secret\") pod \"global-pull-secret-syncer-cwjw5\" (UID: \"5ac2c336-c8a9-484a-83df-60182dc9faf5\") " pod="kube-system/global-pull-secret-syncer-cwjw5"
Jul 02 17:10:47.855239 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:47.855211    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1d3526d-01f3-4e77-a78e-ac8954a7a207-metrics-certs\") pod \"network-metrics-daemon-g67j2\" (UID: \"d1d3526d-01f3-4e77-a78e-ac8954a7a207\") " pod="openshift-multus/network-metrics-daemon-g67j2"
Jul 02 17:10:47.855463 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:10:47.855318    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 17:10:47.855463 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:10:47.855405    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ac2c336-c8a9-484a-83df-60182dc9faf5-original-pull-secret podName:5ac2c336-c8a9-484a-83df-60182dc9faf5 nodeName:}" failed. No retries permitted until 2026-07-02 17:10:49.855384364 +0000 UTC m=+5.045087022 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5ac2c336-c8a9-484a-83df-60182dc9faf5-original-pull-secret") pod "global-pull-secret-syncer-cwjw5" (UID: "5ac2c336-c8a9-484a-83df-60182dc9faf5") : object "kube-system"/"original-pull-secret" not registered
Jul 02 17:10:47.856761 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:10:47.855324    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 17:10:47.856761 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:10:47.855782    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1d3526d-01f3-4e77-a78e-ac8954a7a207-metrics-certs podName:d1d3526d-01f3-4e77-a78e-ac8954a7a207 nodeName:}" failed. No retries permitted until 2026-07-02 17:10:49.855766585 +0000 UTC m=+5.045469228 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d1d3526d-01f3-4e77-a78e-ac8954a7a207-metrics-certs") pod "network-metrics-daemon-g67j2" (UID: "d1d3526d-01f3-4e77-a78e-ac8954a7a207") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 17:10:47.956578 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:47.956328    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skvsn\" (UniqueName: \"kubernetes.io/projected/fb3341a1-f14e-40be-8591-28a12d33716b-kube-api-access-skvsn\") pod \"network-check-target-p5sdw\" (UID: \"fb3341a1-f14e-40be-8591-28a12d33716b\") " pod="openshift-network-diagnostics/network-check-target-p5sdw"
Jul 02 17:10:47.956578 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:10:47.956542    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 17:10:47.956578 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:10:47.956561    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 17:10:47.956578 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:10:47.956573    2578 projected.go:196] Error preparing data for projected volume kube-api-access-skvsn for pod openshift-network-diagnostics/network-check-target-p5sdw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 17:10:47.956931 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:10:47.956630    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fb3341a1-f14e-40be-8591-28a12d33716b-kube-api-access-skvsn podName:fb3341a1-f14e-40be-8591-28a12d33716b nodeName:}" failed. No retries permitted until 2026-07-02 17:10:49.956610573 +0000 UTC m=+5.146313226 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-skvsn" (UniqueName: "kubernetes.io/projected/fb3341a1-f14e-40be-8591-28a12d33716b-kube-api-access-skvsn") pod "network-check-target-p5sdw" (UID: "fb3341a1-f14e-40be-8591-28a12d33716b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 17:10:48.294223 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:48.294183    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 17:05:46 +0000 UTC" deadline="2027-12-11 11:19:12.975748644 +0000 UTC"
Jul 02 17:10:48.294223 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:48.294222    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12642h8m24.681531056s"
Jul 02 17:10:48.489846 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:48.489808    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g67j2"
Jul 02 17:10:48.490041 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:48.489849    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p5sdw"
Jul 02 17:10:48.490041 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:10:48.489955    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g67j2" podUID="d1d3526d-01f3-4e77-a78e-ac8954a7a207"
Jul 02 17:10:48.490160 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:10:48.490089    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p5sdw" podUID="fb3341a1-f14e-40be-8591-28a12d33716b"
Jul 02 17:10:49.492813 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:49.492783    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cwjw5"
Jul 02 17:10:49.493383 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:10:49.492922    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cwjw5" podUID="5ac2c336-c8a9-484a-83df-60182dc9faf5"
Jul 02 17:10:49.872621 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:49.872549    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ac2c336-c8a9-484a-83df-60182dc9faf5-original-pull-secret\") pod \"global-pull-secret-syncer-cwjw5\" (UID: \"5ac2c336-c8a9-484a-83df-60182dc9faf5\") " pod="kube-system/global-pull-secret-syncer-cwjw5"
Jul 02 17:10:49.872621 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:49.872601    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1d3526d-01f3-4e77-a78e-ac8954a7a207-metrics-certs\") pod \"network-metrics-daemon-g67j2\" (UID: \"d1d3526d-01f3-4e77-a78e-ac8954a7a207\") " pod="openshift-multus/network-metrics-daemon-g67j2"
Jul 02 17:10:49.872796 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:10:49.872739    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 17:10:49.872832 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:10:49.872799    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1d3526d-01f3-4e77-a78e-ac8954a7a207-metrics-certs podName:d1d3526d-01f3-4e77-a78e-ac8954a7a207 nodeName:}" failed. No retries permitted until 2026-07-02 17:10:53.872779917 +0000 UTC m=+9.062482581 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d1d3526d-01f3-4e77-a78e-ac8954a7a207-metrics-certs") pod "network-metrics-daemon-g67j2" (UID: "d1d3526d-01f3-4e77-a78e-ac8954a7a207") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 17:10:49.873207 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:10:49.873187    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 17:10:49.873307 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:10:49.873238    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ac2c336-c8a9-484a-83df-60182dc9faf5-original-pull-secret podName:5ac2c336-c8a9-484a-83df-60182dc9faf5 nodeName:}" failed. No retries permitted until 2026-07-02 17:10:53.873223976 +0000 UTC m=+9.062926617 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5ac2c336-c8a9-484a-83df-60182dc9faf5-original-pull-secret") pod "global-pull-secret-syncer-cwjw5" (UID: "5ac2c336-c8a9-484a-83df-60182dc9faf5") : object "kube-system"/"original-pull-secret" not registered
Jul 02 17:10:49.973356 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:49.973323    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skvsn\" (UniqueName: \"kubernetes.io/projected/fb3341a1-f14e-40be-8591-28a12d33716b-kube-api-access-skvsn\") pod \"network-check-target-p5sdw\" (UID: \"fb3341a1-f14e-40be-8591-28a12d33716b\") " pod="openshift-network-diagnostics/network-check-target-p5sdw"
Jul 02 17:10:49.973535 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:10:49.973473    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 17:10:49.973535 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:10:49.973491    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 17:10:49.973535 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:10:49.973502    2578 projected.go:196] Error preparing data for projected volume kube-api-access-skvsn for pod openshift-network-diagnostics/network-check-target-p5sdw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 17:10:49.973686 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:10:49.973553    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fb3341a1-f14e-40be-8591-28a12d33716b-kube-api-access-skvsn podName:fb3341a1-f14e-40be-8591-28a12d33716b nodeName:}" failed. No retries permitted until 2026-07-02 17:10:53.973535931 +0000 UTC m=+9.163238588 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-skvsn" (UniqueName: "kubernetes.io/projected/fb3341a1-f14e-40be-8591-28a12d33716b-kube-api-access-skvsn") pod "network-check-target-p5sdw" (UID: "fb3341a1-f14e-40be-8591-28a12d33716b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 17:10:50.490616 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:50.490586    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g67j2"
Jul 02 17:10:50.490616 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:50.490618    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p5sdw"
Jul 02 17:10:50.490848 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:10:50.490725    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g67j2" podUID="d1d3526d-01f3-4e77-a78e-ac8954a7a207"
Jul 02 17:10:50.490902 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:10:50.490845    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p5sdw" podUID="fb3341a1-f14e-40be-8591-28a12d33716b"
Jul 02 17:10:51.494573 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:51.494545    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cwjw5"
Jul 02 17:10:51.495053 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:10:51.494659    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cwjw5" podUID="5ac2c336-c8a9-484a-83df-60182dc9faf5"
Jul 02 17:10:52.490815 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:52.490787    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p5sdw"
Jul 02 17:10:52.490983 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:52.490787    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g67j2"
Jul 02 17:10:52.490983 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:10:52.490905    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p5sdw" podUID="fb3341a1-f14e-40be-8591-28a12d33716b"
Jul 02 17:10:52.491128 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:10:52.490993    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g67j2" podUID="d1d3526d-01f3-4e77-a78e-ac8954a7a207"
Jul 02 17:10:53.491038 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:53.490538    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cwjw5"
Jul 02 17:10:53.491038 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:10:53.490678    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cwjw5" podUID="5ac2c336-c8a9-484a-83df-60182dc9faf5"
Jul 02 17:10:53.905265 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:53.905180    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ac2c336-c8a9-484a-83df-60182dc9faf5-original-pull-secret\") pod \"global-pull-secret-syncer-cwjw5\" (UID: \"5ac2c336-c8a9-484a-83df-60182dc9faf5\") " pod="kube-system/global-pull-secret-syncer-cwjw5"
Jul 02 17:10:53.905265 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:53.905222    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1d3526d-01f3-4e77-a78e-ac8954a7a207-metrics-certs\") pod \"network-metrics-daemon-g67j2\" (UID: \"d1d3526d-01f3-4e77-a78e-ac8954a7a207\") " pod="openshift-multus/network-metrics-daemon-g67j2"
Jul 02 17:10:53.905484 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:10:53.905332    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 17:10:53.905484 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:10:53.905379    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1d3526d-01f3-4e77-a78e-ac8954a7a207-metrics-certs podName:d1d3526d-01f3-4e77-a78e-ac8954a7a207 nodeName:}" failed. No retries permitted until 2026-07-02 17:11:01.905365256 +0000 UTC m=+17.095067899 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d1d3526d-01f3-4e77-a78e-ac8954a7a207-metrics-certs") pod "network-metrics-daemon-g67j2" (UID: "d1d3526d-01f3-4e77-a78e-ac8954a7a207") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 17:10:53.905484 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:10:53.905391    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 17:10:53.905484 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:10:53.905461    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ac2c336-c8a9-484a-83df-60182dc9faf5-original-pull-secret podName:5ac2c336-c8a9-484a-83df-60182dc9faf5 nodeName:}" failed. No retries permitted until 2026-07-02 17:11:01.905440783 +0000 UTC m=+17.095143437 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5ac2c336-c8a9-484a-83df-60182dc9faf5-original-pull-secret") pod "global-pull-secret-syncer-cwjw5" (UID: "5ac2c336-c8a9-484a-83df-60182dc9faf5") : object "kube-system"/"original-pull-secret" not registered
Jul 02 17:10:54.006034 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:54.005981    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skvsn\" (UniqueName: \"kubernetes.io/projected/fb3341a1-f14e-40be-8591-28a12d33716b-kube-api-access-skvsn\") pod \"network-check-target-p5sdw\" (UID: \"fb3341a1-f14e-40be-8591-28a12d33716b\") " pod="openshift-network-diagnostics/network-check-target-p5sdw"
Jul 02 17:10:54.006260 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:10:54.006216    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 17:10:54.006260 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:10:54.006244    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 17:10:54.006260 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:10:54.006259    2578 projected.go:196] Error preparing data for projected volume kube-api-access-skvsn for pod openshift-network-diagnostics/network-check-target-p5sdw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 17:10:54.006512 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:10:54.006322    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fb3341a1-f14e-40be-8591-28a12d33716b-kube-api-access-skvsn podName:fb3341a1-f14e-40be-8591-28a12d33716b nodeName:}" failed. No retries permitted until 2026-07-02 17:11:02.006303353 +0000 UTC m=+17.196005995 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-skvsn" (UniqueName: "kubernetes.io/projected/fb3341a1-f14e-40be-8591-28a12d33716b-kube-api-access-skvsn") pod "network-check-target-p5sdw" (UID: "fb3341a1-f14e-40be-8591-28a12d33716b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 17:10:54.489817 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:54.489778    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g67j2"
Jul 02 17:10:54.490002 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:54.489778    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p5sdw"
Jul 02 17:10:54.490002 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:10:54.489925    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g67j2" podUID="d1d3526d-01f3-4e77-a78e-ac8954a7a207"
Jul 02 17:10:54.490128 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:10:54.490035    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p5sdw" podUID="fb3341a1-f14e-40be-8591-28a12d33716b"
Jul 02 17:10:55.492008 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:55.491972    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cwjw5"
Jul 02 17:10:55.492573 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:10:55.492149    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cwjw5" podUID="5ac2c336-c8a9-484a-83df-60182dc9faf5"
Jul 02 17:10:56.490657 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:56.490626    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g67j2"
Jul 02 17:10:56.490845 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:56.490674    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p5sdw"
Jul 02 17:10:56.490845 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:10:56.490774    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g67j2" podUID="d1d3526d-01f3-4e77-a78e-ac8954a7a207"
Jul 02 17:10:56.490966 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:10:56.490910    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p5sdw" podUID="fb3341a1-f14e-40be-8591-28a12d33716b"
Jul 02 17:10:57.490166 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:57.490130    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cwjw5"
Jul 02 17:10:57.490614 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:10:57.490244    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cwjw5" podUID="5ac2c336-c8a9-484a-83df-60182dc9faf5"
Jul 02 17:10:58.490494 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:58.490448    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g67j2"
Jul 02 17:10:58.490494 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:58.490485    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p5sdw"
Jul 02 17:10:58.490866 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:10:58.490562    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g67j2" podUID="d1d3526d-01f3-4e77-a78e-ac8954a7a207"
Jul 02 17:10:58.490866 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:10:58.490674    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p5sdw" podUID="fb3341a1-f14e-40be-8591-28a12d33716b"
Jul 02 17:10:59.490100 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:10:59.490063    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cwjw5"
Jul 02 17:10:59.490281 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:10:59.490198    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cwjw5" podUID="5ac2c336-c8a9-484a-83df-60182dc9faf5"
Jul 02 17:11:00.490654 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:00.490619    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g67j2"
Jul 02 17:11:00.490654 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:00.490646    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p5sdw"
Jul 02 17:11:00.491240 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:11:00.490739    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g67j2" podUID="d1d3526d-01f3-4e77-a78e-ac8954a7a207"
Jul 02 17:11:00.491240 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:11:00.490856    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p5sdw" podUID="fb3341a1-f14e-40be-8591-28a12d33716b"
Jul 02 17:11:01.490093 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:01.490062    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cwjw5"
Jul 02 17:11:01.490269 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:11:01.490194    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cwjw5" podUID="5ac2c336-c8a9-484a-83df-60182dc9faf5"
Jul 02 17:11:01.969512 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:01.969433    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ac2c336-c8a9-484a-83df-60182dc9faf5-original-pull-secret\") pod \"global-pull-secret-syncer-cwjw5\" (UID: \"5ac2c336-c8a9-484a-83df-60182dc9faf5\") " pod="kube-system/global-pull-secret-syncer-cwjw5"
Jul 02 17:11:01.969512 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:01.969482    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1d3526d-01f3-4e77-a78e-ac8954a7a207-metrics-certs\") pod \"network-metrics-daemon-g67j2\" (UID: \"d1d3526d-01f3-4e77-a78e-ac8954a7a207\") " pod="openshift-multus/network-metrics-daemon-g67j2"
Jul 02 17:11:01.969920 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:11:01.969587    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 17:11:01.969920 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:11:01.969642    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1d3526d-01f3-4e77-a78e-ac8954a7a207-metrics-certs podName:d1d3526d-01f3-4e77-a78e-ac8954a7a207 nodeName:}" failed. No retries permitted until 2026-07-02 17:11:17.969627256 +0000 UTC m=+33.159329901 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d1d3526d-01f3-4e77-a78e-ac8954a7a207-metrics-certs") pod "network-metrics-daemon-g67j2" (UID: "d1d3526d-01f3-4e77-a78e-ac8954a7a207") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 17:11:01.969920 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:11:01.969587    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 17:11:01.969920 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:11:01.969709    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ac2c336-c8a9-484a-83df-60182dc9faf5-original-pull-secret podName:5ac2c336-c8a9-484a-83df-60182dc9faf5 nodeName:}" failed. No retries permitted until 2026-07-02 17:11:17.969696248 +0000 UTC m=+33.159398898 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5ac2c336-c8a9-484a-83df-60182dc9faf5-original-pull-secret") pod "global-pull-secret-syncer-cwjw5" (UID: "5ac2c336-c8a9-484a-83df-60182dc9faf5") : object "kube-system"/"original-pull-secret" not registered
Jul 02 17:11:02.070766 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:02.070739    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skvsn\" (UniqueName: \"kubernetes.io/projected/fb3341a1-f14e-40be-8591-28a12d33716b-kube-api-access-skvsn\") pod \"network-check-target-p5sdw\" (UID: \"fb3341a1-f14e-40be-8591-28a12d33716b\") " pod="openshift-network-diagnostics/network-check-target-p5sdw"
Jul 02 17:11:02.070902 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:11:02.070845    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 17:11:02.070902 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:11:02.070859    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 17:11:02.070902 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:11:02.070867    2578 projected.go:196] Error preparing data for projected volume kube-api-access-skvsn for pod openshift-network-diagnostics/network-check-target-p5sdw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 17:11:02.071002 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:11:02.070912    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fb3341a1-f14e-40be-8591-28a12d33716b-kube-api-access-skvsn podName:fb3341a1-f14e-40be-8591-28a12d33716b nodeName:}" failed. No retries permitted until 2026-07-02 17:11:18.070901029 +0000 UTC m=+33.260603669 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-skvsn" (UniqueName: "kubernetes.io/projected/fb3341a1-f14e-40be-8591-28a12d33716b-kube-api-access-skvsn") pod "network-check-target-p5sdw" (UID: "fb3341a1-f14e-40be-8591-28a12d33716b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 17:11:02.490163 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:02.490132    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g67j2"
Jul 02 17:11:02.490347 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:11:02.490252    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g67j2" podUID="d1d3526d-01f3-4e77-a78e-ac8954a7a207"
Jul 02 17:11:02.490347 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:02.490292    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p5sdw"
Jul 02 17:11:02.490347 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:11:02.490344    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p5sdw" podUID="fb3341a1-f14e-40be-8591-28a12d33716b"
Jul 02 17:11:03.490253 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:03.490219    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cwjw5"
Jul 02 17:11:03.490720 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:11:03.490349    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cwjw5" podUID="5ac2c336-c8a9-484a-83df-60182dc9faf5"
Jul 02 17:11:04.489756 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:04.489718    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g67j2"
Jul 02 17:11:04.489948 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:11:04.489864    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g67j2" podUID="d1d3526d-01f3-4e77-a78e-ac8954a7a207"
Jul 02 17:11:04.489948 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:04.489925    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p5sdw"
Jul 02 17:11:04.490082 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:11:04.490053    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p5sdw" podUID="fb3341a1-f14e-40be-8591-28a12d33716b"
Jul 02 17:11:05.490690 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:05.490659    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cwjw5"
Jul 02 17:11:05.491135 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:11:05.490748    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cwjw5" podUID="5ac2c336-c8a9-484a-83df-60182dc9faf5"
Jul 02 17:11:06.490155 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:06.490125    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g67j2"
Jul 02 17:11:06.490259 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:06.490125    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p5sdw"
Jul 02 17:11:06.490259 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:11:06.490236    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g67j2" podUID="d1d3526d-01f3-4e77-a78e-ac8954a7a207"
Jul 02 17:11:06.490331 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:11:06.490286    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p5sdw" podUID="fb3341a1-f14e-40be-8591-28a12d33716b"
Jul 02 17:11:07.490625 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:07.490417    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cwjw5"
Jul 02 17:11:07.490968 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:11:07.490711    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cwjw5" podUID="5ac2c336-c8a9-484a-83df-60182dc9faf5"
Jul 02 17:11:07.689190 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:07.689156    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wkl8x" event={"ID":"31c6d25a-09ab-4af9-bda6-e98f486b8f6f","Type":"ContainerStarted","Data":"62073604c3fb0780745bf3cadfac66109d7f46726f51fb59e07a0328eb902bb4"}
Jul 02 17:11:07.690645 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:07.690616    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-67.ec2.internal" event={"ID":"6a1d014754611bbab3feb2df8e5c006f","Type":"ContainerStarted","Data":"795fb9dc46f99f59fe872c5818163eedf39eb0e4279c95146dc44bfc953d91d5"}
Jul 02 17:11:07.693606 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:07.693587    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-62g9m_d6628590-1cf7-4a61-9350-539f3ae7ed91/ovn-acl-logging/0.log"
Jul 02 17:11:07.693994 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:07.693970    2578 generic.go:356] "Generic (PLEG): container finished" podID="d6628590-1cf7-4a61-9350-539f3ae7ed91" containerID="67258459785e8fe8d9966089c647181bdbc44e16e85544f54ec21164b2d96493" exitCode=1
Jul 02 17:11:07.694104 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:07.694045    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-62g9m" event={"ID":"d6628590-1cf7-4a61-9350-539f3ae7ed91","Type":"ContainerStarted","Data":"47d7006207518169ac7564118a7b062c46c2709533ebce4ee14129f1b32dbfa8"}
Jul 02 17:11:07.694158 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:07.694123    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-62g9m" event={"ID":"d6628590-1cf7-4a61-9350-539f3ae7ed91","Type":"ContainerStarted","Data":"0cd8c8b50bb92b84bc828f5793dba3d0036807490cc5365ddd4a096dff3eb576"}
Jul 02 17:11:07.694196 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:07.694176    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-62g9m" event={"ID":"d6628590-1cf7-4a61-9350-539f3ae7ed91","Type":"ContainerStarted","Data":"7f5e582adfad0a6ee6533965cce876f444fe34412ea0be0b95d23e5dff8af521"}
Jul 02 17:11:07.694235 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:07.694223    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-62g9m" event={"ID":"d6628590-1cf7-4a61-9350-539f3ae7ed91","Type":"ContainerStarted","Data":"dac41a995bcf1e16d1cc2108163a5d4ee9c5b40b783359cce9357b8e97e7cc6f"}
Jul 02 17:11:07.694290 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:07.694271    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-62g9m" event={"ID":"d6628590-1cf7-4a61-9350-539f3ae7ed91","Type":"ContainerDied","Data":"67258459785e8fe8d9966089c647181bdbc44e16e85544f54ec21164b2d96493"}
Jul 02 17:11:07.694343 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:07.694319    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-62g9m" event={"ID":"d6628590-1cf7-4a61-9350-539f3ae7ed91","Type":"ContainerStarted","Data":"6a34212e4dedba2a62854b3fd55ce81b65fa2ed4cf6c440c6d7de68f63d720c5"}
Jul 02 17:11:07.695497 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:07.695477    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kbqsq" event={"ID":"8f4635ce-bab5-4ebd-8db9-2837729fd121","Type":"ContainerStarted","Data":"ad699373dca8822274e9bf93aba866536738c9678258140e1bc37a5609a1d684"}
Jul 02 17:11:07.710042 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:07.708076    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-wkl8x" podStartSLOduration=3.074589322 podStartE2EDuration="22.708007671s" totalImagesPullingTime="19.633418349s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 17:10:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:11:07.707592177 +0000 UTC m=+22.897294839" watchObservedRunningTime="2026-07-02 17:11:07.708007671 +0000 UTC m=+22.897710334"
Jul 02 17:11:07.746859 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:07.746812    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-67.ec2.internal" podStartSLOduration=21.746792965 podStartE2EDuration="21.746792965s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 17:10:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:11:07.725432345 +0000 UTC m=+22.915135008" watchObservedRunningTime="2026-07-02 17:11:07.746792965 +0000 UTC m=+22.936495630"
Jul 02 17:11:07.747204 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:07.747160    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-kbqsq" podStartSLOduration=2.306710087 podStartE2EDuration="22.74715077s" totalImagesPullingTime="20.440440683s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 17:10:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:11:07.746285897 +0000 UTC m=+22.935988561" watchObservedRunningTime="2026-07-02 17:11:07.74715077 +0000 UTC m=+22.936853433"
Jul 02 17:11:08.490464 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:08.490440    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g67j2"
Jul 02 17:11:08.490660 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:11:08.490534    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g67j2" podUID="d1d3526d-01f3-4e77-a78e-ac8954a7a207"
Jul 02 17:11:08.490660 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:08.490561    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p5sdw"
Jul 02 17:11:08.490660 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:11:08.490602    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p5sdw" podUID="fb3341a1-f14e-40be-8591-28a12d33716b"
Jul 02 17:11:08.700899 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:08.700861    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l852t" event={"ID":"ab1d35cf-6b41-4851-9bf6-3f0de96ef752","Type":"ContainerStarted","Data":"3e54a5ac2a460317b4a9c0af4d4b1e497c62f84490fea0fd766e82ef0a915f63"}
Jul 02 17:11:08.703271 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:08.703237    2578 generic.go:356] "Generic (PLEG): container finished" podID="ffc3b6c26cb60d94275aa594f7eb9639" containerID="7f7feb22f69c3b96f88b242e17f00ff2c7f6a8ed616e9bc13c7b47567498aa1a" exitCode=0
Jul 02 17:11:08.703422 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:08.703290    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-67.ec2.internal" event={"ID":"ffc3b6c26cb60d94275aa594f7eb9639","Type":"ContainerDied","Data":"7f7feb22f69c3b96f88b242e17f00ff2c7f6a8ed616e9bc13c7b47567498aa1a"}
Jul 02 17:11:08.704969 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:08.704942    2578 generic.go:356] "Generic (PLEG): container finished" podID="2d56f816-270b-4962-b1f0-2e5b8acdb3ce" containerID="efa77c8473c732f218a7e4d25c0ba9b7620ed82cb23112b66152ab338101de60" exitCode=0
Jul 02 17:11:08.705093 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:08.704968    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-87dbx" event={"ID":"2d56f816-270b-4962-b1f0-2e5b8acdb3ce","Type":"ContainerDied","Data":"efa77c8473c732f218a7e4d25c0ba9b7620ed82cb23112b66152ab338101de60"}
Jul 02 17:11:08.707089 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:08.706735    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tcwxf" event={"ID":"16a92923-d844-41d1-adee-c655f4a3ff8f","Type":"ContainerStarted","Data":"bd674580b6b973d4f7f9d64a92042720371d05c15c5e5c96f3b6a125f5f75a86"}
Jul 02 17:11:08.708149 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:08.708130    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vfd4d" event={"ID":"fb0fdece-96ab-471d-87e5-89e41822fd53","Type":"ContainerStarted","Data":"66177114c3cdea39a37c54efcafffa41a2414ba7fd31bcf686850523119275fe"}
Jul 02 17:11:08.709825 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:08.709764    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bvtjp" event={"ID":"d20bc45e-c1ca-4088-ab8a-4266d1c66c8c","Type":"ContainerStarted","Data":"281df67e5e55c22422a3fbb6087b227284c2873e053706c3fe71f25b882ee13a"}
Jul 02 17:11:08.711329 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:08.711272    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cr9bq" event={"ID":"de6a6072-1ba3-44d4-8fbd-4e332b70d7a5","Type":"ContainerStarted","Data":"d79c96bdc14e3537bc38dcba63658c7b7394533c82c86ac46de4fd7d6c279cc5"}
Jul 02 17:11:08.745108 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:08.745034    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-cr9bq" podStartSLOduration=3.995298476 podStartE2EDuration="23.745008415s" totalImagesPullingTime="19.749709939s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 17:10:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:11:08.744639539 +0000 UTC m=+23.934342202" watchObservedRunningTime="2026-07-02 17:11:08.745008415 +0000 UTC m=+23.934711076"
Jul 02 17:11:08.797221 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:08.795500    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-tcwxf" podStartSLOduration=4.006292432 podStartE2EDuration="23.795442756s" totalImagesPullingTime="19.789150324s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 17:10:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:11:08.794953412 +0000 UTC m=+23.984656076" watchObservedRunningTime="2026-07-02 17:11:08.795442756 +0000 UTC m=+23.985145418"
Jul 02 17:11:08.813684 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:08.813653    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-bvtjp" podStartSLOduration=4.144536302 podStartE2EDuration="23.813642737s" totalImagesPullingTime="19.669106435s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:10:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:11:08.813531875 +0000 UTC m=+24.003234538" watchObservedRunningTime="2026-07-02 17:11:08.813642737 +0000 UTC m=+24.003345398"
Jul 02 17:11:08.831646 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:08.831479    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-vfd4d" podStartSLOduration=4.393397715 podStartE2EDuration="23.831466234s" totalImagesPullingTime="19.438068519s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 17:10:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:11:08.831190084 +0000 UTC m=+24.020892746" watchObservedRunningTime="2026-07-02 17:11:08.831466234 +0000 UTC m=+24.021168895"
Jul 02 17:11:09.006505 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:09.006484    2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 02 17:11:09.127626 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:09.127603    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-bvtjp"
Jul 02 17:11:09.128066 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:09.128052    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-bvtjp"
Jul 02 17:11:09.366627 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:09.366504    2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-02T17:11:09.00650037Z","UUID":"e1b02700-29db-484a-9faa-888e07b903f1","Handler":null,"Name":"","Endpoint":""}
Jul 02 17:11:09.368209 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:09.368191    2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 02 17:11:09.368323 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:09.368230    2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 02 17:11:09.489831 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:09.489782    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cwjw5"
Jul 02 17:11:09.489952 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:11:09.489908    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cwjw5" podUID="5ac2c336-c8a9-484a-83df-60182dc9faf5"
Jul 02 17:11:09.715210 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:09.715139    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l852t" event={"ID":"ab1d35cf-6b41-4851-9bf6-3f0de96ef752","Type":"ContainerStarted","Data":"750fe440f9ee12f74a0cd1215ba7b54d08a47015e5582d433b479cf12e205028"}
Jul 02 17:11:09.716890 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:09.716867    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-67.ec2.internal" event={"ID":"ffc3b6c26cb60d94275aa594f7eb9639","Type":"ContainerStarted","Data":"b514a6b856bcfb6b4ac7283a4724021949a03dd9b368050ee3a524a9da5320a4"}
Jul 02 17:11:09.719915 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:09.719895    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-62g9m_d6628590-1cf7-4a61-9350-539f3ae7ed91/ovn-acl-logging/0.log"
Jul 02 17:11:09.720303 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:09.720267    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-62g9m" event={"ID":"d6628590-1cf7-4a61-9350-539f3ae7ed91","Type":"ContainerStarted","Data":"85dc8cc67adcc016a2ebf1d4758a872bcf38405f736107dd8d9915e21e8391d3"}
Jul 02 17:11:09.720691 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:09.720668    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-bvtjp"
Jul 02 17:11:09.721125 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:09.721098    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-bvtjp"
Jul 02 17:11:09.734917 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:09.734878    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-67.ec2.internal" podStartSLOduration=23.734861365 podStartE2EDuration="23.734861365s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 17:10:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:11:09.734440863 +0000 UTC m=+24.924143526" watchObservedRunningTime="2026-07-02 17:11:09.734861365 +0000 UTC m=+24.924564026"
Jul 02 17:11:10.347230 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:10.347143    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:11:10.441718 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:10.441677    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:11:10.490318 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:10.490286    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g67j2"
Jul 02 17:11:10.490463 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:11:10.490398    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g67j2" podUID="d1d3526d-01f3-4e77-a78e-ac8954a7a207"
Jul 02 17:11:10.490532 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:10.490461    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p5sdw"
Jul 02 17:11:10.490615 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:11:10.490596    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p5sdw" podUID="fb3341a1-f14e-40be-8591-28a12d33716b"
Jul 02 17:11:10.543367 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:10.543344    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:11:10.723982 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:10.723949    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l852t" event={"ID":"ab1d35cf-6b41-4851-9bf6-3f0de96ef752","Type":"ContainerStarted","Data":"1b12a0fe66cd662d29670d334914569c8c47cd7e8f866f703bc809069cd6c467"}
Jul 02 17:11:10.744061 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:10.743997    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l852t" podStartSLOduration=3.797303726 podStartE2EDuration="25.743982428s" totalImagesPullingTime="21.946678702s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 17:10:45 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:11:10.743980336 +0000 UTC m=+25.933682999" watchObservedRunningTime="2026-07-02 17:11:10.743982428 +0000 UTC m=+25.933685080"
Jul 02 17:11:11.490216 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:11.490183    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cwjw5"
Jul 02 17:11:11.490372 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:11:11.490286    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cwjw5" podUID="5ac2c336-c8a9-484a-83df-60182dc9faf5"
Jul 02 17:11:12.490368 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:12.490332    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g67j2"
Jul 02 17:11:12.490368 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:12.490361    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p5sdw"
Jul 02 17:11:12.490961 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:11:12.490466    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g67j2" podUID="d1d3526d-01f3-4e77-a78e-ac8954a7a207"
Jul 02 17:11:12.490961 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:11:12.490581    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p5sdw" podUID="fb3341a1-f14e-40be-8591-28a12d33716b"
Jul 02 17:11:12.730716 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:12.730687    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-62g9m_d6628590-1cf7-4a61-9350-539f3ae7ed91/ovn-acl-logging/0.log"
Jul 02 17:11:12.731073 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:12.731054    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-62g9m" event={"ID":"d6628590-1cf7-4a61-9350-539f3ae7ed91","Type":"ContainerStarted","Data":"dcb1fb53d2b3ea83c014babe0cb72c65c657e492b0cc8c20f1e3b801a4dabbed"}
Jul 02 17:11:12.731325 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:12.731308    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-62g9m"
Jul 02 17:11:12.731384 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:12.731371    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-62g9m"
Jul 02 17:11:12.731454 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:12.731439    2578 scope.go:117] "RemoveContainer" containerID="67258459785e8fe8d9966089c647181bdbc44e16e85544f54ec21164b2d96493"
Jul 02 17:11:12.748813 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:12.748794    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-62g9m"
Jul 02 17:11:13.490410 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:13.490382    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cwjw5"
Jul 02 17:11:13.490985 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:11:13.490486    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cwjw5" podUID="5ac2c336-c8a9-484a-83df-60182dc9faf5"
Jul 02 17:11:13.737608 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:13.737578    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-62g9m_d6628590-1cf7-4a61-9350-539f3ae7ed91/ovn-acl-logging/0.log"
Jul 02 17:11:13.738074 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:13.738043    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-62g9m" event={"ID":"d6628590-1cf7-4a61-9350-539f3ae7ed91","Type":"ContainerStarted","Data":"9498391b64de0002488b67fa6d9321616217ad7ed0341da1fb90b423ad539f69"}
Jul 02 17:11:13.738294 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:13.738273    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-62g9m"
Jul 02 17:11:13.757389 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:13.757359    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-62g9m"
Jul 02 17:11:13.771292 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:13.771241    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-62g9m" podStartSLOduration=8.696807114 podStartE2EDuration="28.771220693s" totalImagesPullingTime="20.074413579s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 17:10:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:11:13.770655517 +0000 UTC m=+28.960358178" watchObservedRunningTime="2026-07-02 17:11:13.771220693 +0000 UTC m=+28.960923356"
Jul 02 17:11:13.949192 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:13.949141    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:11:13.978051 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:13.978011    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-p5sdw"]
Jul 02 17:11:13.978179 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:13.978124    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p5sdw"
Jul 02 17:11:13.978214 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:11:13.978199    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p5sdw" podUID="fb3341a1-f14e-40be-8591-28a12d33716b"
Jul 02 17:11:13.980542 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:13.980515    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cwjw5"]
Jul 02 17:11:13.980660 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:13.980597    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cwjw5"
Jul 02 17:11:13.980702 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:11:13.980673    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cwjw5" podUID="5ac2c336-c8a9-484a-83df-60182dc9faf5"
Jul 02 17:11:13.981082 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:13.981063    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-g67j2"]
Jul 02 17:11:13.981170 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:13.981151    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g67j2"
Jul 02 17:11:13.981268 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:11:13.981235    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g67j2" podUID="d1d3526d-01f3-4e77-a78e-ac8954a7a207"
Jul 02 17:11:14.049279 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:14.049198    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:11:14.957832 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:14.957563    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:11:15.056103 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:15.056066    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:11:15.491621 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:15.491587    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p5sdw"
Jul 02 17:11:15.491785 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:15.491677    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g67j2"
Jul 02 17:11:15.491785 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:15.491699    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cwjw5"
Jul 02 17:11:15.491785 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:11:15.491764    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p5sdw" podUID="fb3341a1-f14e-40be-8591-28a12d33716b"
Jul 02 17:11:15.491951 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:11:15.491795    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g67j2" podUID="d1d3526d-01f3-4e77-a78e-ac8954a7a207"
Jul 02 17:11:15.491951 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:11:15.491866    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cwjw5" podUID="5ac2c336-c8a9-484a-83df-60182dc9faf5"
Jul 02 17:11:16.747508 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:16.747475    2578 generic.go:356] "Generic (PLEG): container finished" podID="2d56f816-270b-4962-b1f0-2e5b8acdb3ce" containerID="ff278cca2f7d45041b7079787022ef22ea4a58d6b0d101b22aa7274bc9aa1f1a" exitCode=0
Jul 02 17:11:16.747942 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:16.747538    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-87dbx" event={"ID":"2d56f816-270b-4962-b1f0-2e5b8acdb3ce","Type":"ContainerDied","Data":"ff278cca2f7d45041b7079787022ef22ea4a58d6b0d101b22aa7274bc9aa1f1a"}
Jul 02 17:11:17.490048 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:17.489751    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p5sdw"
Jul 02 17:11:17.490048 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:17.489782    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g67j2"
Jul 02 17:11:17.490048 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:17.489751    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cwjw5"
Jul 02 17:11:17.490048 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:11:17.489866    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p5sdw" podUID="fb3341a1-f14e-40be-8591-28a12d33716b"
Jul 02 17:11:17.490048 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:11:17.489950    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cwjw5" podUID="5ac2c336-c8a9-484a-83df-60182dc9faf5"
Jul 02 17:11:17.490048 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:11:17.490036    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g67j2" podUID="d1d3526d-01f3-4e77-a78e-ac8954a7a207"
Jul 02 17:11:17.751538 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:17.751506    2578 generic.go:356] "Generic (PLEG): container finished" podID="2d56f816-270b-4962-b1f0-2e5b8acdb3ce" containerID="d14582388c277bc0ce8aea45e4384cba357a36950b44909b8c16a6ac735f1e14" exitCode=0
Jul 02 17:11:17.751882 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:17.751563    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-87dbx" event={"ID":"2d56f816-270b-4962-b1f0-2e5b8acdb3ce","Type":"ContainerDied","Data":"d14582388c277bc0ce8aea45e4384cba357a36950b44909b8c16a6ac735f1e14"}
Jul 02 17:11:17.989857 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:17.989823    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1d3526d-01f3-4e77-a78e-ac8954a7a207-metrics-certs\") pod \"network-metrics-daemon-g67j2\" (UID: \"d1d3526d-01f3-4e77-a78e-ac8954a7a207\") " pod="openshift-multus/network-metrics-daemon-g67j2"
Jul 02 17:11:17.990042 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:17.989906    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ac2c336-c8a9-484a-83df-60182dc9faf5-original-pull-secret\") pod \"global-pull-secret-syncer-cwjw5\" (UID: \"5ac2c336-c8a9-484a-83df-60182dc9faf5\") " pod="kube-system/global-pull-secret-syncer-cwjw5"
Jul 02 17:11:17.990042 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:11:17.989965    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 17:11:17.990042 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:11:17.989996    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 17:11:17.990176 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:11:17.990047    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1d3526d-01f3-4e77-a78e-ac8954a7a207-metrics-certs podName:d1d3526d-01f3-4e77-a78e-ac8954a7a207 nodeName:}" failed. No retries permitted until 2026-07-02 17:11:49.990030304 +0000 UTC m=+65.179732958 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d1d3526d-01f3-4e77-a78e-ac8954a7a207-metrics-certs") pod "network-metrics-daemon-g67j2" (UID: "d1d3526d-01f3-4e77-a78e-ac8954a7a207") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 17:11:17.990176 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:11:17.990063    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ac2c336-c8a9-484a-83df-60182dc9faf5-original-pull-secret podName:5ac2c336-c8a9-484a-83df-60182dc9faf5 nodeName:}" failed. No retries permitted until 2026-07-02 17:11:49.990057138 +0000 UTC m=+65.179759778 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5ac2c336-c8a9-484a-83df-60182dc9faf5-original-pull-secret") pod "global-pull-secret-syncer-cwjw5" (UID: "5ac2c336-c8a9-484a-83df-60182dc9faf5") : object "kube-system"/"original-pull-secret" not registered
Jul 02 17:11:18.091042 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:18.090959    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skvsn\" (UniqueName: \"kubernetes.io/projected/fb3341a1-f14e-40be-8591-28a12d33716b-kube-api-access-skvsn\") pod \"network-check-target-p5sdw\" (UID: \"fb3341a1-f14e-40be-8591-28a12d33716b\") " pod="openshift-network-diagnostics/network-check-target-p5sdw"
Jul 02 17:11:18.091147 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:11:18.091081    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 17:11:18.091147 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:11:18.091098    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 17:11:18.091147 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:11:18.091108    2578 projected.go:196] Error preparing data for projected volume kube-api-access-skvsn for pod openshift-network-diagnostics/network-check-target-p5sdw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 17:11:18.091238 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:11:18.091149    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fb3341a1-f14e-40be-8591-28a12d33716b-kube-api-access-skvsn podName:fb3341a1-f14e-40be-8591-28a12d33716b nodeName:}" failed. No retries permitted until 2026-07-02 17:11:50.091137287 +0000 UTC m=+65.280839930 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-skvsn" (UniqueName: "kubernetes.io/projected/fb3341a1-f14e-40be-8591-28a12d33716b-kube-api-access-skvsn") pod "network-check-target-p5sdw" (UID: "fb3341a1-f14e-40be-8591-28a12d33716b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 17:11:18.756535 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:18.756505    2578 generic.go:356] "Generic (PLEG): container finished" podID="2d56f816-270b-4962-b1f0-2e5b8acdb3ce" containerID="4b28f7a7302e95a61f3884e40f791776ff3cf11ec4d8ba1fcc7d1189d041c66b" exitCode=0
Jul 02 17:11:18.756992 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:18.756564    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-87dbx" event={"ID":"2d56f816-270b-4962-b1f0-2e5b8acdb3ce","Type":"ContainerDied","Data":"4b28f7a7302e95a61f3884e40f791776ff3cf11ec4d8ba1fcc7d1189d041c66b"}
Jul 02 17:11:19.490709 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:19.490679    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g67j2"
Jul 02 17:11:19.490865 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:19.490679    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cwjw5"
Jul 02 17:11:19.490865 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:11:19.490808    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g67j2" podUID="d1d3526d-01f3-4e77-a78e-ac8954a7a207"
Jul 02 17:11:19.490865 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:19.490679    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p5sdw"
Jul 02 17:11:19.491051 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:11:19.490905    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cwjw5" podUID="5ac2c336-c8a9-484a-83df-60182dc9faf5"
Jul 02 17:11:19.491051 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:11:19.490992    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p5sdw" podUID="fb3341a1-f14e-40be-8591-28a12d33716b"
Jul 02 17:11:20.953166 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:20.953098    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-67.ec2.internal" event="NodeReady"
Jul 02 17:11:20.953617 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:20.953239    2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 02 17:11:20.998155 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:20.998128    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-cfxt6"]
Jul 02 17:11:21.001132 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:21.001115    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cfxt6"
Jul 02 17:11:21.003790 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:21.003772    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 02 17:11:21.003920 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:21.003898    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 02 17:11:21.004046 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:21.003949    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wfcqg\""
Jul 02 17:11:21.005455 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:21.005436    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-tg92m"]
Jul 02 17:11:21.008150 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:21.008132    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-tg92m"
Jul 02 17:11:21.011597 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:21.010759    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 02 17:11:21.011597 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:21.010859    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 02 17:11:21.011597 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:21.010878    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 02 17:11:21.011597 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:21.011337    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-nbjgv\""
Jul 02 17:11:21.012241 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:21.012217    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cfxt6"]
Jul 02 17:11:21.022382 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:21.022319    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-tg92m"]
Jul 02 17:11:21.118186 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:21.118153    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4r4vw\" (UniqueName: \"kubernetes.io/projected/e2ca5a7e-9ab8-4e9d-a2ca-e6df8c93a07c-kube-api-access-4r4vw\") pod \"ingress-canary-tg92m\" (UID: \"e2ca5a7e-9ab8-4e9d-a2ca-e6df8c93a07c\") " pod="openshift-ingress-canary/ingress-canary-tg92m"
Jul 02 17:11:21.118350 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:21.118195    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjjp5\" (UniqueName: \"kubernetes.io/projected/2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9-kube-api-access-sjjp5\") pod \"dns-default-cfxt6\" (UID: \"2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9\") " pod="openshift-dns/dns-default-cfxt6"
Jul 02 17:11:21.118350 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:21.118224    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9-tmp-dir\") pod \"dns-default-cfxt6\" (UID: \"2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9\") " pod="openshift-dns/dns-default-cfxt6"
Jul 02 17:11:21.118350 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:21.118250    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e2ca5a7e-9ab8-4e9d-a2ca-e6df8c93a07c-cert\") pod \"ingress-canary-tg92m\" (UID: \"e2ca5a7e-9ab8-4e9d-a2ca-e6df8c93a07c\") " pod="openshift-ingress-canary/ingress-canary-tg92m"
Jul 02 17:11:21.118350 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:21.118333    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9-config-volume\") pod \"dns-default-cfxt6\" (UID: \"2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9\") " pod="openshift-dns/dns-default-cfxt6"
Jul 02 17:11:21.118510 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:21.118381    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9-metrics-tls\") pod \"dns-default-cfxt6\" (UID: \"2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9\") " pod="openshift-dns/dns-default-cfxt6"
Jul 02 17:11:21.219356 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:21.219279    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjjp5\" (UniqueName: \"kubernetes.io/projected/2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9-kube-api-access-sjjp5\") pod \"dns-default-cfxt6\" (UID: \"2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9\") " pod="openshift-dns/dns-default-cfxt6"
Jul 02 17:11:21.219356 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:21.219314    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9-tmp-dir\") pod \"dns-default-cfxt6\" (UID: \"2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9\") " pod="openshift-dns/dns-default-cfxt6"
Jul 02 17:11:21.219356 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:21.219339    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e2ca5a7e-9ab8-4e9d-a2ca-e6df8c93a07c-cert\") pod \"ingress-canary-tg92m\" (UID: \"e2ca5a7e-9ab8-4e9d-a2ca-e6df8c93a07c\") " pod="openshift-ingress-canary/ingress-canary-tg92m"
Jul 02 17:11:21.219606 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:21.219388    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9-config-volume\") pod \"dns-default-cfxt6\" (UID: \"2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9\") " pod="openshift-dns/dns-default-cfxt6"
Jul 02 17:11:21.219606 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:21.219426    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9-metrics-tls\") pod \"dns-default-cfxt6\" (UID: \"2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9\") " pod="openshift-dns/dns-default-cfxt6"
Jul 02 17:11:21.219606 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:21.219498    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4r4vw\" (UniqueName: \"kubernetes.io/projected/e2ca5a7e-9ab8-4e9d-a2ca-e6df8c93a07c-kube-api-access-4r4vw\") pod \"ingress-canary-tg92m\" (UID: \"e2ca5a7e-9ab8-4e9d-a2ca-e6df8c93a07c\") " pod="openshift-ingress-canary/ingress-canary-tg92m"
Jul 02 17:11:21.219961 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:11:21.219938    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 17:11:21.220103 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:11:21.220010    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9-metrics-tls podName:2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9 nodeName:}" failed. No retries permitted until 2026-07-02 17:11:21.719990002 +0000 UTC m=+36.909692648 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9-metrics-tls") pod "dns-default-cfxt6" (UID: "2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9") : secret "dns-default-metrics-tls" not found
Jul 02 17:11:21.220103 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:21.219940    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9-tmp-dir\") pod \"dns-default-cfxt6\" (UID: \"2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9\") " pod="openshift-dns/dns-default-cfxt6"
Jul 02 17:11:21.220342 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:21.220323    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9-config-volume\") pod \"dns-default-cfxt6\" (UID: \"2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9\") " pod="openshift-dns/dns-default-cfxt6"
Jul 02 17:11:21.224347 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:21.224323    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e2ca5a7e-9ab8-4e9d-a2ca-e6df8c93a07c-cert\") pod \"ingress-canary-tg92m\" (UID: \"e2ca5a7e-9ab8-4e9d-a2ca-e6df8c93a07c\") " pod="openshift-ingress-canary/ingress-canary-tg92m"
Jul 02 17:11:21.230758 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:21.230731    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjjp5\" (UniqueName: \"kubernetes.io/projected/2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9-kube-api-access-sjjp5\") pod \"dns-default-cfxt6\" (UID: \"2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9\") " pod="openshift-dns/dns-default-cfxt6"
Jul 02 17:11:21.231146 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:21.231130    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4r4vw\" (UniqueName: \"kubernetes.io/projected/e2ca5a7e-9ab8-4e9d-a2ca-e6df8c93a07c-kube-api-access-4r4vw\") pod \"ingress-canary-tg92m\" (UID: \"e2ca5a7e-9ab8-4e9d-a2ca-e6df8c93a07c\") " pod="openshift-ingress-canary/ingress-canary-tg92m"
Jul 02 17:11:21.319102 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:21.319065    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-tg92m"
Jul 02 17:11:21.490828 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:21.490789    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cwjw5"
Jul 02 17:11:21.490828 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:21.490826    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p5sdw"
Jul 02 17:11:21.491120 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:21.490789    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g67j2"
Jul 02 17:11:21.494159 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:21.494138    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 02 17:11:21.494278 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:21.494258    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 02 17:11:21.494347 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:21.494277    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 02 17:11:21.494347 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:21.494297    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 02 17:11:21.494443 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:21.494362    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vg44r\""
Jul 02 17:11:21.494595 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:21.494568    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dk9fp\""
Jul 02 17:11:21.723289 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:21.723247    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9-metrics-tls\") pod \"dns-default-cfxt6\" (UID: \"2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9\") " pod="openshift-dns/dns-default-cfxt6"
Jul 02 17:11:21.723471 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:11:21.723416    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 17:11:21.723527 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:11:21.723509    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9-metrics-tls podName:2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9 nodeName:}" failed. No retries permitted until 2026-07-02 17:11:22.723492517 +0000 UTC m=+37.913195173 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9-metrics-tls") pod "dns-default-cfxt6" (UID: "2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9") : secret "dns-default-metrics-tls" not found
Jul 02 17:11:22.679863 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:22.679831    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-tg92m"]
Jul 02 17:11:22.729737 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:22.729704    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9-metrics-tls\") pod \"dns-default-cfxt6\" (UID: \"2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9\") " pod="openshift-dns/dns-default-cfxt6"
Jul 02 17:11:22.729885 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:11:22.729869    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 17:11:22.729945 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:11:22.729935    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9-metrics-tls podName:2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9 nodeName:}" failed. No retries permitted until 2026-07-02 17:11:24.729919514 +0000 UTC m=+39.919622153 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9-metrics-tls") pod "dns-default-cfxt6" (UID: "2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9") : secret "dns-default-metrics-tls" not found
Jul 02 17:11:22.769997 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:11:22.769967    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2ca5a7e_9ab8_4e9d_a2ca_e6df8c93a07c.slice/crio-aa471229862609a226deeebc71d73329d92d3f63e777e96c328966afcf462d5e WatchSource:0}: Error finding container aa471229862609a226deeebc71d73329d92d3f63e777e96c328966afcf462d5e: Status 404 returned error can't find the container with id aa471229862609a226deeebc71d73329d92d3f63e777e96c328966afcf462d5e
Jul 02 17:11:23.774572 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:23.774331    2578 generic.go:356] "Generic (PLEG): container finished" podID="2d56f816-270b-4962-b1f0-2e5b8acdb3ce" containerID="09daf6798faf4b502567d897a40555b642d3fd1ca655d74ba81b671333140397" exitCode=0
Jul 02 17:11:23.775036 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:23.774410    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-87dbx" event={"ID":"2d56f816-270b-4962-b1f0-2e5b8acdb3ce","Type":"ContainerDied","Data":"09daf6798faf4b502567d897a40555b642d3fd1ca655d74ba81b671333140397"}
Jul 02 17:11:23.776033 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:23.775992    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-tg92m" event={"ID":"e2ca5a7e-9ab8-4e9d-a2ca-e6df8c93a07c","Type":"ContainerStarted","Data":"aa471229862609a226deeebc71d73329d92d3f63e777e96c328966afcf462d5e"}
Jul 02 17:11:23.883989 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:23.883929    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:11:23.985032 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:23.984986    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:11:24.428035 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:24.427981    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:11:24.528895 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:24.528848    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:11:24.746874 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:24.746841    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9-metrics-tls\") pod \"dns-default-cfxt6\" (UID: \"2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9\") " pod="openshift-dns/dns-default-cfxt6"
Jul 02 17:11:24.747071 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:11:24.746971    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 17:11:24.747071 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:11:24.747053    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9-metrics-tls podName:2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9 nodeName:}" failed. No retries permitted until 2026-07-02 17:11:28.747033327 +0000 UTC m=+43.936735991 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9-metrics-tls") pod "dns-default-cfxt6" (UID: "2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9") : secret "dns-default-metrics-tls" not found
Jul 02 17:11:24.782210 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:24.782177    2578 generic.go:356] "Generic (PLEG): container finished" podID="2d56f816-270b-4962-b1f0-2e5b8acdb3ce" containerID="211f20ecabfcf257608bf26d4cb835c1ff085710c7ca207ffc2441f84441d071" exitCode=0
Jul 02 17:11:24.782643 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:24.782223    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-87dbx" event={"ID":"2d56f816-270b-4962-b1f0-2e5b8acdb3ce","Type":"ContainerDied","Data":"211f20ecabfcf257608bf26d4cb835c1ff085710c7ca207ffc2441f84441d071"}
Jul 02 17:11:24.962485 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:24.962405    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:11:25.062539 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:25.062455    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:11:25.786385 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:25.786350    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-tg92m" event={"ID":"e2ca5a7e-9ab8-4e9d-a2ca-e6df8c93a07c","Type":"ContainerStarted","Data":"5978d00764798e044094b58208d3d74cc4037475e55248d9a76063c5a4d86647"}
Jul 02 17:11:25.789672 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:25.789646    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-87dbx" event={"ID":"2d56f816-270b-4962-b1f0-2e5b8acdb3ce","Type":"ContainerStarted","Data":"2bad555b1e7ecc560d6282e78596542f3b6e80478d50044e373dc4daf50d6734"}
Jul 02 17:11:25.805357 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:25.805313    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-tg92m" podStartSLOduration=3.168043607 podStartE2EDuration="5.805296861s" totalImagesPullingTime="2.637253254s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:11:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:11:25.805039486 +0000 UTC m=+40.994742152" watchObservedRunningTime="2026-07-02 17:11:25.805296861 +0000 UTC m=+40.994999524"
Jul 02 17:11:25.828532 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:25.828485    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-87dbx" podStartSLOduration=8.211554985 podStartE2EDuration="40.828471038s" totalImagesPullingTime="32.616916053s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 17:10:45 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:11:25.827940877 +0000 UTC m=+41.017643536" watchObservedRunningTime="2026-07-02 17:11:25.828471038 +0000 UTC m=+41.018173699"
Jul 02 17:11:25.948849 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:25.948811    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:11:26.049295 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:26.049221    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:11:28.770487 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:28.770451    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9-metrics-tls\") pod \"dns-default-cfxt6\" (UID: \"2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9\") " pod="openshift-dns/dns-default-cfxt6"
Jul 02 17:11:28.770895 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:11:28.770566    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 17:11:28.770895 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:11:28.770617    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9-metrics-tls podName:2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9 nodeName:}" failed. No retries permitted until 2026-07-02 17:11:36.770603242 +0000 UTC m=+51.960305882 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9-metrics-tls") pod "dns-default-cfxt6" (UID: "2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9") : secret "dns-default-metrics-tls" not found
Jul 02 17:11:34.934461 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:34.934412    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:11:35.002200 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:35.002174    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:11:36.823887 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:36.823852    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9-metrics-tls\") pod \"dns-default-cfxt6\" (UID: \"2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9\") " pod="openshift-dns/dns-default-cfxt6"
Jul 02 17:11:36.824356 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:11:36.823966    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 17:11:36.824356 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:11:36.824012    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9-metrics-tls podName:2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9 nodeName:}" failed. No retries permitted until 2026-07-02 17:11:52.824000353 +0000 UTC m=+68.013702993 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9-metrics-tls") pod "dns-default-cfxt6" (UID: "2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9") : secret "dns-default-metrics-tls" not found
Jul 02 17:11:39.507130 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:39.507096    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59948b9d98-xlbss"]
Jul 02 17:11:39.521885 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:39.521862    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59948b9d98-xlbss"]
Jul 02 17:11:39.522050 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:39.521945    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59948b9d98-xlbss"
Jul 02 17:11:39.525738 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:39.525719    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 02 17:11:39.527338 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:39.527316    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 02 17:11:39.527447 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:39.527372    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-sxhph\""
Jul 02 17:11:39.527447 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:39.527425    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 02 17:11:39.527537 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:39.527452    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 02 17:11:39.543516 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:39.543491    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/28f6fd07-b48d-428c-8ff7-0ca6eb257587-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-59948b9d98-xlbss\" (UID: \"28f6fd07-b48d-428c-8ff7-0ca6eb257587\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59948b9d98-xlbss"
Jul 02 17:11:39.543621 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:39.543533    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flf6d\" (UniqueName: \"kubernetes.io/projected/28f6fd07-b48d-428c-8ff7-0ca6eb257587-kube-api-access-flf6d\") pod \"managed-serviceaccount-addon-agent-59948b9d98-xlbss\" (UID: \"28f6fd07-b48d-428c-8ff7-0ca6eb257587\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59948b9d98-xlbss"
Jul 02 17:11:39.644504 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:39.644479    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/28f6fd07-b48d-428c-8ff7-0ca6eb257587-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-59948b9d98-xlbss\" (UID: \"28f6fd07-b48d-428c-8ff7-0ca6eb257587\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59948b9d98-xlbss"
Jul 02 17:11:39.644600 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:39.644521    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flf6d\" (UniqueName: \"kubernetes.io/projected/28f6fd07-b48d-428c-8ff7-0ca6eb257587-kube-api-access-flf6d\") pod \"managed-serviceaccount-addon-agent-59948b9d98-xlbss\" (UID: \"28f6fd07-b48d-428c-8ff7-0ca6eb257587\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59948b9d98-xlbss"
Jul 02 17:11:39.647882 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:39.647862    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/28f6fd07-b48d-428c-8ff7-0ca6eb257587-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-59948b9d98-xlbss\" (UID: \"28f6fd07-b48d-428c-8ff7-0ca6eb257587\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59948b9d98-xlbss"
Jul 02 17:11:39.653815 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:39.653785    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-flf6d\" (UniqueName: \"kubernetes.io/projected/28f6fd07-b48d-428c-8ff7-0ca6eb257587-kube-api-access-flf6d\") pod \"managed-serviceaccount-addon-agent-59948b9d98-xlbss\" (UID: \"28f6fd07-b48d-428c-8ff7-0ca6eb257587\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59948b9d98-xlbss"
Jul 02 17:11:39.839826 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:39.839781    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59948b9d98-xlbss"
Jul 02 17:11:39.991642 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:39.991586    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59948b9d98-xlbss"]
Jul 02 17:11:39.994901 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:11:39.994870    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod28f6fd07_b48d_428c_8ff7_0ca6eb257587.slice/crio-989f2e0a614150276162f8d9263ad62eb8663321475778c8368dcd0748767382 WatchSource:0}: Error finding container 989f2e0a614150276162f8d9263ad62eb8663321475778c8368dcd0748767382: Status 404 returned error can't find the container with id 989f2e0a614150276162f8d9263ad62eb8663321475778c8368dcd0748767382
Jul 02 17:11:40.825602 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:40.825565    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59948b9d98-xlbss" event={"ID":"28f6fd07-b48d-428c-8ff7-0ca6eb257587","Type":"ContainerStarted","Data":"989f2e0a614150276162f8d9263ad62eb8663321475778c8368dcd0748767382"}
Jul 02 17:11:42.831172 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:42.831079    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59948b9d98-xlbss" event={"ID":"28f6fd07-b48d-428c-8ff7-0ca6eb257587","Type":"ContainerStarted","Data":"84916d15e63dceaed62da3c1f727548292b84dd0a24729444633d8f7369825f1"}
Jul 02 17:11:42.848779 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:42.848730    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59948b9d98-xlbss" podStartSLOduration=1.302969722 podStartE2EDuration="3.848714633s" totalImagesPullingTime="2.545744911s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:11:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:11:42.848090431 +0000 UTC m=+58.037793094" watchObservedRunningTime="2026-07-02 17:11:42.848714633 +0000 UTC m=+58.038417296"
Jul 02 17:11:45.754351 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:45.754325    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-62g9m"
Jul 02 17:11:45.917797 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:45.917767    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:11:46.017860 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:46.017770    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:11:46.844859 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:46.844824    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:11:46.910546 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:46.910513    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:11:50.016029 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:50.015971    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ac2c336-c8a9-484a-83df-60182dc9faf5-original-pull-secret\") pod \"global-pull-secret-syncer-cwjw5\" (UID: \"5ac2c336-c8a9-484a-83df-60182dc9faf5\") " pod="kube-system/global-pull-secret-syncer-cwjw5"
Jul 02 17:11:50.016515 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:50.016057    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1d3526d-01f3-4e77-a78e-ac8954a7a207-metrics-certs\") pod \"network-metrics-daemon-g67j2\" (UID: \"d1d3526d-01f3-4e77-a78e-ac8954a7a207\") " pod="openshift-multus/network-metrics-daemon-g67j2"
Jul 02 17:11:50.019051 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:50.019008    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 02 17:11:50.019101 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:50.019080    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 02 17:11:50.026383 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:11:50.026363    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 02 17:11:50.026502 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:11:50.026432    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1d3526d-01f3-4e77-a78e-ac8954a7a207-metrics-certs podName:d1d3526d-01f3-4e77-a78e-ac8954a7a207 nodeName:}" failed. No retries permitted until 2026-07-02 17:12:54.026411486 +0000 UTC m=+129.216114140 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d1d3526d-01f3-4e77-a78e-ac8954a7a207-metrics-certs") pod "network-metrics-daemon-g67j2" (UID: "d1d3526d-01f3-4e77-a78e-ac8954a7a207") : secret "metrics-daemon-secret" not found
Jul 02 17:11:50.028431 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:50.028408    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ac2c336-c8a9-484a-83df-60182dc9faf5-original-pull-secret\") pod \"global-pull-secret-syncer-cwjw5\" (UID: \"5ac2c336-c8a9-484a-83df-60182dc9faf5\") " pod="kube-system/global-pull-secret-syncer-cwjw5"
Jul 02 17:11:50.117067 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:50.117038    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skvsn\" (UniqueName: \"kubernetes.io/projected/fb3341a1-f14e-40be-8591-28a12d33716b-kube-api-access-skvsn\") pod \"network-check-target-p5sdw\" (UID: \"fb3341a1-f14e-40be-8591-28a12d33716b\") " pod="openshift-network-diagnostics/network-check-target-p5sdw"
Jul 02 17:11:50.120170 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:50.120155    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 02 17:11:50.129756 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:50.129737    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 02 17:11:50.140271 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:50.140245    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-skvsn\" (UniqueName: \"kubernetes.io/projected/fb3341a1-f14e-40be-8591-28a12d33716b-kube-api-access-skvsn\") pod \"network-check-target-p5sdw\" (UID: \"fb3341a1-f14e-40be-8591-28a12d33716b\") " pod="openshift-network-diagnostics/network-check-target-p5sdw"
Jul 02 17:11:50.207148 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:50.207109    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:11:50.278479 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:50.278409    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:11:50.304417 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:50.304401    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cwjw5"
Jul 02 17:11:50.320876 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:50.320859    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dk9fp\""
Jul 02 17:11:50.328225 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:50.328208    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p5sdw"
Jul 02 17:11:50.432535 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:50.432508    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cwjw5"]
Jul 02 17:11:50.451418 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:50.451393    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-p5sdw"]
Jul 02 17:11:50.453633 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:11:50.453609    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb3341a1_f14e_40be_8591_28a12d33716b.slice/crio-24a309f2e7eeb229b3b9e0c721c4521eec28235eabeff0d87f0703c7acd05c33 WatchSource:0}: Error finding container 24a309f2e7eeb229b3b9e0c721c4521eec28235eabeff0d87f0703c7acd05c33: Status 404 returned error can't find the container with id 24a309f2e7eeb229b3b9e0c721c4521eec28235eabeff0d87f0703c7acd05c33
Jul 02 17:11:50.850805 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:50.850768    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cwjw5" event={"ID":"5ac2c336-c8a9-484a-83df-60182dc9faf5","Type":"ContainerStarted","Data":"66437e78d667d9555fdaf390304083c3ace65e4cc747086c44e7f31a33710b2b"}
Jul 02 17:11:50.852069 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:50.852037    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-p5sdw" event={"ID":"fb3341a1-f14e-40be-8591-28a12d33716b","Type":"ContainerStarted","Data":"24a309f2e7eeb229b3b9e0c721c4521eec28235eabeff0d87f0703c7acd05c33"}
Jul 02 17:11:52.837564 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:52.837528    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9-metrics-tls\") pod \"dns-default-cfxt6\" (UID: \"2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9\") " pod="openshift-dns/dns-default-cfxt6"
Jul 02 17:11:52.838010 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:11:52.837689    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 17:11:52.838010 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:11:52.837753    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9-metrics-tls podName:2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9 nodeName:}" failed. No retries permitted until 2026-07-02 17:12:24.837733428 +0000 UTC m=+100.027436084 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9-metrics-tls") pod "dns-default-cfxt6" (UID: "2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9") : secret "dns-default-metrics-tls" not found
Jul 02 17:11:53.862771 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:53.862692    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-p5sdw" event={"ID":"fb3341a1-f14e-40be-8591-28a12d33716b","Type":"ContainerStarted","Data":"c32684a940aa81a6280203d30c6b909fc814c0da1a19c04e2e283c5b1eb6fa03"}
Jul 02 17:11:53.863176 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:53.862820    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-p5sdw"
Jul 02 17:11:53.879269 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:53.879217    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-p5sdw" podStartSLOduration=65.788928205 podStartE2EDuration="1m8.879200822s" totalImagesPullingTime="3.090272617s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:10:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:11:53.878254627 +0000 UTC m=+69.067957289" watchObservedRunningTime="2026-07-02 17:11:53.879200822 +0000 UTC m=+69.068903485"
Jul 02 17:11:55.868677 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:55.868601    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cwjw5" event={"ID":"5ac2c336-c8a9-484a-83df-60182dc9faf5","Type":"ContainerStarted","Data":"7f1b31ec9c70e76cf9514c2f85bdd5ba5789b6403945b4ff905f23513016f9e0"}
Jul 02 17:11:55.891330 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:11:55.891286    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-cwjw5" podStartSLOduration=65.789380462 podStartE2EDuration="1m10.8912707s" totalImagesPullingTime="5.101890238s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 17:10:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:11:55.891135191 +0000 UTC m=+71.080837853" watchObservedRunningTime="2026-07-02 17:11:55.8912707 +0000 UTC m=+71.080973362"
Jul 02 17:12:12.377787 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:12:12.377669    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:12:12.478356 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:12:12.478318    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:12:24.852194 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:12:24.852158    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9-metrics-tls\") pod \"dns-default-cfxt6\" (UID: \"2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9\") " pod="openshift-dns/dns-default-cfxt6"
Jul 02 17:12:24.852550 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:12:24.852276    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 17:12:24.852550 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:12:24.852340    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9-metrics-tls podName:2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9 nodeName:}" failed. No retries permitted until 2026-07-02 17:13:28.852325019 +0000 UTC m=+164.042027658 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9-metrics-tls") pod "dns-default-cfxt6" (UID: "2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9") : secret "dns-default-metrics-tls" not found
Jul 02 17:12:24.867750 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:12:24.867728    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-p5sdw"
Jul 02 17:12:41.212059 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:12:41.211937    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:12:54.046800 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:12:54.046762    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1d3526d-01f3-4e77-a78e-ac8954a7a207-metrics-certs\") pod \"network-metrics-daemon-g67j2\" (UID: \"d1d3526d-01f3-4e77-a78e-ac8954a7a207\") " pod="openshift-multus/network-metrics-daemon-g67j2"
Jul 02 17:12:54.047297 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:12:54.046878    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 02 17:12:54.047297 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:12:54.046938    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1d3526d-01f3-4e77-a78e-ac8954a7a207-metrics-certs podName:d1d3526d-01f3-4e77-a78e-ac8954a7a207 nodeName:}" failed. No retries permitted until 2026-07-02 17:14:56.046923089 +0000 UTC m=+251.236625729 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d1d3526d-01f3-4e77-a78e-ac8954a7a207-metrics-certs") pod "network-metrics-daemon-g67j2" (UID: "d1d3526d-01f3-4e77-a78e-ac8954a7a207") : secret "metrics-daemon-secret" not found
Jul 02 17:13:24.012509 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:13:24.012457    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-cfxt6" podUID="2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9"
Jul 02 17:13:24.073615 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:13:24.073568    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cfxt6"
Jul 02 17:13:24.511509 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:13:24.511473    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-g67j2" podUID="d1d3526d-01f3-4e77-a78e-ac8954a7a207"
Jul 02 17:13:28.872495 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:13:28.872456    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9-metrics-tls\") pod \"dns-default-cfxt6\" (UID: \"2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9\") " pod="openshift-dns/dns-default-cfxt6"
Jul 02 17:13:28.872944 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:13:28.872603    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 17:13:28.872944 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:13:28.872679    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9-metrics-tls podName:2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9 nodeName:}" failed. No retries permitted until 2026-07-02 17:15:30.872660467 +0000 UTC m=+286.062363107 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9-metrics-tls") pod "dns-default-cfxt6" (UID: "2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9") : secret "dns-default-metrics-tls" not found
Jul 02 17:13:38.490787 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:13:38.490698    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g67j2"
Jul 02 17:13:43.116589 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:13:43.116555    2578 generic.go:356] "Generic (PLEG): container finished" podID="28f6fd07-b48d-428c-8ff7-0ca6eb257587" containerID="84916d15e63dceaed62da3c1f727548292b84dd0a24729444633d8f7369825f1" exitCode=255
Jul 02 17:13:43.116938 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:13:43.116627    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59948b9d98-xlbss" event={"ID":"28f6fd07-b48d-428c-8ff7-0ca6eb257587","Type":"ContainerDied","Data":"84916d15e63dceaed62da3c1f727548292b84dd0a24729444633d8f7369825f1"}
Jul 02 17:13:43.122184 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:13:43.122167    2578 scope.go:117] "RemoveContainer" containerID="84916d15e63dceaed62da3c1f727548292b84dd0a24729444633d8f7369825f1"
Jul 02 17:13:44.123733 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:13:44.123695    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59948b9d98-xlbss" event={"ID":"28f6fd07-b48d-428c-8ff7-0ca6eb257587","Type":"ContainerStarted","Data":"d1e202c509cbfbd73280485769e3e70b1125cab9e8000b8368a156c91300589c"}
Jul 02 17:14:13.564955 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:13.564912    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:14:41.702780 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:41.702748    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6b64bb69f7-cvlj6"]
Jul 02 17:14:41.704264 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:41.704247    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b64bb69f7-cvlj6"
Jul 02 17:14:41.707112 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:41.707090    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 02 17:14:41.707414 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:41.707396    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 02 17:14:41.707636 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:41.707620    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-z9h8v\""
Jul 02 17:14:41.707718 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:41.707639    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 02 17:14:41.720686 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:41.720655    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 02 17:14:41.730557 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:41.730535    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6b64bb69f7-cvlj6"]
Jul 02 17:14:41.793657 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:41.793625    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-56499946bc-qrstt"]
Jul 02 17:14:41.795392 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:41.795378    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56499946bc-qrstt"
Jul 02 17:14:41.797132 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:41.797113    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5f67b55555-nz4p7"]
Jul 02 17:14:41.798124 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:41.798106    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-g8ztf\""
Jul 02 17:14:41.798596 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:41.798581    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-d6ppd"]
Jul 02 17:14:41.798705 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:41.798689    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5f67b55555-nz4p7"
Jul 02 17:14:41.800349 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:41.800331    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-d6ppd"
Jul 02 17:14:41.802031 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:41.802002    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 02 17:14:41.802114 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:41.802073    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-7fv4b\""
Jul 02 17:14:41.802638 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:41.802622    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 02 17:14:41.802693 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:41.802621    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 02 17:14:41.803444 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:41.803408    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 02 17:14:41.807087 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:41.807064    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 02 17:14:41.807362 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:41.807341    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 02 17:14:41.807475 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:41.807381    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 02 17:14:41.807612 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:41.807506    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-8pwlf\""
Jul 02 17:14:41.808283 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:41.808267    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56499946bc-qrstt"]
Jul 02 17:14:41.809145 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:41.809127    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 02 17:14:41.816856 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:41.816841    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5f67b55555-nz4p7"]
Jul 02 17:14:41.817603 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:41.817586    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-d6ppd"]
Jul 02 17:14:41.834596 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:41.834575    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/30e7892b-fe20-48ab-adbd-a13b8756a114-bound-sa-token\") pod \"image-registry-6b64bb69f7-cvlj6\" (UID: \"30e7892b-fe20-48ab-adbd-a13b8756a114\") " pod="openshift-image-registry/image-registry-6b64bb69f7-cvlj6"
Jul 02 17:14:41.834674 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:41.834605    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/30e7892b-fe20-48ab-adbd-a13b8756a114-image-registry-private-configuration\") pod \"image-registry-6b64bb69f7-cvlj6\" (UID: \"30e7892b-fe20-48ab-adbd-a13b8756a114\") " pod="openshift-image-registry/image-registry-6b64bb69f7-cvlj6"
Jul 02 17:14:41.834674 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:41.834668    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/30e7892b-fe20-48ab-adbd-a13b8756a114-registry-tls\") pod \"image-registry-6b64bb69f7-cvlj6\" (UID: \"30e7892b-fe20-48ab-adbd-a13b8756a114\") " pod="openshift-image-registry/image-registry-6b64bb69f7-cvlj6"
Jul 02 17:14:41.834745 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:41.834686    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/30e7892b-fe20-48ab-adbd-a13b8756a114-trusted-ca\") pod \"image-registry-6b64bb69f7-cvlj6\" (UID: \"30e7892b-fe20-48ab-adbd-a13b8756a114\") " pod="openshift-image-registry/image-registry-6b64bb69f7-cvlj6"
Jul 02 17:14:41.834745 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:41.834730    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/30e7892b-fe20-48ab-adbd-a13b8756a114-registry-certificates\") pod \"image-registry-6b64bb69f7-cvlj6\" (UID: \"30e7892b-fe20-48ab-adbd-a13b8756a114\") " pod="openshift-image-registry/image-registry-6b64bb69f7-cvlj6"
Jul 02 17:14:41.834808 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:41.834756    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/30e7892b-fe20-48ab-adbd-a13b8756a114-ca-trust-extracted\") pod \"image-registry-6b64bb69f7-cvlj6\" (UID: \"30e7892b-fe20-48ab-adbd-a13b8756a114\") " pod="openshift-image-registry/image-registry-6b64bb69f7-cvlj6"
Jul 02 17:14:41.834808 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:41.834781    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/30e7892b-fe20-48ab-adbd-a13b8756a114-installation-pull-secrets\") pod \"image-registry-6b64bb69f7-cvlj6\" (UID: \"30e7892b-fe20-48ab-adbd-a13b8756a114\") " pod="openshift-image-registry/image-registry-6b64bb69f7-cvlj6"
Jul 02 17:14:41.834808 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:41.834799    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bt4b\" (UniqueName: \"kubernetes.io/projected/30e7892b-fe20-48ab-adbd-a13b8756a114-kube-api-access-2bt4b\") pod \"image-registry-6b64bb69f7-cvlj6\" (UID: \"30e7892b-fe20-48ab-adbd-a13b8756a114\") " pod="openshift-image-registry/image-registry-6b64bb69f7-cvlj6"
Jul 02 17:14:41.935304 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:41.935284    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/30e7892b-fe20-48ab-adbd-a13b8756a114-bound-sa-token\") pod \"image-registry-6b64bb69f7-cvlj6\" (UID: \"30e7892b-fe20-48ab-adbd-a13b8756a114\") " pod="openshift-image-registry/image-registry-6b64bb69f7-cvlj6"
Jul 02 17:14:41.935408 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:41.935311    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/30e7892b-fe20-48ab-adbd-a13b8756a114-image-registry-private-configuration\") pod \"image-registry-6b64bb69f7-cvlj6\" (UID: \"30e7892b-fe20-48ab-adbd-a13b8756a114\") " pod="openshift-image-registry/image-registry-6b64bb69f7-cvlj6"
Jul 02 17:14:41.935408 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:41.935340    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/30e7892b-fe20-48ab-adbd-a13b8756a114-registry-tls\") pod \"image-registry-6b64bb69f7-cvlj6\" (UID: \"30e7892b-fe20-48ab-adbd-a13b8756a114\") " pod="openshift-image-registry/image-registry-6b64bb69f7-cvlj6"
Jul 02 17:14:41.935518 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:14:41.935409    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 17:14:41.935518 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:14:41.935419    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b64bb69f7-cvlj6: secret "image-registry-tls" not found
Jul 02 17:14:41.935518 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:41.935458    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/30e7892b-fe20-48ab-adbd-a13b8756a114-trusted-ca\") pod \"image-registry-6b64bb69f7-cvlj6\" (UID: \"30e7892b-fe20-48ab-adbd-a13b8756a114\") " pod="openshift-image-registry/image-registry-6b64bb69f7-cvlj6"
Jul 02 17:14:41.935518 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:14:41.935470    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30e7892b-fe20-48ab-adbd-a13b8756a114-registry-tls podName:30e7892b-fe20-48ab-adbd-a13b8756a114 nodeName:}" failed. No retries permitted until 2026-07-02 17:14:42.435453567 +0000 UTC m=+237.625156229 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/30e7892b-fe20-48ab-adbd-a13b8756a114-registry-tls") pod "image-registry-6b64bb69f7-cvlj6" (UID: "30e7892b-fe20-48ab-adbd-a13b8756a114") : secret "image-registry-tls" not found
Jul 02 17:14:41.935518 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:41.935491    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/30e7892b-fe20-48ab-adbd-a13b8756a114-registry-certificates\") pod \"image-registry-6b64bb69f7-cvlj6\" (UID: \"30e7892b-fe20-48ab-adbd-a13b8756a114\") " pod="openshift-image-registry/image-registry-6b64bb69f7-cvlj6"
Jul 02 17:14:41.935518 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:41.935510    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/30e7892b-fe20-48ab-adbd-a13b8756a114-ca-trust-extracted\") pod \"image-registry-6b64bb69f7-cvlj6\" (UID: \"30e7892b-fe20-48ab-adbd-a13b8756a114\") " pod="openshift-image-registry/image-registry-6b64bb69f7-cvlj6"
Jul 02 17:14:41.935814 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:41.935539    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/30e7892b-fe20-48ab-adbd-a13b8756a114-installation-pull-secrets\") pod \"image-registry-6b64bb69f7-cvlj6\" (UID: \"30e7892b-fe20-48ab-adbd-a13b8756a114\") " pod="openshift-image-registry/image-registry-6b64bb69f7-cvlj6"
Jul 02 17:14:41.935814 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:41.935572    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5180569c-246f-44b6-a676-52300031785d-service-ca-bundle\") pod \"insights-operator-5f67b55555-nz4p7\" (UID: \"5180569c-246f-44b6-a676-52300031785d\") " pod="openshift-insights/insights-operator-5f67b55555-nz4p7"
Jul 02 17:14:41.935814 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:41.935604    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwxwq\" (UniqueName: \"kubernetes.io/projected/5180569c-246f-44b6-a676-52300031785d-kube-api-access-lwxwq\") pod \"insights-operator-5f67b55555-nz4p7\" (UID: \"5180569c-246f-44b6-a676-52300031785d\") " pod="openshift-insights/insights-operator-5f67b55555-nz4p7"
Jul 02 17:14:41.935814 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:41.935638    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bt4b\" (UniqueName: \"kubernetes.io/projected/30e7892b-fe20-48ab-adbd-a13b8756a114-kube-api-access-2bt4b\") pod \"image-registry-6b64bb69f7-cvlj6\" (UID: \"30e7892b-fe20-48ab-adbd-a13b8756a114\") " pod="openshift-image-registry/image-registry-6b64bb69f7-cvlj6"
Jul 02 17:14:41.935814 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:41.935668    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5180569c-246f-44b6-a676-52300031785d-trusted-ca-bundle\") pod \"insights-operator-5f67b55555-nz4p7\" (UID: \"5180569c-246f-44b6-a676-52300031785d\") " pod="openshift-insights/insights-operator-5f67b55555-nz4p7"
Jul 02 17:14:41.935814 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:41.935697    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/bd155b1c-0eb2-4271-974c-f8804ba77251-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-d6ppd\" (UID: \"bd155b1c-0eb2-4271-974c-f8804ba77251\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-d6ppd"
Jul 02 17:14:41.935814 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:41.935730    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5180569c-246f-44b6-a676-52300031785d-snapshots\") pod \"insights-operator-5f67b55555-nz4p7\" (UID: \"5180569c-246f-44b6-a676-52300031785d\") " pod="openshift-insights/insights-operator-5f67b55555-nz4p7"
Jul 02 17:14:41.935814 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:41.935757    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5180569c-246f-44b6-a676-52300031785d-serving-cert\") pod \"insights-operator-5f67b55555-nz4p7\" (UID: \"5180569c-246f-44b6-a676-52300031785d\") " pod="openshift-insights/insights-operator-5f67b55555-nz4p7"
Jul 02 17:14:41.935814 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:41.935790    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5180569c-246f-44b6-a676-52300031785d-tmp\") pod \"insights-operator-5f67b55555-nz4p7\" (UID: \"5180569c-246f-44b6-a676-52300031785d\") " pod="openshift-insights/insights-operator-5f67b55555-nz4p7"
Jul 02 17:14:41.936264 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:41.935825    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwr7t\" (UniqueName: \"kubernetes.io/projected/f190d5fc-b5a2-4a11-a9c3-a04aa71c7ba4-kube-api-access-lwr7t\") pod \"network-check-source-56499946bc-qrstt\" (UID: \"f190d5fc-b5a2-4a11-a9c3-a04aa71c7ba4\") " pod="openshift-network-diagnostics/network-check-source-56499946bc-qrstt"
Jul 02 17:14:41.936264 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:41.935854    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdsqs\" (UniqueName: \"kubernetes.io/projected/bd155b1c-0eb2-4271-974c-f8804ba77251-kube-api-access-gdsqs\") pod \"cluster-samples-operator-9ddc5ff76-d6ppd\" (UID: \"bd155b1c-0eb2-4271-974c-f8804ba77251\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-d6ppd"
Jul 02 17:14:41.936264 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:41.936083    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/30e7892b-fe20-48ab-adbd-a13b8756a114-ca-trust-extracted\") pod \"image-registry-6b64bb69f7-cvlj6\" (UID: \"30e7892b-fe20-48ab-adbd-a13b8756a114\") " pod="openshift-image-registry/image-registry-6b64bb69f7-cvlj6"
Jul 02 17:14:41.936264 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:41.936178    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/30e7892b-fe20-48ab-adbd-a13b8756a114-registry-certificates\") pod \"image-registry-6b64bb69f7-cvlj6\" (UID: \"30e7892b-fe20-48ab-adbd-a13b8756a114\") " pod="openshift-image-registry/image-registry-6b64bb69f7-cvlj6"
Jul 02 17:14:41.936756 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:41.936736    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/30e7892b-fe20-48ab-adbd-a13b8756a114-trusted-ca\") pod \"image-registry-6b64bb69f7-cvlj6\" (UID: \"30e7892b-fe20-48ab-adbd-a13b8756a114\") " pod="openshift-image-registry/image-registry-6b64bb69f7-cvlj6"
Jul 02 17:14:41.937847 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:41.937828    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/30e7892b-fe20-48ab-adbd-a13b8756a114-image-registry-private-configuration\") pod \"image-registry-6b64bb69f7-cvlj6\" (UID: \"30e7892b-fe20-48ab-adbd-a13b8756a114\") " pod="openshift-image-registry/image-registry-6b64bb69f7-cvlj6"
Jul 02 17:14:41.937931 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:41.937913    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/30e7892b-fe20-48ab-adbd-a13b8756a114-installation-pull-secrets\") pod \"image-registry-6b64bb69f7-cvlj6\" (UID: \"30e7892b-fe20-48ab-adbd-a13b8756a114\") " pod="openshift-image-registry/image-registry-6b64bb69f7-cvlj6"
Jul 02 17:14:41.943995 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:41.943976    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/30e7892b-fe20-48ab-adbd-a13b8756a114-bound-sa-token\") pod \"image-registry-6b64bb69f7-cvlj6\" (UID: \"30e7892b-fe20-48ab-adbd-a13b8756a114\") " pod="openshift-image-registry/image-registry-6b64bb69f7-cvlj6"
Jul 02 17:14:41.944148 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:41.944133    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bt4b\" (UniqueName: \"kubernetes.io/projected/30e7892b-fe20-48ab-adbd-a13b8756a114-kube-api-access-2bt4b\") pod \"image-registry-6b64bb69f7-cvlj6\" (UID: \"30e7892b-fe20-48ab-adbd-a13b8756a114\") " pod="openshift-image-registry/image-registry-6b64bb69f7-cvlj6"
Jul 02 17:14:42.010884 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:42.010861    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:14:42.036893 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:42.036873    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5180569c-246f-44b6-a676-52300031785d-service-ca-bundle\") pod \"insights-operator-5f67b55555-nz4p7\" (UID: \"5180569c-246f-44b6-a676-52300031785d\") " pod="openshift-insights/insights-operator-5f67b55555-nz4p7"
Jul 02 17:14:42.036970 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:42.036898    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwxwq\" (UniqueName: \"kubernetes.io/projected/5180569c-246f-44b6-a676-52300031785d-kube-api-access-lwxwq\") pod \"insights-operator-5f67b55555-nz4p7\" (UID: \"5180569c-246f-44b6-a676-52300031785d\") " pod="openshift-insights/insights-operator-5f67b55555-nz4p7"
Jul 02 17:14:42.036970 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:42.036915    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5180569c-246f-44b6-a676-52300031785d-trusted-ca-bundle\") pod \"insights-operator-5f67b55555-nz4p7\" (UID: \"5180569c-246f-44b6-a676-52300031785d\") " pod="openshift-insights/insights-operator-5f67b55555-nz4p7"
Jul 02 17:14:42.036970 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:42.036931    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/bd155b1c-0eb2-4271-974c-f8804ba77251-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-d6ppd\" (UID: \"bd155b1c-0eb2-4271-974c-f8804ba77251\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-d6ppd"
Jul 02 17:14:42.036970 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:42.036954    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5180569c-246f-44b6-a676-52300031785d-snapshots\") pod \"insights-operator-5f67b55555-nz4p7\" (UID: \"5180569c-246f-44b6-a676-52300031785d\") " pod="openshift-insights/insights-operator-5f67b55555-nz4p7"
Jul 02 17:14:42.036970 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:42.036969    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5180569c-246f-44b6-a676-52300031785d-serving-cert\") pod \"insights-operator-5f67b55555-nz4p7\" (UID: \"5180569c-246f-44b6-a676-52300031785d\") " pod="openshift-insights/insights-operator-5f67b55555-nz4p7"
Jul 02 17:14:42.037256 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:42.036994    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5180569c-246f-44b6-a676-52300031785d-tmp\") pod \"insights-operator-5f67b55555-nz4p7\" (UID: \"5180569c-246f-44b6-a676-52300031785d\") " pod="openshift-insights/insights-operator-5f67b55555-nz4p7"
Jul 02 17:14:42.037256 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:14:42.037041    2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 02 17:14:42.037256 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:42.037106    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwr7t\" (UniqueName: \"kubernetes.io/projected/f190d5fc-b5a2-4a11-a9c3-a04aa71c7ba4-kube-api-access-lwr7t\") pod \"network-check-source-56499946bc-qrstt\" (UID: \"f190d5fc-b5a2-4a11-a9c3-a04aa71c7ba4\") " pod="openshift-network-diagnostics/network-check-source-56499946bc-qrstt"
Jul 02 17:14:42.037256 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:42.037154    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdsqs\" (UniqueName: \"kubernetes.io/projected/bd155b1c-0eb2-4271-974c-f8804ba77251-kube-api-access-gdsqs\") pod \"cluster-samples-operator-9ddc5ff76-d6ppd\" (UID: \"bd155b1c-0eb2-4271-974c-f8804ba77251\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-d6ppd"
Jul 02 17:14:42.037256 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:14:42.037255    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd155b1c-0eb2-4271-974c-f8804ba77251-samples-operator-tls podName:bd155b1c-0eb2-4271-974c-f8804ba77251 nodeName:}" failed. No retries permitted until 2026-07-02 17:14:42.537231858 +0000 UTC m=+237.726934512 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/bd155b1c-0eb2-4271-974c-f8804ba77251-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-d6ppd" (UID: "bd155b1c-0eb2-4271-974c-f8804ba77251") : secret "samples-operator-tls" not found
Jul 02 17:14:42.037570 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:42.037552    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5180569c-246f-44b6-a676-52300031785d-tmp\") pod \"insights-operator-5f67b55555-nz4p7\" (UID: \"5180569c-246f-44b6-a676-52300031785d\") " pod="openshift-insights/insights-operator-5f67b55555-nz4p7"
Jul 02 17:14:42.037655 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:42.037622    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5180569c-246f-44b6-a676-52300031785d-snapshots\") pod \"insights-operator-5f67b55555-nz4p7\" (UID: \"5180569c-246f-44b6-a676-52300031785d\") " pod="openshift-insights/insights-operator-5f67b55555-nz4p7"
Jul 02 17:14:42.037812 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:42.037791    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5180569c-246f-44b6-a676-52300031785d-service-ca-bundle\") pod \"insights-operator-5f67b55555-nz4p7\" (UID: \"5180569c-246f-44b6-a676-52300031785d\") " pod="openshift-insights/insights-operator-5f67b55555-nz4p7"
Jul 02 17:14:42.038286 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:42.038266    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5180569c-246f-44b6-a676-52300031785d-trusted-ca-bundle\") pod \"insights-operator-5f67b55555-nz4p7\" (UID: \"5180569c-246f-44b6-a676-52300031785d\") " pod="openshift-insights/insights-operator-5f67b55555-nz4p7"
Jul 02 17:14:42.039225 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:42.039202    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5180569c-246f-44b6-a676-52300031785d-serving-cert\") pod \"insights-operator-5f67b55555-nz4p7\" (UID: \"5180569c-246f-44b6-a676-52300031785d\") " pod="openshift-insights/insights-operator-5f67b55555-nz4p7"
Jul 02 17:14:42.048710 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:42.048691    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwr7t\" (UniqueName: \"kubernetes.io/projected/f190d5fc-b5a2-4a11-a9c3-a04aa71c7ba4-kube-api-access-lwr7t\") pod \"network-check-source-56499946bc-qrstt\" (UID: \"f190d5fc-b5a2-4a11-a9c3-a04aa71c7ba4\") " pod="openshift-network-diagnostics/network-check-source-56499946bc-qrstt"
Jul 02 17:14:42.049029 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:42.048998    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwxwq\" (UniqueName: \"kubernetes.io/projected/5180569c-246f-44b6-a676-52300031785d-kube-api-access-lwxwq\") pod \"insights-operator-5f67b55555-nz4p7\" (UID: \"5180569c-246f-44b6-a676-52300031785d\") " pod="openshift-insights/insights-operator-5f67b55555-nz4p7"
Jul 02 17:14:42.049128 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:42.049113    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdsqs\" (UniqueName: \"kubernetes.io/projected/bd155b1c-0eb2-4271-974c-f8804ba77251-kube-api-access-gdsqs\") pod \"cluster-samples-operator-9ddc5ff76-d6ppd\" (UID: \"bd155b1c-0eb2-4271-974c-f8804ba77251\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-d6ppd"
Jul 02 17:14:42.107184 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:42.107158    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56499946bc-qrstt"
Jul 02 17:14:42.113415 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:42.113394    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5f67b55555-nz4p7"
Jul 02 17:14:42.231438 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:42.231407    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56499946bc-qrstt"]
Jul 02 17:14:42.235178 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:14:42.235154    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf190d5fc_b5a2_4a11_a9c3_a04aa71c7ba4.slice/crio-b250992a82565595caabd1e5c2a8d3523e3a82c3b39b80f585ab2d566228cf28 WatchSource:0}: Error finding container b250992a82565595caabd1e5c2a8d3523e3a82c3b39b80f585ab2d566228cf28: Status 404 returned error can't find the container with id b250992a82565595caabd1e5c2a8d3523e3a82c3b39b80f585ab2d566228cf28
Jul 02 17:14:42.264582 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:42.264560    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5f67b55555-nz4p7"]
Jul 02 17:14:42.266509 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:14:42.266480    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5180569c_246f_44b6_a676_52300031785d.slice/crio-afeebadb91d1606d2cdd83c63c5cdf60ad3da936b20c43c4b47067292f299b60 WatchSource:0}: Error finding container afeebadb91d1606d2cdd83c63c5cdf60ad3da936b20c43c4b47067292f299b60: Status 404 returned error can't find the container with id afeebadb91d1606d2cdd83c63c5cdf60ad3da936b20c43c4b47067292f299b60
Jul 02 17:14:42.287035 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:42.286991    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56499946bc-qrstt" event={"ID":"f190d5fc-b5a2-4a11-a9c3-a04aa71c7ba4","Type":"ContainerStarted","Data":"cbe7d35459ad1d95e120092c16e3524bd3d33d39daaa07e70a809d1b41d2c0c5"}
Jul 02 17:14:42.287121 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:42.287062    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56499946bc-qrstt" event={"ID":"f190d5fc-b5a2-4a11-a9c3-a04aa71c7ba4","Type":"ContainerStarted","Data":"b250992a82565595caabd1e5c2a8d3523e3a82c3b39b80f585ab2d566228cf28"}
Jul 02 17:14:42.288063 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:42.288043    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-nz4p7" event={"ID":"5180569c-246f-44b6-a676-52300031785d","Type":"ContainerStarted","Data":"afeebadb91d1606d2cdd83c63c5cdf60ad3da936b20c43c4b47067292f299b60"}
Jul 02 17:14:42.307679 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:42.307633    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-56499946bc-qrstt" podStartSLOduration=1.307615913 podStartE2EDuration="1.307615913s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:14:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:14:42.307333278 +0000 UTC m=+237.497035940" watchObservedRunningTime="2026-07-02 17:14:42.307615913 +0000 UTC m=+237.497318575"
Jul 02 17:14:42.439003 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:42.438975    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/30e7892b-fe20-48ab-adbd-a13b8756a114-registry-tls\") pod \"image-registry-6b64bb69f7-cvlj6\" (UID: \"30e7892b-fe20-48ab-adbd-a13b8756a114\") " pod="openshift-image-registry/image-registry-6b64bb69f7-cvlj6"
Jul 02 17:14:42.439145 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:14:42.439095    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 17:14:42.439145 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:14:42.439108    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b64bb69f7-cvlj6: secret "image-registry-tls" not found
Jul 02 17:14:42.439243 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:14:42.439155    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30e7892b-fe20-48ab-adbd-a13b8756a114-registry-tls podName:30e7892b-fe20-48ab-adbd-a13b8756a114 nodeName:}" failed. No retries permitted until 2026-07-02 17:14:43.439139202 +0000 UTC m=+238.628841843 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/30e7892b-fe20-48ab-adbd-a13b8756a114-registry-tls") pod "image-registry-6b64bb69f7-cvlj6" (UID: "30e7892b-fe20-48ab-adbd-a13b8756a114") : secret "image-registry-tls" not found
Jul 02 17:14:42.540096 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:42.540032    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/bd155b1c-0eb2-4271-974c-f8804ba77251-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-d6ppd\" (UID: \"bd155b1c-0eb2-4271-974c-f8804ba77251\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-d6ppd"
Jul 02 17:14:42.540193 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:14:42.540153    2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 02 17:14:42.540247 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:14:42.540206    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd155b1c-0eb2-4271-974c-f8804ba77251-samples-operator-tls podName:bd155b1c-0eb2-4271-974c-f8804ba77251 nodeName:}" failed. No retries permitted until 2026-07-02 17:14:43.540192778 +0000 UTC m=+238.729895421 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/bd155b1c-0eb2-4271-974c-f8804ba77251-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-d6ppd" (UID: "bd155b1c-0eb2-4271-974c-f8804ba77251") : secret "samples-operator-tls" not found
Jul 02 17:14:43.140371 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:43.140311    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:14:43.449123 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:43.449039    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/30e7892b-fe20-48ab-adbd-a13b8756a114-registry-tls\") pod \"image-registry-6b64bb69f7-cvlj6\" (UID: \"30e7892b-fe20-48ab-adbd-a13b8756a114\") " pod="openshift-image-registry/image-registry-6b64bb69f7-cvlj6"
Jul 02 17:14:43.449287 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:14:43.449168    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 17:14:43.449287 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:14:43.449182    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b64bb69f7-cvlj6: secret "image-registry-tls" not found
Jul 02 17:14:43.449287 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:14:43.449238    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30e7892b-fe20-48ab-adbd-a13b8756a114-registry-tls podName:30e7892b-fe20-48ab-adbd-a13b8756a114 nodeName:}" failed. No retries permitted until 2026-07-02 17:14:45.449219798 +0000 UTC m=+240.638922438 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/30e7892b-fe20-48ab-adbd-a13b8756a114-registry-tls") pod "image-registry-6b64bb69f7-cvlj6" (UID: "30e7892b-fe20-48ab-adbd-a13b8756a114") : secret "image-registry-tls" not found
Jul 02 17:14:43.549454 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:43.549419    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/bd155b1c-0eb2-4271-974c-f8804ba77251-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-d6ppd\" (UID: \"bd155b1c-0eb2-4271-974c-f8804ba77251\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-d6ppd"
Jul 02 17:14:43.549598 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:14:43.549558    2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 02 17:14:43.549656 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:14:43.549618    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd155b1c-0eb2-4271-974c-f8804ba77251-samples-operator-tls podName:bd155b1c-0eb2-4271-974c-f8804ba77251 nodeName:}" failed. No retries permitted until 2026-07-02 17:14:45.54960026 +0000 UTC m=+240.739302904 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/bd155b1c-0eb2-4271-974c-f8804ba77251-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-d6ppd" (UID: "bd155b1c-0eb2-4271-974c-f8804ba77251") : secret "samples-operator-tls" not found
Jul 02 17:14:44.424517 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:44.424475    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:14:44.496403 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:44.496355    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:14:45.298658 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:45.298619    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-nz4p7" event={"ID":"5180569c-246f-44b6-a676-52300031785d","Type":"ContainerStarted","Data":"d28d02c9f3829318d45c53b0efa525cec68dd702bb191ddac7b07d33d87df3df"}
Jul 02 17:14:45.315955 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:45.315903    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5f67b55555-nz4p7" podStartSLOduration=1.9165817139999999 podStartE2EDuration="4.315886867s" totalImagesPullingTime="2.399305153s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:14:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:14:45.315826077 +0000 UTC m=+240.505528739" watchObservedRunningTime="2026-07-02 17:14:45.315886867 +0000 UTC m=+240.505589531"
Jul 02 17:14:45.464599 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:45.464567    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/30e7892b-fe20-48ab-adbd-a13b8756a114-registry-tls\") pod \"image-registry-6b64bb69f7-cvlj6\" (UID: \"30e7892b-fe20-48ab-adbd-a13b8756a114\") " pod="openshift-image-registry/image-registry-6b64bb69f7-cvlj6"
Jul 02 17:14:45.464917 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:14:45.464658    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 17:14:45.464917 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:14:45.464669    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b64bb69f7-cvlj6: secret "image-registry-tls" not found
Jul 02 17:14:45.464917 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:14:45.464729    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30e7892b-fe20-48ab-adbd-a13b8756a114-registry-tls podName:30e7892b-fe20-48ab-adbd-a13b8756a114 nodeName:}" failed. No retries permitted until 2026-07-02 17:14:49.464714861 +0000 UTC m=+244.654417500 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/30e7892b-fe20-48ab-adbd-a13b8756a114-registry-tls") pod "image-registry-6b64bb69f7-cvlj6" (UID: "30e7892b-fe20-48ab-adbd-a13b8756a114") : secret "image-registry-tls" not found
Jul 02 17:14:45.565878 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:45.565811    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/bd155b1c-0eb2-4271-974c-f8804ba77251-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-d6ppd\" (UID: \"bd155b1c-0eb2-4271-974c-f8804ba77251\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-d6ppd"
Jul 02 17:14:45.565985 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:14:45.565915    2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 02 17:14:45.565985 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:14:45.565963    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd155b1c-0eb2-4271-974c-f8804ba77251-samples-operator-tls podName:bd155b1c-0eb2-4271-974c-f8804ba77251 nodeName:}" failed. No retries permitted until 2026-07-02 17:14:49.565947772 +0000 UTC m=+244.755650413 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/bd155b1c-0eb2-4271-974c-f8804ba77251-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-d6ppd" (UID: "bd155b1c-0eb2-4271-974c-f8804ba77251") : secret "samples-operator-tls" not found
Jul 02 17:14:46.560107 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:46.560073    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-45vvn"]
Jul 02 17:14:46.563454 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:46.563425    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-45vvn"
Jul 02 17:14:46.566559 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:46.566536    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-hjnd2\""
Jul 02 17:14:46.566691 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:46.566567    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 02 17:14:46.567722 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:46.567707    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 02 17:14:46.586862 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:46.586837    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-45vvn"]
Jul 02 17:14:46.591727 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:46.591702    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:14:46.662943 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:46.662917    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:14:46.672879 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:46.672856    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9220e650-ec7a-485c-a786-ac5ddbfbfd22-data-volume\") pod \"insights-runtime-extractor-45vvn\" (UID: \"9220e650-ec7a-485c-a786-ac5ddbfbfd22\") " pod="openshift-insights/insights-runtime-extractor-45vvn"
Jul 02 17:14:46.672947 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:46.672903    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62hf5\" (UniqueName: \"kubernetes.io/projected/9220e650-ec7a-485c-a786-ac5ddbfbfd22-kube-api-access-62hf5\") pod \"insights-runtime-extractor-45vvn\" (UID: \"9220e650-ec7a-485c-a786-ac5ddbfbfd22\") " pod="openshift-insights/insights-runtime-extractor-45vvn"
Jul 02 17:14:46.672990 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:46.672944    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9220e650-ec7a-485c-a786-ac5ddbfbfd22-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-45vvn\" (UID: \"9220e650-ec7a-485c-a786-ac5ddbfbfd22\") " pod="openshift-insights/insights-runtime-extractor-45vvn"
Jul 02 17:14:46.672990 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:46.672978    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9220e650-ec7a-485c-a786-ac5ddbfbfd22-crio-socket\") pod \"insights-runtime-extractor-45vvn\" (UID: \"9220e650-ec7a-485c-a786-ac5ddbfbfd22\") " pod="openshift-insights/insights-runtime-extractor-45vvn"
Jul 02 17:14:46.673080 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:46.672997    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9220e650-ec7a-485c-a786-ac5ddbfbfd22-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-45vvn\" (UID: \"9220e650-ec7a-485c-a786-ac5ddbfbfd22\") " pod="openshift-insights/insights-runtime-extractor-45vvn"
Jul 02 17:14:46.773968 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:46.773945    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62hf5\" (UniqueName: \"kubernetes.io/projected/9220e650-ec7a-485c-a786-ac5ddbfbfd22-kube-api-access-62hf5\") pod \"insights-runtime-extractor-45vvn\" (UID: \"9220e650-ec7a-485c-a786-ac5ddbfbfd22\") " pod="openshift-insights/insights-runtime-extractor-45vvn"
Jul 02 17:14:46.774084 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:46.773974    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9220e650-ec7a-485c-a786-ac5ddbfbfd22-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-45vvn\" (UID: \"9220e650-ec7a-485c-a786-ac5ddbfbfd22\") " pod="openshift-insights/insights-runtime-extractor-45vvn"
Jul 02 17:14:46.774084 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:46.773995    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9220e650-ec7a-485c-a786-ac5ddbfbfd22-crio-socket\") pod \"insights-runtime-extractor-45vvn\" (UID: \"9220e650-ec7a-485c-a786-ac5ddbfbfd22\") " pod="openshift-insights/insights-runtime-extractor-45vvn"
Jul 02 17:14:46.774084 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:46.774032    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9220e650-ec7a-485c-a786-ac5ddbfbfd22-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-45vvn\" (UID: \"9220e650-ec7a-485c-a786-ac5ddbfbfd22\") " pod="openshift-insights/insights-runtime-extractor-45vvn"
Jul 02 17:14:46.774202 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:14:46.774091    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 17:14:46.774202 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:46.774105    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9220e650-ec7a-485c-a786-ac5ddbfbfd22-data-volume\") pod \"insights-runtime-extractor-45vvn\" (UID: \"9220e650-ec7a-485c-a786-ac5ddbfbfd22\") " pod="openshift-insights/insights-runtime-extractor-45vvn"
Jul 02 17:14:46.774202 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:46.774108    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9220e650-ec7a-485c-a786-ac5ddbfbfd22-crio-socket\") pod \"insights-runtime-extractor-45vvn\" (UID: \"9220e650-ec7a-485c-a786-ac5ddbfbfd22\") " pod="openshift-insights/insights-runtime-extractor-45vvn"
Jul 02 17:14:46.774202 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:14:46.774153    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9220e650-ec7a-485c-a786-ac5ddbfbfd22-kube-rbac-proxy-cm podName:9220e650-ec7a-485c-a786-ac5ddbfbfd22 nodeName:}" failed. No retries permitted until 2026-07-02 17:14:47.27413598 +0000 UTC m=+242.463838640 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9220e650-ec7a-485c-a786-ac5ddbfbfd22-kube-rbac-proxy-cm") pod "insights-runtime-extractor-45vvn" (UID: "9220e650-ec7a-485c-a786-ac5ddbfbfd22") : configmap "kube-rbac-proxy" not found
Jul 02 17:14:46.774202 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:14:46.774196    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 17:14:46.774368 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:14:46.774261    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9220e650-ec7a-485c-a786-ac5ddbfbfd22-insights-runtime-extractor-tls podName:9220e650-ec7a-485c-a786-ac5ddbfbfd22 nodeName:}" failed. No retries permitted until 2026-07-02 17:14:47.274246036 +0000 UTC m=+242.463948682 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9220e650-ec7a-485c-a786-ac5ddbfbfd22-insights-runtime-extractor-tls") pod "insights-runtime-extractor-45vvn" (UID: "9220e650-ec7a-485c-a786-ac5ddbfbfd22") : secret "insights-runtime-extractor-tls" not found
Jul 02 17:14:46.774368 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:46.774363    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9220e650-ec7a-485c-a786-ac5ddbfbfd22-data-volume\") pod \"insights-runtime-extractor-45vvn\" (UID: \"9220e650-ec7a-485c-a786-ac5ddbfbfd22\") " pod="openshift-insights/insights-runtime-extractor-45vvn"
Jul 02 17:14:46.782588 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:46.782570    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-62hf5\" (UniqueName: \"kubernetes.io/projected/9220e650-ec7a-485c-a786-ac5ddbfbfd22-kube-api-access-62hf5\") pod \"insights-runtime-extractor-45vvn\" (UID: \"9220e650-ec7a-485c-a786-ac5ddbfbfd22\") " pod="openshift-insights/insights-runtime-extractor-45vvn"
Jul 02 17:14:46.978029 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:46.977989    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:14:47.005503 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:47.005479    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-786f9fbc5-k2sv7"]
Jul 02 17:14:47.007352 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:47.007338    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-k2sv7"
Jul 02 17:14:47.010791 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:47.010772    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 02 17:14:47.010988 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:47.010971    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-6tzdg\""
Jul 02 17:14:47.011312 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:47.011296    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 02 17:14:47.021768 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:47.021747    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-786f9fbc5-k2sv7"]
Jul 02 17:14:47.063671 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:47.063647    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:14:47.076600 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:47.076580    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxb2j\" (UniqueName: \"kubernetes.io/projected/a8f152d2-c52f-4a22-967a-06ab63e82320-kube-api-access-hxb2j\") pod \"migrator-786f9fbc5-k2sv7\" (UID: \"a8f152d2-c52f-4a22-967a-06ab63e82320\") " pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-k2sv7"
Jul 02 17:14:47.165820 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:47.165799    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:14:47.177060 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:47.177039    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxb2j\" (UniqueName: \"kubernetes.io/projected/a8f152d2-c52f-4a22-967a-06ab63e82320-kube-api-access-hxb2j\") pod \"migrator-786f9fbc5-k2sv7\" (UID: \"a8f152d2-c52f-4a22-967a-06ab63e82320\") " pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-k2sv7"
Jul 02 17:14:47.189152 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:47.189124    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxb2j\" (UniqueName: \"kubernetes.io/projected/a8f152d2-c52f-4a22-967a-06ab63e82320-kube-api-access-hxb2j\") pod \"migrator-786f9fbc5-k2sv7\" (UID: \"a8f152d2-c52f-4a22-967a-06ab63e82320\") " pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-k2sv7"
Jul 02 17:14:47.267506 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:47.267442    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:14:47.277421 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:47.277404    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9220e650-ec7a-485c-a786-ac5ddbfbfd22-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-45vvn\" (UID: \"9220e650-ec7a-485c-a786-ac5ddbfbfd22\") " pod="openshift-insights/insights-runtime-extractor-45vvn"
Jul 02 17:14:47.277489 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:47.277435    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9220e650-ec7a-485c-a786-ac5ddbfbfd22-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-45vvn\" (UID: \"9220e650-ec7a-485c-a786-ac5ddbfbfd22\") " pod="openshift-insights/insights-runtime-extractor-45vvn"
Jul 02 17:14:47.277527 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:14:47.277514    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 17:14:47.277569 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:14:47.277538    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 17:14:47.277569 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:14:47.277562    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9220e650-ec7a-485c-a786-ac5ddbfbfd22-kube-rbac-proxy-cm podName:9220e650-ec7a-485c-a786-ac5ddbfbfd22 nodeName:}" failed. No retries permitted until 2026-07-02 17:14:48.277544627 +0000 UTC m=+243.467247270 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9220e650-ec7a-485c-a786-ac5ddbfbfd22-kube-rbac-proxy-cm") pod "insights-runtime-extractor-45vvn" (UID: "9220e650-ec7a-485c-a786-ac5ddbfbfd22") : configmap "kube-rbac-proxy" not found
Jul 02 17:14:47.277648 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:14:47.277581    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9220e650-ec7a-485c-a786-ac5ddbfbfd22-insights-runtime-extractor-tls podName:9220e650-ec7a-485c-a786-ac5ddbfbfd22 nodeName:}" failed. No retries permitted until 2026-07-02 17:14:48.277570486 +0000 UTC m=+243.467273131 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9220e650-ec7a-485c-a786-ac5ddbfbfd22-insights-runtime-extractor-tls") pod "insights-runtime-extractor-45vvn" (UID: "9220e650-ec7a-485c-a786-ac5ddbfbfd22") : secret "insights-runtime-extractor-tls" not found
Jul 02 17:14:47.316111 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:47.316090    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-k2sv7"
Jul 02 17:14:47.435225 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:47.435200    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-786f9fbc5-k2sv7"]
Jul 02 17:14:47.437739 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:14:47.437701    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8f152d2_c52f_4a22_967a_06ab63e82320.slice/crio-4987830d04ab5156cbc9d70a974d7249b0beb0461e3c04ee1a638c26191d8382 WatchSource:0}: Error finding container 4987830d04ab5156cbc9d70a974d7249b0beb0461e3c04ee1a638c26191d8382: Status 404 returned error can't find the container with id 4987830d04ab5156cbc9d70a974d7249b0beb0461e3c04ee1a638c26191d8382
Jul 02 17:14:47.550174 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:47.550110    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:14:47.647865 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:47.647838    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:14:48.285328 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:48.285298    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9220e650-ec7a-485c-a786-ac5ddbfbfd22-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-45vvn\" (UID: \"9220e650-ec7a-485c-a786-ac5ddbfbfd22\") " pod="openshift-insights/insights-runtime-extractor-45vvn"
Jul 02 17:14:48.285479 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:48.285401    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9220e650-ec7a-485c-a786-ac5ddbfbfd22-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-45vvn\" (UID: \"9220e650-ec7a-485c-a786-ac5ddbfbfd22\") " pod="openshift-insights/insights-runtime-extractor-45vvn"
Jul 02 17:14:48.285479 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:14:48.285454    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 17:14:48.285479 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:14:48.285471    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 17:14:48.285579 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:14:48.285518    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9220e650-ec7a-485c-a786-ac5ddbfbfd22-insights-runtime-extractor-tls podName:9220e650-ec7a-485c-a786-ac5ddbfbfd22 nodeName:}" failed. No retries permitted until 2026-07-02 17:14:50.285504831 +0000 UTC m=+245.475207487 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9220e650-ec7a-485c-a786-ac5ddbfbfd22-insights-runtime-extractor-tls") pod "insights-runtime-extractor-45vvn" (UID: "9220e650-ec7a-485c-a786-ac5ddbfbfd22") : secret "insights-runtime-extractor-tls" not found
Jul 02 17:14:48.285579 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:14:48.285533    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9220e650-ec7a-485c-a786-ac5ddbfbfd22-kube-rbac-proxy-cm podName:9220e650-ec7a-485c-a786-ac5ddbfbfd22 nodeName:}" failed. No retries permitted until 2026-07-02 17:14:50.285527974 +0000 UTC m=+245.475230613 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9220e650-ec7a-485c-a786-ac5ddbfbfd22-kube-rbac-proxy-cm") pod "insights-runtime-extractor-45vvn" (UID: "9220e650-ec7a-485c-a786-ac5ddbfbfd22") : configmap "kube-rbac-proxy" not found
Jul 02 17:14:48.307781 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:48.307754    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-k2sv7" event={"ID":"a8f152d2-c52f-4a22-967a-06ab63e82320","Type":"ContainerStarted","Data":"4987830d04ab5156cbc9d70a974d7249b0beb0461e3c04ee1a638c26191d8382"}
Jul 02 17:14:48.711036 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:48.710952    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vfd4d_fb0fdece-96ab-471d-87e5-89e41822fd53/dns-node-resolver/0.log"
Jul 02 17:14:49.197231 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:49.197192    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:14:49.300849 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:49.300815    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:14:49.312501 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:49.312478    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-k2sv7" event={"ID":"a8f152d2-c52f-4a22-967a-06ab63e82320","Type":"ContainerStarted","Data":"e25b8bfa7a13c473a69aa6144e783e5b530811988bef69cd27b34e6a3b39d612"}
Jul 02 17:14:49.312585 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:49.312528    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-k2sv7" event={"ID":"a8f152d2-c52f-4a22-967a-06ab63e82320","Type":"ContainerStarted","Data":"bcb0b13f7157d12489be2c1a8d4688f3308f5f83d10961e2c9b7f914137e78ce"}
Jul 02 17:14:49.332128 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:49.332086    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-k2sv7" podStartSLOduration=1.647001774 podStartE2EDuration="3.33207079s" totalImagesPullingTime="1.685069016s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:14:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:14:49.331288092 +0000 UTC m=+244.520990755" watchObservedRunningTime="2026-07-02 17:14:49.33207079 +0000 UTC m=+244.521773452"
Jul 02 17:14:49.422740 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:49.422676    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:14:49.490845 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:49.490814    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:14:49.496357 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:49.496335    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/30e7892b-fe20-48ab-adbd-a13b8756a114-registry-tls\") pod \"image-registry-6b64bb69f7-cvlj6\" (UID: \"30e7892b-fe20-48ab-adbd-a13b8756a114\") " pod="openshift-image-registry/image-registry-6b64bb69f7-cvlj6"
Jul 02 17:14:49.496489 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:14:49.496473    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 17:14:49.496535 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:14:49.496491    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b64bb69f7-cvlj6: secret "image-registry-tls" not found
Jul 02 17:14:49.496535 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:14:49.496533    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30e7892b-fe20-48ab-adbd-a13b8756a114-registry-tls podName:30e7892b-fe20-48ab-adbd-a13b8756a114 nodeName:}" failed. No retries permitted until 2026-07-02 17:14:57.496521419 +0000 UTC m=+252.686224063 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/30e7892b-fe20-48ab-adbd-a13b8756a114-registry-tls") pod "image-registry-6b64bb69f7-cvlj6" (UID: "30e7892b-fe20-48ab-adbd-a13b8756a114") : secret "image-registry-tls" not found
Jul 02 17:14:49.597231 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:49.597197    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/bd155b1c-0eb2-4271-974c-f8804ba77251-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-d6ppd\" (UID: \"bd155b1c-0eb2-4271-974c-f8804ba77251\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-d6ppd"
Jul 02 17:14:49.597349 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:14:49.597336    2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 02 17:14:49.597397 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:14:49.597388    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd155b1c-0eb2-4271-974c-f8804ba77251-samples-operator-tls podName:bd155b1c-0eb2-4271-974c-f8804ba77251 nodeName:}" failed. No retries permitted until 2026-07-02 17:14:57.597370105 +0000 UTC m=+252.787072756 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/bd155b1c-0eb2-4271-974c-f8804ba77251-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-d6ppd" (UID: "bd155b1c-0eb2-4271-974c-f8804ba77251") : secret "samples-operator-tls" not found
Jul 02 17:14:49.710470 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:49.710425    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cr9bq_de6a6072-1ba3-44d4-8fbd-4e332b70d7a5/node-ca/0.log"
Jul 02 17:14:50.231951 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:50.231921    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:14:50.302034 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:50.301995    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9220e650-ec7a-485c-a786-ac5ddbfbfd22-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-45vvn\" (UID: \"9220e650-ec7a-485c-a786-ac5ddbfbfd22\") " pod="openshift-insights/insights-runtime-extractor-45vvn"
Jul 02 17:14:50.302159 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:50.302058    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9220e650-ec7a-485c-a786-ac5ddbfbfd22-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-45vvn\" (UID: \"9220e650-ec7a-485c-a786-ac5ddbfbfd22\") " pod="openshift-insights/insights-runtime-extractor-45vvn"
Jul 02 17:14:50.302159 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:14:50.302108    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 17:14:50.302159 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:14:50.302157    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9220e650-ec7a-485c-a786-ac5ddbfbfd22-kube-rbac-proxy-cm podName:9220e650-ec7a-485c-a786-ac5ddbfbfd22 nodeName:}" failed. No retries permitted until 2026-07-02 17:14:54.302140736 +0000 UTC m=+249.491843396 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9220e650-ec7a-485c-a786-ac5ddbfbfd22-kube-rbac-proxy-cm") pod "insights-runtime-extractor-45vvn" (UID: "9220e650-ec7a-485c-a786-ac5ddbfbfd22") : configmap "kube-rbac-proxy" not found
Jul 02 17:14:50.302293 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:14:50.302205    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 17:14:50.302293 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:14:50.302250    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9220e650-ec7a-485c-a786-ac5ddbfbfd22-insights-runtime-extractor-tls podName:9220e650-ec7a-485c-a786-ac5ddbfbfd22 nodeName:}" failed. No retries permitted until 2026-07-02 17:14:54.30223895 +0000 UTC m=+249.491941589 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9220e650-ec7a-485c-a786-ac5ddbfbfd22-insights-runtime-extractor-tls") pod "insights-runtime-extractor-45vvn" (UID: "9220e650-ec7a-485c-a786-ac5ddbfbfd22") : secret "insights-runtime-extractor-tls" not found
Jul 02 17:14:50.511716 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:50.511655    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-tg92m_e2ca5a7e-9ab8-4e9d-a2ca-e6df8c93a07c/serve-healthcheck-canary/0.log"
Jul 02 17:14:51.105603 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:51.105567    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:14:51.291226 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:51.291191    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:14:51.387474 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:51.387400    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:14:51.544176 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:51.544145    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:14:51.759834 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:51.759805    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:14:51.853400 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:51.853371    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:14:52.613144 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:52.613111    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:14:53.215267 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:53.215241    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:14:53.409384 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:53.409359    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:14:53.629821 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:53.629791    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:14:53.809764 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:53.809725    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:14:54.065055 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:54.065010    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:14:54.333552 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:54.333486    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9220e650-ec7a-485c-a786-ac5ddbfbfd22-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-45vvn\" (UID: \"9220e650-ec7a-485c-a786-ac5ddbfbfd22\") " pod="openshift-insights/insights-runtime-extractor-45vvn"
Jul 02 17:14:54.333552 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:54.333521    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9220e650-ec7a-485c-a786-ac5ddbfbfd22-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-45vvn\" (UID: \"9220e650-ec7a-485c-a786-ac5ddbfbfd22\") " pod="openshift-insights/insights-runtime-extractor-45vvn"
Jul 02 17:14:54.333706 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:14:54.333613    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 17:14:54.333706 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:14:54.333630    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 17:14:54.333706 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:14:54.333676    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9220e650-ec7a-485c-a786-ac5ddbfbfd22-kube-rbac-proxy-cm podName:9220e650-ec7a-485c-a786-ac5ddbfbfd22 nodeName:}" failed. No retries permitted until 2026-07-02 17:15:02.333657764 +0000 UTC m=+257.523360408 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9220e650-ec7a-485c-a786-ac5ddbfbfd22-kube-rbac-proxy-cm") pod "insights-runtime-extractor-45vvn" (UID: "9220e650-ec7a-485c-a786-ac5ddbfbfd22") : configmap "kube-rbac-proxy" not found
Jul 02 17:14:54.333706 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:14:54.333689    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9220e650-ec7a-485c-a786-ac5ddbfbfd22-insights-runtime-extractor-tls podName:9220e650-ec7a-485c-a786-ac5ddbfbfd22 nodeName:}" failed. No retries permitted until 2026-07-02 17:15:02.333683217 +0000 UTC m=+257.523385858 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9220e650-ec7a-485c-a786-ac5ddbfbfd22-insights-runtime-extractor-tls") pod "insights-runtime-extractor-45vvn" (UID: "9220e650-ec7a-485c-a786-ac5ddbfbfd22") : secret "insights-runtime-extractor-tls" not found
Jul 02 17:14:54.812153 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:54.812119    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:14:55.015258 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:55.015225    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:14:55.206668 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:55.206592    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:14:55.306170 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:55.306147    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:14:55.408366 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:55.408332    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:14:55.608338 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:55.608315    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:14:55.808312 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:55.808281    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:14:56.147301 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:56.147265    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1d3526d-01f3-4e77-a78e-ac8954a7a207-metrics-certs\") pod \"network-metrics-daemon-g67j2\" (UID: \"d1d3526d-01f3-4e77-a78e-ac8954a7a207\") " pod="openshift-multus/network-metrics-daemon-g67j2"
Jul 02 17:14:56.147737 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:14:56.147429    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 02 17:14:56.147737 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:14:56.147504    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1d3526d-01f3-4e77-a78e-ac8954a7a207-metrics-certs podName:d1d3526d-01f3-4e77-a78e-ac8954a7a207 nodeName:}" failed. No retries permitted until 2026-07-02 17:16:58.147483406 +0000 UTC m=+373.337186055 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d1d3526d-01f3-4e77-a78e-ac8954a7a207-metrics-certs") pod "network-metrics-daemon-g67j2" (UID: "d1d3526d-01f3-4e77-a78e-ac8954a7a207") : secret "metrics-daemon-secret" not found
Jul 02 17:14:56.806037 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:56.805986    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:14:57.145639 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:57.145561    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:14:57.246072 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:57.246038    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:14:57.406320 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:57.406240    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:14:57.558946 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:57.558918    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/30e7892b-fe20-48ab-adbd-a13b8756a114-registry-tls\") pod \"image-registry-6b64bb69f7-cvlj6\" (UID: \"30e7892b-fe20-48ab-adbd-a13b8756a114\") " pod="openshift-image-registry/image-registry-6b64bb69f7-cvlj6"
Jul 02 17:14:57.561288 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:57.561263    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/30e7892b-fe20-48ab-adbd-a13b8756a114-registry-tls\") pod \"image-registry-6b64bb69f7-cvlj6\" (UID: \"30e7892b-fe20-48ab-adbd-a13b8756a114\") " pod="openshift-image-registry/image-registry-6b64bb69f7-cvlj6"
Jul 02 17:14:57.604352 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:57.604324    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:14:57.615972 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:57.615950    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-z9h8v\""
Jul 02 17:14:57.623422 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:57.623405    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b64bb69f7-cvlj6"
Jul 02 17:14:57.659481 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:57.659416    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/bd155b1c-0eb2-4271-974c-f8804ba77251-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-d6ppd\" (UID: \"bd155b1c-0eb2-4271-974c-f8804ba77251\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-d6ppd"
Jul 02 17:14:57.661638 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:57.661616    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/bd155b1c-0eb2-4271-974c-f8804ba77251-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-d6ppd\" (UID: \"bd155b1c-0eb2-4271-974c-f8804ba77251\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-d6ppd"
Jul 02 17:14:57.722078 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:57.722058    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-8pwlf\""
Jul 02 17:14:57.729399 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:57.729376    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-d6ppd"
Jul 02 17:14:57.745546 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:57.745520    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6b64bb69f7-cvlj6"]
Jul 02 17:14:57.749274 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:14:57.749249    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30e7892b_fe20_48ab_adbd_a13b8756a114.slice/crio-ad3ed4a5dcd01c4470e4ddc2db1f847de8ba39e8f50c9017a712a08954f35aa8 WatchSource:0}: Error finding container ad3ed4a5dcd01c4470e4ddc2db1f847de8ba39e8f50c9017a712a08954f35aa8: Status 404 returned error can't find the container with id ad3ed4a5dcd01c4470e4ddc2db1f847de8ba39e8f50c9017a712a08954f35aa8
Jul 02 17:14:57.858880 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:57.858851    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-d6ppd"]
Jul 02 17:14:58.008581 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:58.008546    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:14:58.340653 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:58.340572    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-d6ppd" event={"ID":"bd155b1c-0eb2-4271-974c-f8804ba77251","Type":"ContainerStarted","Data":"19621a10f733dae969ebcd32bede45e5129b0268b19222afd4bb315bf1bcfd82"}
Jul 02 17:14:58.341951 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:58.341929    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b64bb69f7-cvlj6" event={"ID":"30e7892b-fe20-48ab-adbd-a13b8756a114","Type":"ContainerStarted","Data":"92159c3c3bb0fb9e9c71e6ce7722bd923da52bb4dd50efc667ec2d6b47d3decd"}
Jul 02 17:14:58.342078 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:58.341962    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b64bb69f7-cvlj6" event={"ID":"30e7892b-fe20-48ab-adbd-a13b8756a114","Type":"ContainerStarted","Data":"ad3ed4a5dcd01c4470e4ddc2db1f847de8ba39e8f50c9017a712a08954f35aa8"}
Jul 02 17:14:58.342078 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:58.342054    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6b64bb69f7-cvlj6"
Jul 02 17:14:58.360182 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:58.360147    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6b64bb69f7-cvlj6" podStartSLOduration=17.360134641 podStartE2EDuration="17.360134641s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:14:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:14:58.359520065 +0000 UTC m=+253.549222725" watchObservedRunningTime="2026-07-02 17:14:58.360134641 +0000 UTC m=+253.549837304"
Jul 02 17:14:58.807875 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:58.807843    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:14:59.015771 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:59.015738    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:14:59.207830 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:59.207760    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:14:59.602294 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:59.602258    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:14:59.703506 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:59.703477    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:14:59.939059 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:14:59.938953    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:00.066586 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:00.066551    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:00.608265 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:00.608233    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:01.014537 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:01.014502    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:01.210667 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:01.210636    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:01.352606 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:01.352535    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-d6ppd" event={"ID":"bd155b1c-0eb2-4271-974c-f8804ba77251","Type":"ContainerStarted","Data":"b7e25809dad56367e86e68d26e159d11c89843a9bf1a8f4fe380b5c77307464a"}
Jul 02 17:15:01.352748 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:01.352605    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-d6ppd" event={"ID":"bd155b1c-0eb2-4271-974c-f8804ba77251","Type":"ContainerStarted","Data":"b35c25b25ef7b1b1a99523fe3a906eb0b07d13fe50380802d9df1317b269ce52"}
Jul 02 17:15:01.369852 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:01.369805    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-d6ppd" podStartSLOduration=17.788566413 podStartE2EDuration="20.369791782s" totalImagesPullingTime="2.581225369s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:14:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:15:01.369377291 +0000 UTC m=+256.559079955" watchObservedRunningTime="2026-07-02 17:15:01.369791782 +0000 UTC m=+256.559494444"
Jul 02 17:15:01.392120 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:01.392091    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:01.606412 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:01.606350    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:01.806004 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:01.805972    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:02.395771 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:02.395732    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9220e650-ec7a-485c-a786-ac5ddbfbfd22-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-45vvn\" (UID: \"9220e650-ec7a-485c-a786-ac5ddbfbfd22\") " pod="openshift-insights/insights-runtime-extractor-45vvn"
Jul 02 17:15:02.395928 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:02.395811    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9220e650-ec7a-485c-a786-ac5ddbfbfd22-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-45vvn\" (UID: \"9220e650-ec7a-485c-a786-ac5ddbfbfd22\") " pod="openshift-insights/insights-runtime-extractor-45vvn"
Jul 02 17:15:02.396310 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:02.396292    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9220e650-ec7a-485c-a786-ac5ddbfbfd22-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-45vvn\" (UID: \"9220e650-ec7a-485c-a786-ac5ddbfbfd22\") " pod="openshift-insights/insights-runtime-extractor-45vvn"
Jul 02 17:15:02.397990 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:02.397971    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9220e650-ec7a-485c-a786-ac5ddbfbfd22-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-45vvn\" (UID: \"9220e650-ec7a-485c-a786-ac5ddbfbfd22\") " pod="openshift-insights/insights-runtime-extractor-45vvn"
Jul 02 17:15:02.472237 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:02.472218    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-45vvn"
Jul 02 17:15:02.594930 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:02.594902    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-45vvn"]
Jul 02 17:15:02.597503 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:15:02.597480    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9220e650_ec7a_485c_a786_ac5ddbfbfd22.slice/crio-ae3fa69e4bad80e5bcfcb6df6cc0028b89e4ae3e10aa2cbea9ff1cbc3e830938 WatchSource:0}: Error finding container ae3fa69e4bad80e5bcfcb6df6cc0028b89e4ae3e10aa2cbea9ff1cbc3e830938: Status 404 returned error can't find the container with id ae3fa69e4bad80e5bcfcb6df6cc0028b89e4ae3e10aa2cbea9ff1cbc3e830938
Jul 02 17:15:03.168873 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:03.168717    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:03.270936 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:03.270873    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:03.334160 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:03.334085    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:03.361665 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:03.361581    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-45vvn" event={"ID":"9220e650-ec7a-485c-a786-ac5ddbfbfd22","Type":"ContainerStarted","Data":"ae3fa69e4bad80e5bcfcb6df6cc0028b89e4ae3e10aa2cbea9ff1cbc3e830938"}
Jul 02 17:15:03.537005 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:03.536963    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:03.643590 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:03.643556    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:03.924348 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:03.924262    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:04.025152 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:04.025118    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:04.260221 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:04.260188    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:04.664673 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:04.664596    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:04.855793 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:04.855727    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:04.955718 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:04.955637    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:05.070957 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:05.070924    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:05.673861 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:05.673820    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:05.760220 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:05.760188    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:06.372322 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:06.372293    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-45vvn" event={"ID":"9220e650-ec7a-485c-a786-ac5ddbfbfd22","Type":"ContainerStarted","Data":"2a77e484d8018332bd53df09bad830ee3ebd9887e87004dab764cead6699465b"}
Jul 02 17:15:07.378334 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:07.378298    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-45vvn" event={"ID":"9220e650-ec7a-485c-a786-ac5ddbfbfd22","Type":"ContainerStarted","Data":"600171d97d3e544f215138595ea1201cf1875d565f466c1a2c047d58ddd039b9"}
Jul 02 17:15:09.386214 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:09.386184    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-45vvn" event={"ID":"9220e650-ec7a-485c-a786-ac5ddbfbfd22","Type":"ContainerStarted","Data":"97443abca27a8aa185827f6046c2146202d0e63b74e69bf8e2bf23255ccd9155"}
Jul 02 17:15:09.405216 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:09.405177    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-45vvn" podStartSLOduration=16.884392157 podStartE2EDuration="23.405162603s" totalImagesPullingTime="6.520770446s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 17:14:46 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:15:09.403115183 +0000 UTC m=+264.592817844" watchObservedRunningTime="2026-07-02 17:15:09.405162603 +0000 UTC m=+264.594865265"
Jul 02 17:15:12.907232 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:12.907200    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6b64bb69f7-cvlj6"]
Jul 02 17:15:12.911359 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:12.911333    2578 patch_prober.go:28] interesting pod/image-registry-6b64bb69f7-cvlj6 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 02 17:15:12.911491 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:12.911379    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6b64bb69f7-cvlj6" podUID="30e7892b-fe20-48ab-adbd-a13b8756a114" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 17:15:12.929820 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:12.929797    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5499b6fb8f-q7nf2"]
Jul 02 17:15:12.932725 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:12.932710    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5499b6fb8f-q7nf2"
Jul 02 17:15:12.936243 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:12.936220    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-wkjxl\""
Jul 02 17:15:12.936366 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:12.936274    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 02 17:15:12.936366 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:12.936220    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 02 17:15:12.937540 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:12.937521    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-86ddb7bc6-tk8sx"]
Jul 02 17:15:12.940321 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:12.940303    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-86ddb7bc6-tk8sx"
Jul 02 17:15:12.947276 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:12.947255    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5499b6fb8f-q7nf2"]
Jul 02 17:15:12.954877 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:12.954854    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-86ddb7bc6-tk8sx"]
Jul 02 17:15:13.022905 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:13.022882    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:13.075536 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:13.075515    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/25f8baf0-6658-4bc0-bbb4-85d02f461241-image-registry-private-configuration\") pod \"image-registry-86ddb7bc6-tk8sx\" (UID: \"25f8baf0-6658-4bc0-bbb4-85d02f461241\") " pod="openshift-image-registry/image-registry-86ddb7bc6-tk8sx"
Jul 02 17:15:13.075638 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:13.075548    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/25f8baf0-6658-4bc0-bbb4-85d02f461241-registry-certificates\") pod \"image-registry-86ddb7bc6-tk8sx\" (UID: \"25f8baf0-6658-4bc0-bbb4-85d02f461241\") " pod="openshift-image-registry/image-registry-86ddb7bc6-tk8sx"
Jul 02 17:15:13.075638 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:13.075575    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wq2w9\" (UniqueName: \"kubernetes.io/projected/25f8baf0-6658-4bc0-bbb4-85d02f461241-kube-api-access-wq2w9\") pod \"image-registry-86ddb7bc6-tk8sx\" (UID: \"25f8baf0-6658-4bc0-bbb4-85d02f461241\") " pod="openshift-image-registry/image-registry-86ddb7bc6-tk8sx"
Jul 02 17:15:13.075638 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:13.075594    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fskbm\" (UniqueName: \"kubernetes.io/projected/ab1e6175-b825-4fec-87cb-5eed477ccd71-kube-api-access-fskbm\") pod \"downloads-5499b6fb8f-q7nf2\" (UID: \"ab1e6175-b825-4fec-87cb-5eed477ccd71\") " pod="openshift-console/downloads-5499b6fb8f-q7nf2"
Jul 02 17:15:13.075638 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:13.075618    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/25f8baf0-6658-4bc0-bbb4-85d02f461241-bound-sa-token\") pod \"image-registry-86ddb7bc6-tk8sx\" (UID: \"25f8baf0-6658-4bc0-bbb4-85d02f461241\") " pod="openshift-image-registry/image-registry-86ddb7bc6-tk8sx"
Jul 02 17:15:13.075788 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:13.075669    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/25f8baf0-6658-4bc0-bbb4-85d02f461241-trusted-ca\") pod \"image-registry-86ddb7bc6-tk8sx\" (UID: \"25f8baf0-6658-4bc0-bbb4-85d02f461241\") " pod="openshift-image-registry/image-registry-86ddb7bc6-tk8sx"
Jul 02 17:15:13.075788 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:13.075701    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/25f8baf0-6658-4bc0-bbb4-85d02f461241-installation-pull-secrets\") pod \"image-registry-86ddb7bc6-tk8sx\" (UID: \"25f8baf0-6658-4bc0-bbb4-85d02f461241\") " pod="openshift-image-registry/image-registry-86ddb7bc6-tk8sx"
Jul 02 17:15:13.075788 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:13.075746    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/25f8baf0-6658-4bc0-bbb4-85d02f461241-ca-trust-extracted\") pod \"image-registry-86ddb7bc6-tk8sx\" (UID: \"25f8baf0-6658-4bc0-bbb4-85d02f461241\") " pod="openshift-image-registry/image-registry-86ddb7bc6-tk8sx"
Jul 02 17:15:13.075788 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:13.075782    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/25f8baf0-6658-4bc0-bbb4-85d02f461241-registry-tls\") pod \"image-registry-86ddb7bc6-tk8sx\" (UID: \"25f8baf0-6658-4bc0-bbb4-85d02f461241\") " pod="openshift-image-registry/image-registry-86ddb7bc6-tk8sx"
Jul 02 17:15:13.122622 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:13.122589    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:13.176901 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:13.176849    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/25f8baf0-6658-4bc0-bbb4-85d02f461241-image-registry-private-configuration\") pod \"image-registry-86ddb7bc6-tk8sx\" (UID: \"25f8baf0-6658-4bc0-bbb4-85d02f461241\") " pod="openshift-image-registry/image-registry-86ddb7bc6-tk8sx"
Jul 02 17:15:13.176901 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:13.176892    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/25f8baf0-6658-4bc0-bbb4-85d02f461241-registry-certificates\") pod \"image-registry-86ddb7bc6-tk8sx\" (UID: \"25f8baf0-6658-4bc0-bbb4-85d02f461241\") " pod="openshift-image-registry/image-registry-86ddb7bc6-tk8sx"
Jul 02 17:15:13.177085 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:13.177073    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wq2w9\" (UniqueName: \"kubernetes.io/projected/25f8baf0-6658-4bc0-bbb4-85d02f461241-kube-api-access-wq2w9\") pod \"image-registry-86ddb7bc6-tk8sx\" (UID: \"25f8baf0-6658-4bc0-bbb4-85d02f461241\") " pod="openshift-image-registry/image-registry-86ddb7bc6-tk8sx"
Jul 02 17:15:13.177177 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:13.177098    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fskbm\" (UniqueName: \"kubernetes.io/projected/ab1e6175-b825-4fec-87cb-5eed477ccd71-kube-api-access-fskbm\") pod \"downloads-5499b6fb8f-q7nf2\" (UID: \"ab1e6175-b825-4fec-87cb-5eed477ccd71\") " pod="openshift-console/downloads-5499b6fb8f-q7nf2"
Jul 02 17:15:13.177177 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:13.177117    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/25f8baf0-6658-4bc0-bbb4-85d02f461241-bound-sa-token\") pod \"image-registry-86ddb7bc6-tk8sx\" (UID: \"25f8baf0-6658-4bc0-bbb4-85d02f461241\") " pod="openshift-image-registry/image-registry-86ddb7bc6-tk8sx"
Jul 02 17:15:13.177177 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:13.177143    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/25f8baf0-6658-4bc0-bbb4-85d02f461241-trusted-ca\") pod \"image-registry-86ddb7bc6-tk8sx\" (UID: \"25f8baf0-6658-4bc0-bbb4-85d02f461241\") " pod="openshift-image-registry/image-registry-86ddb7bc6-tk8sx"
Jul 02 17:15:13.177177 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:13.177160    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/25f8baf0-6658-4bc0-bbb4-85d02f461241-installation-pull-secrets\") pod \"image-registry-86ddb7bc6-tk8sx\" (UID: \"25f8baf0-6658-4bc0-bbb4-85d02f461241\") " pod="openshift-image-registry/image-registry-86ddb7bc6-tk8sx"
Jul 02 17:15:13.177372 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:13.177326    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/25f8baf0-6658-4bc0-bbb4-85d02f461241-ca-trust-extracted\") pod \"image-registry-86ddb7bc6-tk8sx\" (UID: \"25f8baf0-6658-4bc0-bbb4-85d02f461241\") " pod="openshift-image-registry/image-registry-86ddb7bc6-tk8sx"
Jul 02 17:15:13.177427 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:13.177390    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/25f8baf0-6658-4bc0-bbb4-85d02f461241-registry-tls\") pod \"image-registry-86ddb7bc6-tk8sx\" (UID: \"25f8baf0-6658-4bc0-bbb4-85d02f461241\") " pod="openshift-image-registry/image-registry-86ddb7bc6-tk8sx"
Jul 02 17:15:13.177748 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:13.177716    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/25f8baf0-6658-4bc0-bbb4-85d02f461241-ca-trust-extracted\") pod \"image-registry-86ddb7bc6-tk8sx\" (UID: \"25f8baf0-6658-4bc0-bbb4-85d02f461241\") " pod="openshift-image-registry/image-registry-86ddb7bc6-tk8sx"
Jul 02 17:15:13.177862 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:13.177833    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/25f8baf0-6658-4bc0-bbb4-85d02f461241-registry-certificates\") pod \"image-registry-86ddb7bc6-tk8sx\" (UID: \"25f8baf0-6658-4bc0-bbb4-85d02f461241\") " pod="openshift-image-registry/image-registry-86ddb7bc6-tk8sx"
Jul 02 17:15:13.178006 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:13.177985    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/25f8baf0-6658-4bc0-bbb4-85d02f461241-trusted-ca\") pod \"image-registry-86ddb7bc6-tk8sx\" (UID: \"25f8baf0-6658-4bc0-bbb4-85d02f461241\") " pod="openshift-image-registry/image-registry-86ddb7bc6-tk8sx"
Jul 02 17:15:13.179376 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:13.179349    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/25f8baf0-6658-4bc0-bbb4-85d02f461241-image-registry-private-configuration\") pod \"image-registry-86ddb7bc6-tk8sx\" (UID: \"25f8baf0-6658-4bc0-bbb4-85d02f461241\") " pod="openshift-image-registry/image-registry-86ddb7bc6-tk8sx"
Jul 02 17:15:13.179482 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:13.179466    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/25f8baf0-6658-4bc0-bbb4-85d02f461241-installation-pull-secrets\") pod \"image-registry-86ddb7bc6-tk8sx\" (UID: \"25f8baf0-6658-4bc0-bbb4-85d02f461241\") " pod="openshift-image-registry/image-registry-86ddb7bc6-tk8sx"
Jul 02 17:15:13.179590 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:13.179574    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/25f8baf0-6658-4bc0-bbb4-85d02f461241-registry-tls\") pod \"image-registry-86ddb7bc6-tk8sx\" (UID: \"25f8baf0-6658-4bc0-bbb4-85d02f461241\") " pod="openshift-image-registry/image-registry-86ddb7bc6-tk8sx"
Jul 02 17:15:13.186066 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:13.186005    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fskbm\" (UniqueName: \"kubernetes.io/projected/ab1e6175-b825-4fec-87cb-5eed477ccd71-kube-api-access-fskbm\") pod \"downloads-5499b6fb8f-q7nf2\" (UID: \"ab1e6175-b825-4fec-87cb-5eed477ccd71\") " pod="openshift-console/downloads-5499b6fb8f-q7nf2"
Jul 02 17:15:13.186529 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:13.186507    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wq2w9\" (UniqueName: \"kubernetes.io/projected/25f8baf0-6658-4bc0-bbb4-85d02f461241-kube-api-access-wq2w9\") pod \"image-registry-86ddb7bc6-tk8sx\" (UID: \"25f8baf0-6658-4bc0-bbb4-85d02f461241\") " pod="openshift-image-registry/image-registry-86ddb7bc6-tk8sx"
Jul 02 17:15:13.186632 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:13.186590    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/25f8baf0-6658-4bc0-bbb4-85d02f461241-bound-sa-token\") pod \"image-registry-86ddb7bc6-tk8sx\" (UID: \"25f8baf0-6658-4bc0-bbb4-85d02f461241\") " pod="openshift-image-registry/image-registry-86ddb7bc6-tk8sx"
Jul 02 17:15:13.241779 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:13.241761    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5499b6fb8f-q7nf2"
Jul 02 17:15:13.248752 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:13.248738    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-86ddb7bc6-tk8sx"
Jul 02 17:15:13.379158 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:13.372963    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5499b6fb8f-q7nf2"]
Jul 02 17:15:13.392978 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:15:13.392949    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab1e6175_b825_4fec_87cb_5eed477ccd71.slice/crio-360cdcfef555e3b2e4478ca55aaec9bd6b8e748353bd6b771fbd906dd3a202e3 WatchSource:0}: Error finding container 360cdcfef555e3b2e4478ca55aaec9bd6b8e748353bd6b771fbd906dd3a202e3: Status 404 returned error can't find the container with id 360cdcfef555e3b2e4478ca55aaec9bd6b8e748353bd6b771fbd906dd3a202e3
Jul 02 17:15:13.400407 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:13.400376    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5499b6fb8f-q7nf2" event={"ID":"ab1e6175-b825-4fec-87cb-5eed477ccd71","Type":"ContainerStarted","Data":"360cdcfef555e3b2e4478ca55aaec9bd6b8e748353bd6b771fbd906dd3a202e3"}
Jul 02 17:15:13.412780 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:13.412748    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-86ddb7bc6-tk8sx"]
Jul 02 17:15:13.415839 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:15:13.415817    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25f8baf0_6658_4bc0_bbb4_85d02f461241.slice/crio-681f544ec27aa23573b308973cb5b72f21ced29ea386a54c68a31ca39d38f9c8 WatchSource:0}: Error finding container 681f544ec27aa23573b308973cb5b72f21ced29ea386a54c68a31ca39d38f9c8: Status 404 returned error can't find the container with id 681f544ec27aa23573b308973cb5b72f21ced29ea386a54c68a31ca39d38f9c8
Jul 02 17:15:14.405931 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:14.405889    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-86ddb7bc6-tk8sx" event={"ID":"25f8baf0-6658-4bc0-bbb4-85d02f461241","Type":"ContainerStarted","Data":"99b16e3f9e63e660de2f84a91cef79548b9667b036e436731c7afbbb9d14b9da"}
Jul 02 17:15:14.406411 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:14.405950    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-86ddb7bc6-tk8sx" event={"ID":"25f8baf0-6658-4bc0-bbb4-85d02f461241","Type":"ContainerStarted","Data":"681f544ec27aa23573b308973cb5b72f21ced29ea386a54c68a31ca39d38f9c8"}
Jul 02 17:15:14.406411 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:14.405979    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-86ddb7bc6-tk8sx"
Jul 02 17:15:14.429472 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:14.429425    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-86ddb7bc6-tk8sx" podStartSLOduration=2.429409609 podStartE2EDuration="2.429409609s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:15:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:15:14.429396185 +0000 UTC m=+269.619098847" watchObservedRunningTime="2026-07-02 17:15:14.429409609 +0000 UTC m=+269.619112252"
Jul 02 17:15:16.204697 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:16.204647    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:16.366229 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:16.366196    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:16.641242 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:16.641203    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:18.283239 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:18.283205    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:18.351148 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:18.351119    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:22.509374 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:22.509336    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:22.610778 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:22.610740    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:22.669121 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:22.669090    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:22.912568 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:22.912480    2578 patch_prober.go:28] interesting pod/image-registry-6b64bb69f7-cvlj6 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 02 17:15:22.912720 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:22.912558    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6b64bb69f7-cvlj6" podUID="30e7892b-fe20-48ab-adbd-a13b8756a114" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 17:15:24.668553 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:24.668512    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:24.721280 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:24.721238    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:27.074646 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:15:27.074606    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-cfxt6" podUID="2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9"
Jul 02 17:15:27.457692 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:27.457619    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cfxt6"
Jul 02 17:15:29.116338 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:29.116301    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:29.216535 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:29.216486    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:30.930816 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:30.930728    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9-metrics-tls\") pod \"dns-default-cfxt6\" (UID: \"2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9\") " pod="openshift-dns/dns-default-cfxt6"
Jul 02 17:15:30.933589 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:30.933557    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9-metrics-tls\") pod \"dns-default-cfxt6\" (UID: \"2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9\") " pod="openshift-dns/dns-default-cfxt6"
Jul 02 17:15:31.061436 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:31.061408    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wfcqg\""
Jul 02 17:15:31.069695 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:31.069659    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cfxt6"
Jul 02 17:15:31.217505 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:31.217432    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cfxt6"]
Jul 02 17:15:31.220991 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:15:31.220958    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a55b3f2_cdc0_47e0_97fe_052fc86ba3f9.slice/crio-82d9fa955331213aab9f2084299cfe15aeeb69b78815f3334362c192d32761c9 WatchSource:0}: Error finding container 82d9fa955331213aab9f2084299cfe15aeeb69b78815f3334362c192d32761c9: Status 404 returned error can't find the container with id 82d9fa955331213aab9f2084299cfe15aeeb69b78815f3334362c192d32761c9
Jul 02 17:15:31.472843 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:31.472782    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5499b6fb8f-q7nf2" event={"ID":"ab1e6175-b825-4fec-87cb-5eed477ccd71","Type":"ContainerStarted","Data":"3463099ddc89f8139ac573426c6ed47d665c69cfabf565cdff0b2f62a1422b7f"}
Jul 02 17:15:31.473061 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:31.472960    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5499b6fb8f-q7nf2"
Jul 02 17:15:31.474287 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:31.474255    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cfxt6" event={"ID":"2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9","Type":"ContainerStarted","Data":"82d9fa955331213aab9f2084299cfe15aeeb69b78815f3334362c192d32761c9"}
Jul 02 17:15:31.491925 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:31.491872    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5499b6fb8f-q7nf2" podStartSLOduration=2.408191045 podStartE2EDuration="19.491853776s" totalImagesPullingTime="17.083662731s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:15:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:15:31.490178743 +0000 UTC m=+286.679881397" watchObservedRunningTime="2026-07-02 17:15:31.491853776 +0000 UTC m=+286.681556439"
Jul 02 17:15:31.495083 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:31.495063    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5499b6fb8f-q7nf2"
Jul 02 17:15:32.680310 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:32.680250    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:32.744086 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:32.743977    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:32.913275 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:32.913238    2578 patch_prober.go:28] interesting pod/image-registry-6b64bb69f7-cvlj6 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 02 17:15:32.913520 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:32.913297    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6b64bb69f7-cvlj6" podUID="30e7892b-fe20-48ab-adbd-a13b8756a114" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 17:15:33.253458 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:33.253419    2578 patch_prober.go:28] interesting pod/image-registry-86ddb7bc6-tk8sx container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 02 17:15:33.253631 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:33.253473    2578 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-86ddb7bc6-tk8sx" podUID="25f8baf0-6658-4bc0-bbb4-85d02f461241" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 17:15:33.516332 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:33.516257    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:33.575249 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:33.575215    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:34.488431 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:34.488398    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cfxt6" event={"ID":"2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9","Type":"ContainerStarted","Data":"f00c8c5f8eb60c314f6648045503bbb9d8c889e93c951cca46a50d289e39d0f4"}
Jul 02 17:15:34.488966 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:34.488448    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cfxt6" event={"ID":"2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9","Type":"ContainerStarted","Data":"db20edecc0c0bc0440de8cbcd694ee0ae7c8aceacd9b5ad4517e3e9df2bbca10"}
Jul 02 17:15:34.488966 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:34.488497    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-cfxt6"
Jul 02 17:15:34.493860 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:34.493831    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:34.510227 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:34.510184    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-cfxt6" podStartSLOduration=252.083758244 podStartE2EDuration="4m14.510166321s" totalImagesPullingTime="2.426408077s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:11:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:15:34.508084284 +0000 UTC m=+289.697786947" watchObservedRunningTime="2026-07-02 17:15:34.510166321 +0000 UTC m=+289.699868987"
Jul 02 17:15:34.601495 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:34.601455    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:35.420226 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:35.420189    2578 patch_prober.go:28] interesting pod/image-registry-86ddb7bc6-tk8sx container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 02 17:15:35.420410 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:35.420249    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-86ddb7bc6-tk8sx" podUID="25f8baf0-6658-4bc0-bbb4-85d02f461241" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 17:15:35.963493 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:35.963457    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:36.065390 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:36.065355    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:36.135892 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:36.135826    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:36.399686 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:36.399650    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:36.501294 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:36.501236    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:36.863655 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:36.863619    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:37.926803 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:37.926760    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6b64bb69f7-cvlj6" podUID="30e7892b-fe20-48ab-adbd-a13b8756a114" containerName="registry" containerID="cri-o://92159c3c3bb0fb9e9c71e6ce7722bd923da52bb4dd50efc667ec2d6b47d3decd" gracePeriod=30
Jul 02 17:15:38.208977 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:38.208951    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b64bb69f7-cvlj6"
Jul 02 17:15:38.290076 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:38.290036    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/30e7892b-fe20-48ab-adbd-a13b8756a114-ca-trust-extracted\") pod \"30e7892b-fe20-48ab-adbd-a13b8756a114\" (UID: \"30e7892b-fe20-48ab-adbd-a13b8756a114\") "
Jul 02 17:15:38.290234 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:38.290086    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/30e7892b-fe20-48ab-adbd-a13b8756a114-registry-certificates\") pod \"30e7892b-fe20-48ab-adbd-a13b8756a114\" (UID: \"30e7892b-fe20-48ab-adbd-a13b8756a114\") "
Jul 02 17:15:38.290234 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:38.290133    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/30e7892b-fe20-48ab-adbd-a13b8756a114-installation-pull-secrets\") pod \"30e7892b-fe20-48ab-adbd-a13b8756a114\" (UID: \"30e7892b-fe20-48ab-adbd-a13b8756a114\") "
Jul 02 17:15:38.290234 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:38.290165    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/30e7892b-fe20-48ab-adbd-a13b8756a114-trusted-ca\") pod \"30e7892b-fe20-48ab-adbd-a13b8756a114\" (UID: \"30e7892b-fe20-48ab-adbd-a13b8756a114\") "
Jul 02 17:15:38.290234 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:38.290196    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/30e7892b-fe20-48ab-adbd-a13b8756a114-bound-sa-token\") pod \"30e7892b-fe20-48ab-adbd-a13b8756a114\" (UID: \"30e7892b-fe20-48ab-adbd-a13b8756a114\") "
Jul 02 17:15:38.290234 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:38.290231    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/30e7892b-fe20-48ab-adbd-a13b8756a114-image-registry-private-configuration\") pod \"30e7892b-fe20-48ab-adbd-a13b8756a114\" (UID: \"30e7892b-fe20-48ab-adbd-a13b8756a114\") "
Jul 02 17:15:38.290492 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:38.290279    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/30e7892b-fe20-48ab-adbd-a13b8756a114-registry-tls\") pod \"30e7892b-fe20-48ab-adbd-a13b8756a114\" (UID: \"30e7892b-fe20-48ab-adbd-a13b8756a114\") "
Jul 02 17:15:38.290492 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:38.290319    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2bt4b\" (UniqueName: \"kubernetes.io/projected/30e7892b-fe20-48ab-adbd-a13b8756a114-kube-api-access-2bt4b\") pod \"30e7892b-fe20-48ab-adbd-a13b8756a114\" (UID: \"30e7892b-fe20-48ab-adbd-a13b8756a114\") "
Jul 02 17:15:38.290492 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:38.290464    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30e7892b-fe20-48ab-adbd-a13b8756a114-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "30e7892b-fe20-48ab-adbd-a13b8756a114" (UID: "30e7892b-fe20-48ab-adbd-a13b8756a114"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 17:15:38.290646 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:38.290532    2578 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/30e7892b-fe20-48ab-adbd-a13b8756a114-registry-certificates\") on node \"ip-10-0-143-67.ec2.internal\" DevicePath \"\""
Jul 02 17:15:38.290820 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:38.290786    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30e7892b-fe20-48ab-adbd-a13b8756a114-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "30e7892b-fe20-48ab-adbd-a13b8756a114" (UID: "30e7892b-fe20-48ab-adbd-a13b8756a114"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 17:15:38.293338 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:38.293310    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30e7892b-fe20-48ab-adbd-a13b8756a114-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "30e7892b-fe20-48ab-adbd-a13b8756a114" (UID: "30e7892b-fe20-48ab-adbd-a13b8756a114"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 17:15:38.293456 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:38.293338    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30e7892b-fe20-48ab-adbd-a13b8756a114-kube-api-access-2bt4b" (OuterVolumeSpecName: "kube-api-access-2bt4b") pod "30e7892b-fe20-48ab-adbd-a13b8756a114" (UID: "30e7892b-fe20-48ab-adbd-a13b8756a114"). InnerVolumeSpecName "kube-api-access-2bt4b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 17:15:38.293759 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:38.293733    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30e7892b-fe20-48ab-adbd-a13b8756a114-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "30e7892b-fe20-48ab-adbd-a13b8756a114" (UID: "30e7892b-fe20-48ab-adbd-a13b8756a114"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 17:15:38.293981 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:38.293950    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30e7892b-fe20-48ab-adbd-a13b8756a114-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "30e7892b-fe20-48ab-adbd-a13b8756a114" (UID: "30e7892b-fe20-48ab-adbd-a13b8756a114"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 17:15:38.294705 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:38.294677    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30e7892b-fe20-48ab-adbd-a13b8756a114-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "30e7892b-fe20-48ab-adbd-a13b8756a114" (UID: "30e7892b-fe20-48ab-adbd-a13b8756a114"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 17:15:38.302639 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:38.302618    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30e7892b-fe20-48ab-adbd-a13b8756a114-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "30e7892b-fe20-48ab-adbd-a13b8756a114" (UID: "30e7892b-fe20-48ab-adbd-a13b8756a114"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:15:38.391844 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:38.391800    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2bt4b\" (UniqueName: \"kubernetes.io/projected/30e7892b-fe20-48ab-adbd-a13b8756a114-kube-api-access-2bt4b\") on node \"ip-10-0-143-67.ec2.internal\" DevicePath \"\""
Jul 02 17:15:38.391844 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:38.391839    2578 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/30e7892b-fe20-48ab-adbd-a13b8756a114-ca-trust-extracted\") on node \"ip-10-0-143-67.ec2.internal\" DevicePath \"\""
Jul 02 17:15:38.392009 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:38.391853    2578 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/30e7892b-fe20-48ab-adbd-a13b8756a114-installation-pull-secrets\") on node \"ip-10-0-143-67.ec2.internal\" DevicePath \"\""
Jul 02 17:15:38.392009 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:38.391866    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/30e7892b-fe20-48ab-adbd-a13b8756a114-trusted-ca\") on node \"ip-10-0-143-67.ec2.internal\" DevicePath \"\""
Jul 02 17:15:38.392009 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:38.391880    2578 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/30e7892b-fe20-48ab-adbd-a13b8756a114-bound-sa-token\") on node \"ip-10-0-143-67.ec2.internal\" DevicePath \"\""
Jul 02 17:15:38.392009 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:38.391892    2578 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/30e7892b-fe20-48ab-adbd-a13b8756a114-image-registry-private-configuration\") on node \"ip-10-0-143-67.ec2.internal\" DevicePath \"\""
Jul 02 17:15:38.392009 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:38.391904    2578 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/30e7892b-fe20-48ab-adbd-a13b8756a114-registry-tls\") on node \"ip-10-0-143-67.ec2.internal\" DevicePath \"\""
Jul 02 17:15:38.505036 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:38.504992    2578 generic.go:356] "Generic (PLEG): container finished" podID="30e7892b-fe20-48ab-adbd-a13b8756a114" containerID="92159c3c3bb0fb9e9c71e6ce7722bd923da52bb4dd50efc667ec2d6b47d3decd" exitCode=0
Jul 02 17:15:38.505191 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:38.505045    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b64bb69f7-cvlj6" event={"ID":"30e7892b-fe20-48ab-adbd-a13b8756a114","Type":"ContainerDied","Data":"92159c3c3bb0fb9e9c71e6ce7722bd923da52bb4dd50efc667ec2d6b47d3decd"}
Jul 02 17:15:38.505191 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:38.505057    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b64bb69f7-cvlj6"
Jul 02 17:15:38.505191 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:38.505083    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b64bb69f7-cvlj6" event={"ID":"30e7892b-fe20-48ab-adbd-a13b8756a114","Type":"ContainerDied","Data":"ad3ed4a5dcd01c4470e4ddc2db1f847de8ba39e8f50c9017a712a08954f35aa8"}
Jul 02 17:15:38.505191 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:38.505110    2578 scope.go:117] "RemoveContainer" containerID="92159c3c3bb0fb9e9c71e6ce7722bd923da52bb4dd50efc667ec2d6b47d3decd"
Jul 02 17:15:38.514637 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:38.514619    2578 scope.go:117] "RemoveContainer" containerID="92159c3c3bb0fb9e9c71e6ce7722bd923da52bb4dd50efc667ec2d6b47d3decd"
Jul 02 17:15:38.514968 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:15:38.514940    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92159c3c3bb0fb9e9c71e6ce7722bd923da52bb4dd50efc667ec2d6b47d3decd\": container with ID starting with 92159c3c3bb0fb9e9c71e6ce7722bd923da52bb4dd50efc667ec2d6b47d3decd not found: ID does not exist" containerID="92159c3c3bb0fb9e9c71e6ce7722bd923da52bb4dd50efc667ec2d6b47d3decd"
Jul 02 17:15:38.515091 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:38.514977    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92159c3c3bb0fb9e9c71e6ce7722bd923da52bb4dd50efc667ec2d6b47d3decd"} err="failed to get container status \"92159c3c3bb0fb9e9c71e6ce7722bd923da52bb4dd50efc667ec2d6b47d3decd\": rpc error: code = NotFound desc = could not find container \"92159c3c3bb0fb9e9c71e6ce7722bd923da52bb4dd50efc667ec2d6b47d3decd\": container with ID starting with 92159c3c3bb0fb9e9c71e6ce7722bd923da52bb4dd50efc667ec2d6b47d3decd not found: ID does not exist"
Jul 02 17:15:38.527615 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:38.527592    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6b64bb69f7-cvlj6"]
Jul 02 17:15:38.531516 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:38.531497    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6b64bb69f7-cvlj6"]
Jul 02 17:15:39.494487 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:39.494455    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30e7892b-fe20-48ab-adbd-a13b8756a114" path="/var/lib/kubelet/pods/30e7892b-fe20-48ab-adbd-a13b8756a114/volumes"
Jul 02 17:15:39.854526 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:39.854454    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:41.491565 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:15:41.491532    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-g67j2" podUID="d1d3526d-01f3-4e77-a78e-ac8954a7a207"
Jul 02 17:15:42.335035 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:42.334961    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:42.435072 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:42.435045    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:42.541472 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:42.541431    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:42.617676 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:42.617608    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:42.725893 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:42.725856    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:42.779617 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:42.777583    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-kvz2k"]
Jul 02 17:15:42.779617 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:42.778102    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30e7892b-fe20-48ab-adbd-a13b8756a114" containerName="registry"
Jul 02 17:15:42.779617 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:42.778120    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="30e7892b-fe20-48ab-adbd-a13b8756a114" containerName="registry"
Jul 02 17:15:42.779617 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:42.778252    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="30e7892b-fe20-48ab-adbd-a13b8756a114" containerName="registry"
Jul 02 17:15:42.818242 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:42.818210    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:42.866830 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:42.866802    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-845b954455-fdfvp"]
Jul 02 17:15:42.866949 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:42.866913    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-kvz2k"
Jul 02 17:15:42.870208 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:42.870157    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 02 17:15:42.870389 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:42.870352    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 02 17:15:42.870468 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:42.870457    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 02 17:15:42.870525 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:42.870509    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 02 17:15:42.871548 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:42.871531    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 02 17:15:42.871626 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:42.871557    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-6vldc\""
Jul 02 17:15:42.886170 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:42.886151    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-kvz2k"]
Jul 02 17:15:42.886268 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:42.886182    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-jvg8k"]
Jul 02 17:15:42.886307 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:42.886265    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-845b954455-fdfvp"
Jul 02 17:15:42.887529 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:42.887501    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:42.889052 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:42.889011    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 02 17:15:42.889153 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:42.889032    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-r22p9\""
Jul 02 17:15:42.889153 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:42.889140    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 02 17:15:42.889264 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:42.889150    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 02 17:15:42.908497 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:42.908481    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jvg8k"
Jul 02 17:15:42.908497 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:42.908488    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-845b954455-fdfvp"]
Jul 02 17:15:42.911266 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:42.911245    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 02 17:15:42.911368 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:42.911232    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 02 17:15:42.911368 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:42.911279    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 02 17:15:42.911368 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:42.911272    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-xq4xm\""
Jul 02 17:15:42.925777 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:42.925760    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2ad0a20a-c7a3-4fa9-865f-d70dbccc1c16-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-kvz2k\" (UID: \"2ad0a20a-c7a3-4fa9-865f-d70dbccc1c16\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-kvz2k"
Jul 02 17:15:42.925962 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:42.925818    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2ad0a20a-c7a3-4fa9-865f-d70dbccc1c16-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-kvz2k\" (UID: \"2ad0a20a-c7a3-4fa9-865f-d70dbccc1c16\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-kvz2k"
Jul 02 17:15:42.925962 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:42.925863    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jwdm\" (UniqueName: \"kubernetes.io/projected/2ad0a20a-c7a3-4fa9-865f-d70dbccc1c16-kube-api-access-9jwdm\") pod \"openshift-state-metrics-57f99c8b49-kvz2k\" (UID: \"2ad0a20a-c7a3-4fa9-865f-d70dbccc1c16\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-kvz2k"
Jul 02 17:15:42.925962 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:42.925916    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2ad0a20a-c7a3-4fa9-865f-d70dbccc1c16-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-kvz2k\" (UID: \"2ad0a20a-c7a3-4fa9-865f-d70dbccc1c16\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-kvz2k"
Jul 02 17:15:42.990261 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:42.990241    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:43.026673 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.026651    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/604eaa5c-b472-4d40-a129-779cbc619d09-node-exporter-tls\") pod \"node-exporter-jvg8k\" (UID: \"604eaa5c-b472-4d40-a129-779cbc619d09\") " pod="openshift-monitoring/node-exporter-jvg8k"
Jul 02 17:15:43.026764 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.026683    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2ad0a20a-c7a3-4fa9-865f-d70dbccc1c16-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-kvz2k\" (UID: \"2ad0a20a-c7a3-4fa9-865f-d70dbccc1c16\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-kvz2k"
Jul 02 17:15:43.026764 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.026714    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2ad0a20a-c7a3-4fa9-865f-d70dbccc1c16-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-kvz2k\" (UID: \"2ad0a20a-c7a3-4fa9-865f-d70dbccc1c16\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-kvz2k"
Jul 02 17:15:43.026764 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.026756    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f7c9f1d9-8c54-4374-ab66-cdf83fe8aea3-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-845b954455-fdfvp\" (UID: \"f7c9f1d9-8c54-4374-ab66-cdf83fe8aea3\") " pod="openshift-monitoring/kube-state-metrics-845b954455-fdfvp"
Jul 02 17:15:43.026923 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.026786    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/604eaa5c-b472-4d40-a129-779cbc619d09-root\") pod \"node-exporter-jvg8k\" (UID: \"604eaa5c-b472-4d40-a129-779cbc619d09\") " pod="openshift-monitoring/node-exporter-jvg8k"
Jul 02 17:15:43.026923 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.026813    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/604eaa5c-b472-4d40-a129-779cbc619d09-node-exporter-textfile\") pod \"node-exporter-jvg8k\" (UID: \"604eaa5c-b472-4d40-a129-779cbc619d09\") " pod="openshift-monitoring/node-exporter-jvg8k"
Jul 02 17:15:43.026923 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.026837    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/604eaa5c-b472-4d40-a129-779cbc619d09-node-exporter-accelerators-collector-config\") pod \"node-exporter-jvg8k\" (UID: \"604eaa5c-b472-4d40-a129-779cbc619d09\") " pod="openshift-monitoring/node-exporter-jvg8k"
Jul 02 17:15:43.026923 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.026867    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f7c9f1d9-8c54-4374-ab66-cdf83fe8aea3-metrics-client-ca\") pod \"kube-state-metrics-845b954455-fdfvp\" (UID: \"f7c9f1d9-8c54-4374-ab66-cdf83fe8aea3\") " pod="openshift-monitoring/kube-state-metrics-845b954455-fdfvp"
Jul 02 17:15:43.026923 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.026893    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f7c9f1d9-8c54-4374-ab66-cdf83fe8aea3-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-845b954455-fdfvp\" (UID: \"f7c9f1d9-8c54-4374-ab66-cdf83fe8aea3\") " pod="openshift-monitoring/kube-state-metrics-845b954455-fdfvp"
Jul 02 17:15:43.027162 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.026928    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/604eaa5c-b472-4d40-a129-779cbc619d09-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jvg8k\" (UID: \"604eaa5c-b472-4d40-a129-779cbc619d09\") " pod="openshift-monitoring/node-exporter-jvg8k"
Jul 02 17:15:43.027162 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.026970    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-478ss\" (UniqueName: \"kubernetes.io/projected/f7c9f1d9-8c54-4374-ab66-cdf83fe8aea3-kube-api-access-478ss\") pod \"kube-state-metrics-845b954455-fdfvp\" (UID: \"f7c9f1d9-8c54-4374-ab66-cdf83fe8aea3\") " pod="openshift-monitoring/kube-state-metrics-845b954455-fdfvp"
Jul 02 17:15:43.027162 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.027001    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/604eaa5c-b472-4d40-a129-779cbc619d09-node-exporter-wtmp\") pod \"node-exporter-jvg8k\" (UID: \"604eaa5c-b472-4d40-a129-779cbc619d09\") " pod="openshift-monitoring/node-exporter-jvg8k"
Jul 02 17:15:43.027162 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.027082    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f7c9f1d9-8c54-4374-ab66-cdf83fe8aea3-volume-directive-shadow\") pod \"kube-state-metrics-845b954455-fdfvp\" (UID: \"f7c9f1d9-8c54-4374-ab66-cdf83fe8aea3\") " pod="openshift-monitoring/kube-state-metrics-845b954455-fdfvp"
Jul 02 17:15:43.027162 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.027137    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jwdm\" (UniqueName: \"kubernetes.io/projected/2ad0a20a-c7a3-4fa9-865f-d70dbccc1c16-kube-api-access-9jwdm\") pod \"openshift-state-metrics-57f99c8b49-kvz2k\" (UID: \"2ad0a20a-c7a3-4fa9-865f-d70dbccc1c16\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-kvz2k"
Jul 02 17:15:43.027353 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.027168    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f7c9f1d9-8c54-4374-ab66-cdf83fe8aea3-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-fdfvp\" (UID: \"f7c9f1d9-8c54-4374-ab66-cdf83fe8aea3\") " pod="openshift-monitoring/kube-state-metrics-845b954455-fdfvp"
Jul 02 17:15:43.027353 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.027201    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/604eaa5c-b472-4d40-a129-779cbc619d09-sys\") pod \"node-exporter-jvg8k\" (UID: \"604eaa5c-b472-4d40-a129-779cbc619d09\") " pod="openshift-monitoring/node-exporter-jvg8k"
Jul 02 17:15:43.027353 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.027235    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/604eaa5c-b472-4d40-a129-779cbc619d09-metrics-client-ca\") pod \"node-exporter-jvg8k\" (UID: \"604eaa5c-b472-4d40-a129-779cbc619d09\") " pod="openshift-monitoring/node-exporter-jvg8k"
Jul 02 17:15:43.027353 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.027270    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4cpd\" (UniqueName: \"kubernetes.io/projected/604eaa5c-b472-4d40-a129-779cbc619d09-kube-api-access-s4cpd\") pod \"node-exporter-jvg8k\" (UID: \"604eaa5c-b472-4d40-a129-779cbc619d09\") " pod="openshift-monitoring/node-exporter-jvg8k"
Jul 02 17:15:43.027353 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.027301    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2ad0a20a-c7a3-4fa9-865f-d70dbccc1c16-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-kvz2k\" (UID: \"2ad0a20a-c7a3-4fa9-865f-d70dbccc1c16\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-kvz2k"
Jul 02 17:15:43.027530 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.027392    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2ad0a20a-c7a3-4fa9-865f-d70dbccc1c16-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-kvz2k\" (UID: \"2ad0a20a-c7a3-4fa9-865f-d70dbccc1c16\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-kvz2k"
Jul 02 17:15:43.029130 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.029105    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2ad0a20a-c7a3-4fa9-865f-d70dbccc1c16-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-kvz2k\" (UID: \"2ad0a20a-c7a3-4fa9-865f-d70dbccc1c16\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-kvz2k"
Jul 02 17:15:43.029427 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.029411    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2ad0a20a-c7a3-4fa9-865f-d70dbccc1c16-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-kvz2k\" (UID: \"2ad0a20a-c7a3-4fa9-865f-d70dbccc1c16\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-kvz2k"
Jul 02 17:15:43.036231 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.036207    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jwdm\" (UniqueName: \"kubernetes.io/projected/2ad0a20a-c7a3-4fa9-865f-d70dbccc1c16-kube-api-access-9jwdm\") pod \"openshift-state-metrics-57f99c8b49-kvz2k\" (UID: \"2ad0a20a-c7a3-4fa9-865f-d70dbccc1c16\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-kvz2k"
Jul 02 17:15:43.087994 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.087972    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:43.128060 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.127996    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f7c9f1d9-8c54-4374-ab66-cdf83fe8aea3-volume-directive-shadow\") pod \"kube-state-metrics-845b954455-fdfvp\" (UID: \"f7c9f1d9-8c54-4374-ab66-cdf83fe8aea3\") " pod="openshift-monitoring/kube-state-metrics-845b954455-fdfvp"
Jul 02 17:15:43.128060 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.128044    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f7c9f1d9-8c54-4374-ab66-cdf83fe8aea3-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-fdfvp\" (UID: \"f7c9f1d9-8c54-4374-ab66-cdf83fe8aea3\") " pod="openshift-monitoring/kube-state-metrics-845b954455-fdfvp"
Jul 02 17:15:43.128193 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.128065    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/604eaa5c-b472-4d40-a129-779cbc619d09-sys\") pod \"node-exporter-jvg8k\" (UID: \"604eaa5c-b472-4d40-a129-779cbc619d09\") " pod="openshift-monitoring/node-exporter-jvg8k"
Jul 02 17:15:43.128193 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.128083    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/604eaa5c-b472-4d40-a129-779cbc619d09-metrics-client-ca\") pod \"node-exporter-jvg8k\" (UID: \"604eaa5c-b472-4d40-a129-779cbc619d09\") " pod="openshift-monitoring/node-exporter-jvg8k"
Jul 02 17:15:43.128193 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.128106    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4cpd\" (UniqueName: \"kubernetes.io/projected/604eaa5c-b472-4d40-a129-779cbc619d09-kube-api-access-s4cpd\") pod \"node-exporter-jvg8k\" (UID: \"604eaa5c-b472-4d40-a129-779cbc619d09\") " pod="openshift-monitoring/node-exporter-jvg8k"
Jul 02 17:15:43.128193 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.128132    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/604eaa5c-b472-4d40-a129-779cbc619d09-node-exporter-tls\") pod \"node-exporter-jvg8k\" (UID: \"604eaa5c-b472-4d40-a129-779cbc619d09\") " pod="openshift-monitoring/node-exporter-jvg8k"
Jul 02 17:15:43.128193 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.128157    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/604eaa5c-b472-4d40-a129-779cbc619d09-sys\") pod \"node-exporter-jvg8k\" (UID: \"604eaa5c-b472-4d40-a129-779cbc619d09\") " pod="openshift-monitoring/node-exporter-jvg8k"
Jul 02 17:15:43.128428 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:15:43.128218    2578 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 02 17:15:43.128428 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:15:43.128298    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7c9f1d9-8c54-4374-ab66-cdf83fe8aea3-kube-state-metrics-tls podName:f7c9f1d9-8c54-4374-ab66-cdf83fe8aea3 nodeName:}" failed. No retries permitted until 2026-07-02 17:15:43.628251662 +0000 UTC m=+298.817954315 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/f7c9f1d9-8c54-4374-ab66-cdf83fe8aea3-kube-state-metrics-tls") pod "kube-state-metrics-845b954455-fdfvp" (UID: "f7c9f1d9-8c54-4374-ab66-cdf83fe8aea3") : secret "kube-state-metrics-tls" not found
Jul 02 17:15:43.128428 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.128341    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f7c9f1d9-8c54-4374-ab66-cdf83fe8aea3-volume-directive-shadow\") pod \"kube-state-metrics-845b954455-fdfvp\" (UID: \"f7c9f1d9-8c54-4374-ab66-cdf83fe8aea3\") " pod="openshift-monitoring/kube-state-metrics-845b954455-fdfvp"
Jul 02 17:15:43.128428 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.128342    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f7c9f1d9-8c54-4374-ab66-cdf83fe8aea3-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-845b954455-fdfvp\" (UID: \"f7c9f1d9-8c54-4374-ab66-cdf83fe8aea3\") " pod="openshift-monitoring/kube-state-metrics-845b954455-fdfvp"
Jul 02 17:15:43.128428 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.128394    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/604eaa5c-b472-4d40-a129-779cbc619d09-root\") pod \"node-exporter-jvg8k\" (UID: \"604eaa5c-b472-4d40-a129-779cbc619d09\") " pod="openshift-monitoring/node-exporter-jvg8k"
Jul 02 17:15:43.128428 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.128427    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/604eaa5c-b472-4d40-a129-779cbc619d09-node-exporter-textfile\") pod \"node-exporter-jvg8k\" (UID: \"604eaa5c-b472-4d40-a129-779cbc619d09\") " pod="openshift-monitoring/node-exporter-jvg8k"
Jul 02 17:15:43.128727 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.128441    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/604eaa5c-b472-4d40-a129-779cbc619d09-root\") pod \"node-exporter-jvg8k\" (UID: \"604eaa5c-b472-4d40-a129-779cbc619d09\") " pod="openshift-monitoring/node-exporter-jvg8k"
Jul 02 17:15:43.128727 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.128456    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/604eaa5c-b472-4d40-a129-779cbc619d09-node-exporter-accelerators-collector-config\") pod \"node-exporter-jvg8k\" (UID: \"604eaa5c-b472-4d40-a129-779cbc619d09\") " pod="openshift-monitoring/node-exporter-jvg8k"
Jul 02 17:15:43.128727 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.128492    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f7c9f1d9-8c54-4374-ab66-cdf83fe8aea3-metrics-client-ca\") pod \"kube-state-metrics-845b954455-fdfvp\" (UID: \"f7c9f1d9-8c54-4374-ab66-cdf83fe8aea3\") " pod="openshift-monitoring/kube-state-metrics-845b954455-fdfvp"
Jul 02 17:15:43.128727 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.128601    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f7c9f1d9-8c54-4374-ab66-cdf83fe8aea3-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-845b954455-fdfvp\" (UID: \"f7c9f1d9-8c54-4374-ab66-cdf83fe8aea3\") " pod="openshift-monitoring/kube-state-metrics-845b954455-fdfvp"
Jul 02 17:15:43.128727 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.128625    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/604eaa5c-b472-4d40-a129-779cbc619d09-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jvg8k\" (UID: \"604eaa5c-b472-4d40-a129-779cbc619d09\") " pod="openshift-monitoring/node-exporter-jvg8k"
Jul 02 17:15:43.128727 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.128650    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-478ss\" (UniqueName: \"kubernetes.io/projected/f7c9f1d9-8c54-4374-ab66-cdf83fe8aea3-kube-api-access-478ss\") pod \"kube-state-metrics-845b954455-fdfvp\" (UID: \"f7c9f1d9-8c54-4374-ab66-cdf83fe8aea3\") " pod="openshift-monitoring/kube-state-metrics-845b954455-fdfvp"
Jul 02 17:15:43.128727 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.128692    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/604eaa5c-b472-4d40-a129-779cbc619d09-node-exporter-wtmp\") pod \"node-exporter-jvg8k\" (UID: \"604eaa5c-b472-4d40-a129-779cbc619d09\") " pod="openshift-monitoring/node-exporter-jvg8k"
Jul 02 17:15:43.129107 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.128732    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/604eaa5c-b472-4d40-a129-779cbc619d09-metrics-client-ca\") pod \"node-exporter-jvg8k\" (UID: \"604eaa5c-b472-4d40-a129-779cbc619d09\") " pod="openshift-monitoring/node-exporter-jvg8k"
Jul 02 17:15:43.129107 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.128776    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/604eaa5c-b472-4d40-a129-779cbc619d09-node-exporter-textfile\") pod \"node-exporter-jvg8k\" (UID: \"604eaa5c-b472-4d40-a129-779cbc619d09\") " pod="openshift-monitoring/node-exporter-jvg8k"
Jul 02 17:15:43.129107 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.128886    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/604eaa5c-b472-4d40-a129-779cbc619d09-node-exporter-wtmp\") pod \"node-exporter-jvg8k\" (UID: \"604eaa5c-b472-4d40-a129-779cbc619d09\") " pod="openshift-monitoring/node-exporter-jvg8k"
Jul 02 17:15:43.129107 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.128931    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/604eaa5c-b472-4d40-a129-779cbc619d09-node-exporter-accelerators-collector-config\") pod \"node-exporter-jvg8k\" (UID: \"604eaa5c-b472-4d40-a129-779cbc619d09\") " pod="openshift-monitoring/node-exporter-jvg8k"
Jul 02 17:15:43.129283 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.129175    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f7c9f1d9-8c54-4374-ab66-cdf83fe8aea3-metrics-client-ca\") pod \"kube-state-metrics-845b954455-fdfvp\" (UID: \"f7c9f1d9-8c54-4374-ab66-cdf83fe8aea3\") " pod="openshift-monitoring/kube-state-metrics-845b954455-fdfvp"
Jul 02 17:15:43.129283 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.129249    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f7c9f1d9-8c54-4374-ab66-cdf83fe8aea3-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-845b954455-fdfvp\" (UID: \"f7c9f1d9-8c54-4374-ab66-cdf83fe8aea3\") " pod="openshift-monitoring/kube-state-metrics-845b954455-fdfvp"
Jul 02 17:15:43.130882 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.130858    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/604eaa5c-b472-4d40-a129-779cbc619d09-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jvg8k\" (UID: \"604eaa5c-b472-4d40-a129-779cbc619d09\") " pod="openshift-monitoring/node-exporter-jvg8k"
Jul 02 17:15:43.130967 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.130932    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f7c9f1d9-8c54-4374-ab66-cdf83fe8aea3-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-845b954455-fdfvp\" (UID: \"f7c9f1d9-8c54-4374-ab66-cdf83fe8aea3\") " pod="openshift-monitoring/kube-state-metrics-845b954455-fdfvp"
Jul 02 17:15:43.131101 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.131084    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/604eaa5c-b472-4d40-a129-779cbc619d09-node-exporter-tls\") pod \"node-exporter-jvg8k\" (UID: \"604eaa5c-b472-4d40-a129-779cbc619d09\") " pod="openshift-monitoring/node-exporter-jvg8k"
Jul 02 17:15:43.135782 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.135759    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4cpd\" (UniqueName: \"kubernetes.io/projected/604eaa5c-b472-4d40-a129-779cbc619d09-kube-api-access-s4cpd\") pod \"node-exporter-jvg8k\" (UID: \"604eaa5c-b472-4d40-a129-779cbc619d09\") " pod="openshift-monitoring/node-exporter-jvg8k"
Jul 02 17:15:43.136619 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.136604    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-478ss\" (UniqueName: \"kubernetes.io/projected/f7c9f1d9-8c54-4374-ab66-cdf83fe8aea3-kube-api-access-478ss\") pod \"kube-state-metrics-845b954455-fdfvp\" (UID: \"f7c9f1d9-8c54-4374-ab66-cdf83fe8aea3\") " pod="openshift-monitoring/kube-state-metrics-845b954455-fdfvp"
Jul 02 17:15:43.175448 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.175428    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-kvz2k"
Jul 02 17:15:43.187909 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.187885    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:43.216400 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.216381    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jvg8k"
Jul 02 17:15:43.244982 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:15:43.244960    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod604eaa5c_b472_4d40_a129_779cbc619d09.slice/crio-86f77f23729aa834ba22d62c3a0424b8a2de56c733f19268a9b38961332c915d WatchSource:0}: Error finding container 86f77f23729aa834ba22d62c3a0424b8a2de56c733f19268a9b38961332c915d: Status 404 returned error can't find the container with id 86f77f23729aa834ba22d62c3a0424b8a2de56c733f19268a9b38961332c915d
Jul 02 17:15:43.254915 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.254882    2578 patch_prober.go:28] interesting pod/image-registry-86ddb7bc6-tk8sx container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 02 17:15:43.255084 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.254942    2578 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-86ddb7bc6-tk8sx" podUID="25f8baf0-6658-4bc0-bbb4-85d02f461241" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 17:15:43.288175 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.288147    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:43.324718 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.324692    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-kvz2k"]
Jul 02 17:15:43.327399 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:15:43.327376    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ad0a20a_c7a3_4fa9_865f_d70dbccc1c16.slice/crio-11e48d3a6c570d166232d59d4d3b915999466ffbf0c3ee79538aa33b421daf6e WatchSource:0}: Error finding container 11e48d3a6c570d166232d59d4d3b915999466ffbf0c3ee79538aa33b421daf6e: Status 404 returned error can't find the container with id 11e48d3a6c570d166232d59d4d3b915999466ffbf0c3ee79538aa33b421daf6e
Jul 02 17:15:43.387615 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.387541    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:43.487778 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.487744    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:43.524837 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.524814    2578 generic.go:356] "Generic (PLEG): container finished" podID="28f6fd07-b48d-428c-8ff7-0ca6eb257587" containerID="d1e202c509cbfbd73280485769e3e70b1125cab9e8000b8368a156c91300589c" exitCode=255
Jul 02 17:15:43.524947 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.524885    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59948b9d98-xlbss" event={"ID":"28f6fd07-b48d-428c-8ff7-0ca6eb257587","Type":"ContainerDied","Data":"d1e202c509cbfbd73280485769e3e70b1125cab9e8000b8368a156c91300589c"}
Jul 02 17:15:43.524947 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.524929    2578 scope.go:117] "RemoveContainer" containerID="84916d15e63dceaed62da3c1f727548292b84dd0a24729444633d8f7369825f1"
Jul 02 17:15:43.526059 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.526042    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jvg8k" event={"ID":"604eaa5c-b472-4d40-a129-779cbc619d09","Type":"ContainerStarted","Data":"86f77f23729aa834ba22d62c3a0424b8a2de56c733f19268a9b38961332c915d"}
Jul 02 17:15:43.527588 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.527568    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-kvz2k" event={"ID":"2ad0a20a-c7a3-4fa9-865f-d70dbccc1c16","Type":"ContainerStarted","Data":"0345118c5099eda65af5576990e55d200892d0fbb8d8e9a271a2542b2dd9f2f7"}
Jul 02 17:15:43.527688 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.527609    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-kvz2k" event={"ID":"2ad0a20a-c7a3-4fa9-865f-d70dbccc1c16","Type":"ContainerStarted","Data":"11e48d3a6c570d166232d59d4d3b915999466ffbf0c3ee79538aa33b421daf6e"}
Jul 02 17:15:43.530955 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.530942    2578 scope.go:117] "RemoveContainer" containerID="d1e202c509cbfbd73280485769e3e70b1125cab9e8000b8368a156c91300589c"
Jul 02 17:15:43.531111 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:15:43.531094    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-59948b9d98-xlbss_open-cluster-management-agent-addon(28f6fd07-b48d-428c-8ff7-0ca6eb257587)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59948b9d98-xlbss" podUID="28f6fd07-b48d-428c-8ff7-0ca6eb257587"
Jul 02 17:15:43.605950 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.605922    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:43.632128 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.632106    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f7c9f1d9-8c54-4374-ab66-cdf83fe8aea3-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-fdfvp\" (UID: \"f7c9f1d9-8c54-4374-ab66-cdf83fe8aea3\") " pod="openshift-monitoring/kube-state-metrics-845b954455-fdfvp"
Jul 02 17:15:43.634280 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.634262    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f7c9f1d9-8c54-4374-ab66-cdf83fe8aea3-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-fdfvp\" (UID: \"f7c9f1d9-8c54-4374-ab66-cdf83fe8aea3\") " pod="openshift-monitoring/kube-state-metrics-845b954455-fdfvp"
Jul 02 17:15:43.706723 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.706664    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:43.795411 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.795378    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-845b954455-fdfvp"
Jul 02 17:15:43.806867 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.806777    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:43.845696 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.845666    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 02 17:15:43.866247 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.866217    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 02 17:15:43.870287 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.870203    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 02 17:15:43.871132 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.871048    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 02 17:15:43.871311 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.871291    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 02 17:15:43.871442 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.871425    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-d9g8l\""
Jul 02 17:15:43.871549 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.871530    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 02 17:15:43.871760 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.871739    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 02 17:15:43.872138 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.872112    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 02 17:15:43.872402 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.872385    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 02 17:15:43.873396 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.873168    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 02 17:15:43.873504 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.873410    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 02 17:15:43.873592 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.873575    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 02 17:15:43.895595 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.895572    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:43.934401 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.934376    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0f35dce1-602e-4bd1-9b81-2834013fc9f7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0f35dce1-602e-4bd1-9b81-2834013fc9f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 17:15:43.934532 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.934447    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0f35dce1-602e-4bd1-9b81-2834013fc9f7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0f35dce1-602e-4bd1-9b81-2834013fc9f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 17:15:43.934532 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.934482    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0f35dce1-602e-4bd1-9b81-2834013fc9f7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0f35dce1-602e-4bd1-9b81-2834013fc9f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 17:15:43.934532 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.934504    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0f35dce1-602e-4bd1-9b81-2834013fc9f7-config-volume\") pod \"alertmanager-main-0\" (UID: \"0f35dce1-602e-4bd1-9b81-2834013fc9f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 17:15:43.934532 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.934527    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0f35dce1-602e-4bd1-9b81-2834013fc9f7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0f35dce1-602e-4bd1-9b81-2834013fc9f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 17:15:43.934686 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.934611    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0f35dce1-602e-4bd1-9b81-2834013fc9f7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0f35dce1-602e-4bd1-9b81-2834013fc9f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 17:15:43.934686 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.934643    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tzt5\" (UniqueName: \"kubernetes.io/projected/0f35dce1-602e-4bd1-9b81-2834013fc9f7-kube-api-access-7tzt5\") pod \"alertmanager-main-0\" (UID: \"0f35dce1-602e-4bd1-9b81-2834013fc9f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 17:15:43.934686 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.934662    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0f35dce1-602e-4bd1-9b81-2834013fc9f7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0f35dce1-602e-4bd1-9b81-2834013fc9f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 17:15:43.934825 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.934711    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0f35dce1-602e-4bd1-9b81-2834013fc9f7-web-config\") pod \"alertmanager-main-0\" (UID: \"0f35dce1-602e-4bd1-9b81-2834013fc9f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 17:15:43.934825 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.934752    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f35dce1-602e-4bd1-9b81-2834013fc9f7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0f35dce1-602e-4bd1-9b81-2834013fc9f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 17:15:43.934825 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.934815    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0f35dce1-602e-4bd1-9b81-2834013fc9f7-config-out\") pod \"alertmanager-main-0\" (UID: \"0f35dce1-602e-4bd1-9b81-2834013fc9f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 17:15:43.934941 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.934843    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0f35dce1-602e-4bd1-9b81-2834013fc9f7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0f35dce1-602e-4bd1-9b81-2834013fc9f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 17:15:43.934941 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.934869    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0f35dce1-602e-4bd1-9b81-2834013fc9f7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0f35dce1-602e-4bd1-9b81-2834013fc9f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 17:15:43.953724 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.953702    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-845b954455-fdfvp"]
Jul 02 17:15:43.955781 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:15:43.955755    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7c9f1d9_8c54_4374_ab66_cdf83fe8aea3.slice/crio-7a52fe3d5dca2b2c56b8e0caef88b680faf9a2ac1fe39150a42b092be47707b1 WatchSource:0}: Error finding container 7a52fe3d5dca2b2c56b8e0caef88b680faf9a2ac1fe39150a42b092be47707b1: Status 404 returned error can't find the container with id 7a52fe3d5dca2b2c56b8e0caef88b680faf9a2ac1fe39150a42b092be47707b1
Jul 02 17:15:43.959416 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:43.959388    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:44.036002 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:44.035979    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0f35dce1-602e-4bd1-9b81-2834013fc9f7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0f35dce1-602e-4bd1-9b81-2834013fc9f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 17:15:44.036125 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:44.036028    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tzt5\" (UniqueName: \"kubernetes.io/projected/0f35dce1-602e-4bd1-9b81-2834013fc9f7-kube-api-access-7tzt5\") pod \"alertmanager-main-0\" (UID: \"0f35dce1-602e-4bd1-9b81-2834013fc9f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 17:15:44.036125 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:44.036055    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0f35dce1-602e-4bd1-9b81-2834013fc9f7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0f35dce1-602e-4bd1-9b81-2834013fc9f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 17:15:44.036125 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:44.036079    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0f35dce1-602e-4bd1-9b81-2834013fc9f7-web-config\") pod \"alertmanager-main-0\" (UID: \"0f35dce1-602e-4bd1-9b81-2834013fc9f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 17:15:44.036285 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:44.036190    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f35dce1-602e-4bd1-9b81-2834013fc9f7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0f35dce1-602e-4bd1-9b81-2834013fc9f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 17:15:44.036285 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:44.036251    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0f35dce1-602e-4bd1-9b81-2834013fc9f7-config-out\") pod \"alertmanager-main-0\" (UID: \"0f35dce1-602e-4bd1-9b81-2834013fc9f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 17:15:44.036377 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:44.036279    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0f35dce1-602e-4bd1-9b81-2834013fc9f7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0f35dce1-602e-4bd1-9b81-2834013fc9f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 17:15:44.036377 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:44.036308    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0f35dce1-602e-4bd1-9b81-2834013fc9f7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0f35dce1-602e-4bd1-9b81-2834013fc9f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 17:15:44.036377 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:15:44.036340    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0f35dce1-602e-4bd1-9b81-2834013fc9f7-alertmanager-trusted-ca-bundle podName:0f35dce1-602e-4bd1-9b81-2834013fc9f7 nodeName:}" failed. No retries permitted until 2026-07-02 17:15:44.536319339 +0000 UTC m=+299.726022007 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/0f35dce1-602e-4bd1-9b81-2834013fc9f7-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "0f35dce1-602e-4bd1-9b81-2834013fc9f7") : configmap references non-existent config key: ca-bundle.crt
Jul 02 17:15:44.036535 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:15:44.036404    2578 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 02 17:15:44.036535 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:44.036413    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0f35dce1-602e-4bd1-9b81-2834013fc9f7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0f35dce1-602e-4bd1-9b81-2834013fc9f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 17:15:44.036535 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:44.036444    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0f35dce1-602e-4bd1-9b81-2834013fc9f7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0f35dce1-602e-4bd1-9b81-2834013fc9f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 17:15:44.036535 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:15:44.036462    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f35dce1-602e-4bd1-9b81-2834013fc9f7-secret-alertmanager-main-tls podName:0f35dce1-602e-4bd1-9b81-2834013fc9f7 nodeName:}" failed. No retries permitted until 2026-07-02 17:15:44.536438532 +0000 UTC m=+299.726141174 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/0f35dce1-602e-4bd1-9b81-2834013fc9f7-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "0f35dce1-602e-4bd1-9b81-2834013fc9f7") : secret "alertmanager-main-tls" not found
Jul 02 17:15:44.036535 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:44.036499    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0f35dce1-602e-4bd1-9b81-2834013fc9f7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0f35dce1-602e-4bd1-9b81-2834013fc9f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 17:15:44.036793 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:44.036537    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0f35dce1-602e-4bd1-9b81-2834013fc9f7-config-volume\") pod \"alertmanager-main-0\" (UID: \"0f35dce1-602e-4bd1-9b81-2834013fc9f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 17:15:44.036793 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:44.036567    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0f35dce1-602e-4bd1-9b81-2834013fc9f7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0f35dce1-602e-4bd1-9b81-2834013fc9f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 17:15:44.036993 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:44.036928    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0f35dce1-602e-4bd1-9b81-2834013fc9f7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0f35dce1-602e-4bd1-9b81-2834013fc9f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 17:15:44.037375 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:44.037349    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0f35dce1-602e-4bd1-9b81-2834013fc9f7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0f35dce1-602e-4bd1-9b81-2834013fc9f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 17:15:44.038935 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:44.038911    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0f35dce1-602e-4bd1-9b81-2834013fc9f7-web-config\") pod \"alertmanager-main-0\" (UID: \"0f35dce1-602e-4bd1-9b81-2834013fc9f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 17:15:44.039438 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:44.039387    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0f35dce1-602e-4bd1-9b81-2834013fc9f7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0f35dce1-602e-4bd1-9b81-2834013fc9f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 17:15:44.039534 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:44.039487    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0f35dce1-602e-4bd1-9b81-2834013fc9f7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0f35dce1-602e-4bd1-9b81-2834013fc9f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 17:15:44.039630 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:44.039601    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0f35dce1-602e-4bd1-9b81-2834013fc9f7-config-out\") pod \"alertmanager-main-0\" (UID: \"0f35dce1-602e-4bd1-9b81-2834013fc9f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 17:15:44.039770 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:44.039751    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0f35dce1-602e-4bd1-9b81-2834013fc9f7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0f35dce1-602e-4bd1-9b81-2834013fc9f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 17:15:44.039840 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:44.039808    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0f35dce1-602e-4bd1-9b81-2834013fc9f7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0f35dce1-602e-4bd1-9b81-2834013fc9f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 17:15:44.040414 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:44.040391    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0f35dce1-602e-4bd1-9b81-2834013fc9f7-config-volume\") pod \"alertmanager-main-0\" (UID: \"0f35dce1-602e-4bd1-9b81-2834013fc9f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 17:15:44.042556 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:44.041143    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0f35dce1-602e-4bd1-9b81-2834013fc9f7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0f35dce1-602e-4bd1-9b81-2834013fc9f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 17:15:44.049213 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:44.049191    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tzt5\" (UniqueName: \"kubernetes.io/projected/0f35dce1-602e-4bd1-9b81-2834013fc9f7-kube-api-access-7tzt5\") pod \"alertmanager-main-0\" (UID: \"0f35dce1-602e-4bd1-9b81-2834013fc9f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 17:15:44.210765 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:44.210685    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:44.494930 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:44.494907    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-cfxt6"
Jul 02 17:15:44.534079 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:44.534046    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-fdfvp" event={"ID":"f7c9f1d9-8c54-4374-ab66-cdf83fe8aea3","Type":"ContainerStarted","Data":"7a52fe3d5dca2b2c56b8e0caef88b680faf9a2ac1fe39150a42b092be47707b1"}
Jul 02 17:15:44.536181 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:44.536157    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-kvz2k" event={"ID":"2ad0a20a-c7a3-4fa9-865f-d70dbccc1c16","Type":"ContainerStarted","Data":"b5acd10b0009bc1f5d198922b04e740f94210e9425aa58e54a65a85dfa58fa31"}
Jul 02 17:15:44.540461 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:44.540431    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f35dce1-602e-4bd1-9b81-2834013fc9f7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0f35dce1-602e-4bd1-9b81-2834013fc9f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 17:15:44.540567 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:44.540473    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0f35dce1-602e-4bd1-9b81-2834013fc9f7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0f35dce1-602e-4bd1-9b81-2834013fc9f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 17:15:44.541120 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:44.541098    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f35dce1-602e-4bd1-9b81-2834013fc9f7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0f35dce1-602e-4bd1-9b81-2834013fc9f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 17:15:44.542898 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:44.542875    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0f35dce1-602e-4bd1-9b81-2834013fc9f7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0f35dce1-602e-4bd1-9b81-2834013fc9f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 17:15:44.791924 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:44.791772    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 02 17:15:44.980325 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:44.980298    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 02 17:15:44.982791 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:15:44.982758    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f35dce1_602e_4bd1_9b81_2834013fc9f7.slice/crio-a5c50b7c6c97bc63ec8b9695690ff5876921454f4a9aea87d0cf89be4661a70d WatchSource:0}: Error finding container a5c50b7c6c97bc63ec8b9695690ff5876921454f4a9aea87d0cf89be4661a70d: Status 404 returned error can't find the container with id a5c50b7c6c97bc63ec8b9695690ff5876921454f4a9aea87d0cf89be4661a70d
Jul 02 17:15:45.281668 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:45.281648    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-62g9m_d6628590-1cf7-4a61-9350-539f3ae7ed91/ovn-acl-logging/0.log"
Jul 02 17:15:45.281825 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:45.281812    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-62g9m_d6628590-1cf7-4a61-9350-539f3ae7ed91/ovn-acl-logging/0.log"
Jul 02 17:15:45.284319 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:45.284295    2578 kubelet.go:1648] "Image garbage collection succeeded"
Jul 02 17:15:45.418064 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:45.417962    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-86ddb7bc6-tk8sx"
Jul 02 17:15:45.547133 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:45.546951    2578 generic.go:356] "Generic (PLEG): container finished" podID="604eaa5c-b472-4d40-a129-779cbc619d09" containerID="63d6dbd3753fd7c93498d1ed8163e21fd00e2d361b56b669a84c5b07f30eeb7f" exitCode=0
Jul 02 17:15:45.547133 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:45.546986    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jvg8k" event={"ID":"604eaa5c-b472-4d40-a129-779cbc619d09","Type":"ContainerDied","Data":"63d6dbd3753fd7c93498d1ed8163e21fd00e2d361b56b669a84c5b07f30eeb7f"}
Jul 02 17:15:45.554489 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:45.548462    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0f35dce1-602e-4bd1-9b81-2834013fc9f7","Type":"ContainerStarted","Data":"a5c50b7c6c97bc63ec8b9695690ff5876921454f4a9aea87d0cf89be4661a70d"}
Jul 02 17:15:45.554489 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:45.554432    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:45.654093 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:45.654058    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:45.754088 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:45.754057    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:45.854712 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:45.854687    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:46.268689 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:46.268658    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:46.367839 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:46.367803    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:46.554756 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:46.554674    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jvg8k" event={"ID":"604eaa5c-b472-4d40-a129-779cbc619d09","Type":"ContainerStarted","Data":"7cba14d90d8801f9b97f65ccd12b1ed78011304de91ffa3f3f9fe8460ab32d74"}
Jul 02 17:15:46.554756 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:46.554731    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jvg8k" event={"ID":"604eaa5c-b472-4d40-a129-779cbc619d09","Type":"ContainerStarted","Data":"c6c883c783053350d0a9462413f994f9f5acc4271c1e02071bb3721f9bafddf1"}
Jul 02 17:15:46.556945 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:46.556915    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-fdfvp" event={"ID":"f7c9f1d9-8c54-4374-ab66-cdf83fe8aea3","Type":"ContainerStarted","Data":"7322c7e33e8bee159d3a1da1d8b2432887156bbedc3b64705f40597b905bd0b9"}
Jul 02 17:15:46.557103 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:46.556980    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-fdfvp" event={"ID":"f7c9f1d9-8c54-4374-ab66-cdf83fe8aea3","Type":"ContainerStarted","Data":"5db4c4b1462eeec674adfb2cc5ef1943efc5ce7a15226e4a5504311344978841"}
Jul 02 17:15:46.557103 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:46.557008    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-fdfvp" event={"ID":"f7c9f1d9-8c54-4374-ab66-cdf83fe8aea3","Type":"ContainerStarted","Data":"38bf9ce2fedb1069ba1e20e2c9eff9b011e5c5c47a679e5708d5fb0cabba502d"}
Jul 02 17:15:46.559095 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:46.559072    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-kvz2k" event={"ID":"2ad0a20a-c7a3-4fa9-865f-d70dbccc1c16","Type":"ContainerStarted","Data":"218ea3afa5b8b336b23bdf08603628b94f0dbdce453b558ab922c92720b4f212"}
Jul 02 17:15:46.575763 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:46.575704    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-jvg8k" podStartSLOduration=3.061625915 podStartE2EDuration="4.575690426s" totalImagesPullingTime="1.439991823s" totalInitContainerRuntime="74.072688ms" isStatefulPod=true podCreationTimestamp="2026-07-02 17:15:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:15:46.573559295 +0000 UTC m=+301.763261958" watchObservedRunningTime="2026-07-02 17:15:46.575690426 +0000 UTC m=+301.765393127"
Jul 02 17:15:46.590740 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:46.590688    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-845b954455-fdfvp" podStartSLOduration=2.532279909 podStartE2EDuration="4.590669231s" totalImagesPullingTime="2.058389322s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:15:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:15:46.589843724 +0000 UTC m=+301.779546386" watchObservedRunningTime="2026-07-02 17:15:46.590669231 +0000 UTC m=+301.780371894"
Jul 02 17:15:46.605899 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:46.605855    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-kvz2k" podStartSLOduration=2.16746347 podStartE2EDuration="4.605842091s" totalImagesPullingTime="2.438378621s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:15:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:15:46.604970393 +0000 UTC m=+301.794673068" watchObservedRunningTime="2026-07-02 17:15:46.605842091 +0000 UTC m=+301.795544753"
Jul 02 17:15:47.194065 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:47.194037    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7d67d66d9-nbv5x"]
Jul 02 17:15:47.212614 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:47.212583    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7d67d66d9-nbv5x"]
Jul 02 17:15:47.212800 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:47.212695    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7d67d66d9-nbv5x"
Jul 02 17:15:47.215598 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:47.215559    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 02 17:15:47.215598 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:47.215581    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 02 17:15:47.215598 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:47.215594    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 02 17:15:47.215828 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:47.215581    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-q4wgd\""
Jul 02 17:15:47.216902 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:47.216878    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 02 17:15:47.217040 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:47.216988    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-bkuo4pfh13pje\""
Jul 02 17:15:47.265893 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:47.265853    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/57de8b8a-3a07-4c88-ae81-f75bf58cc8ec-audit-log\") pod \"metrics-server-7d67d66d9-nbv5x\" (UID: \"57de8b8a-3a07-4c88-ae81-f75bf58cc8ec\") " pod="openshift-monitoring/metrics-server-7d67d66d9-nbv5x"
Jul 02 17:15:47.266082 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:47.265981    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/57de8b8a-3a07-4c88-ae81-f75bf58cc8ec-client-ca-bundle\") pod \"metrics-server-7d67d66d9-nbv5x\" (UID: \"57de8b8a-3a07-4c88-ae81-f75bf58cc8ec\") " pod="openshift-monitoring/metrics-server-7d67d66d9-nbv5x"
Jul 02 17:15:47.266082 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:47.266034    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v29ck\" (UniqueName: \"kubernetes.io/projected/57de8b8a-3a07-4c88-ae81-f75bf58cc8ec-kube-api-access-v29ck\") pod \"metrics-server-7d67d66d9-nbv5x\" (UID: \"57de8b8a-3a07-4c88-ae81-f75bf58cc8ec\") " pod="openshift-monitoring/metrics-server-7d67d66d9-nbv5x"
Jul 02 17:15:47.266082 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:47.266059    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/57de8b8a-3a07-4c88-ae81-f75bf58cc8ec-metrics-server-audit-profiles\") pod \"metrics-server-7d67d66d9-nbv5x\" (UID: \"57de8b8a-3a07-4c88-ae81-f75bf58cc8ec\") " pod="openshift-monitoring/metrics-server-7d67d66d9-nbv5x"
Jul 02 17:15:47.266252 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:47.266082    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57de8b8a-3a07-4c88-ae81-f75bf58cc8ec-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7d67d66d9-nbv5x\" (UID: \"57de8b8a-3a07-4c88-ae81-f75bf58cc8ec\") " pod="openshift-monitoring/metrics-server-7d67d66d9-nbv5x"
Jul 02 17:15:47.266252 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:47.266113    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/57de8b8a-3a07-4c88-ae81-f75bf58cc8ec-secret-metrics-server-tls\") pod \"metrics-server-7d67d66d9-nbv5x\" (UID: \"57de8b8a-3a07-4c88-ae81-f75bf58cc8ec\") " pod="openshift-monitoring/metrics-server-7d67d66d9-nbv5x"
Jul 02 17:15:47.266340 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:47.266244    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/57de8b8a-3a07-4c88-ae81-f75bf58cc8ec-secret-metrics-server-client-certs\") pod \"metrics-server-7d67d66d9-nbv5x\" (UID: \"57de8b8a-3a07-4c88-ae81-f75bf58cc8ec\") " pod="openshift-monitoring/metrics-server-7d67d66d9-nbv5x"
Jul 02 17:15:47.367208 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:47.367172    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/57de8b8a-3a07-4c88-ae81-f75bf58cc8ec-audit-log\") pod \"metrics-server-7d67d66d9-nbv5x\" (UID: \"57de8b8a-3a07-4c88-ae81-f75bf58cc8ec\") " pod="openshift-monitoring/metrics-server-7d67d66d9-nbv5x"
Jul 02 17:15:47.367389 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:47.367214    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/57de8b8a-3a07-4c88-ae81-f75bf58cc8ec-client-ca-bundle\") pod \"metrics-server-7d67d66d9-nbv5x\" (UID: \"57de8b8a-3a07-4c88-ae81-f75bf58cc8ec\") " pod="openshift-monitoring/metrics-server-7d67d66d9-nbv5x"
Jul 02 17:15:47.367389 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:47.367239    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v29ck\" (UniqueName: \"kubernetes.io/projected/57de8b8a-3a07-4c88-ae81-f75bf58cc8ec-kube-api-access-v29ck\") pod \"metrics-server-7d67d66d9-nbv5x\" (UID: \"57de8b8a-3a07-4c88-ae81-f75bf58cc8ec\") " pod="openshift-monitoring/metrics-server-7d67d66d9-nbv5x"
Jul 02 17:15:47.367389 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:47.367363    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/57de8b8a-3a07-4c88-ae81-f75bf58cc8ec-metrics-server-audit-profiles\") pod \"metrics-server-7d67d66d9-nbv5x\" (UID: \"57de8b8a-3a07-4c88-ae81-f75bf58cc8ec\") " pod="openshift-monitoring/metrics-server-7d67d66d9-nbv5x"
Jul 02 17:15:47.367557 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:47.367399    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57de8b8a-3a07-4c88-ae81-f75bf58cc8ec-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7d67d66d9-nbv5x\" (UID: \"57de8b8a-3a07-4c88-ae81-f75bf58cc8ec\") " pod="openshift-monitoring/metrics-server-7d67d66d9-nbv5x"
Jul 02 17:15:47.367557 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:47.367441    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/57de8b8a-3a07-4c88-ae81-f75bf58cc8ec-secret-metrics-server-tls\") pod \"metrics-server-7d67d66d9-nbv5x\" (UID: \"57de8b8a-3a07-4c88-ae81-f75bf58cc8ec\") " pod="openshift-monitoring/metrics-server-7d67d66d9-nbv5x"
Jul 02 17:15:47.367557 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:47.367495    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/57de8b8a-3a07-4c88-ae81-f75bf58cc8ec-secret-metrics-server-client-certs\") pod \"metrics-server-7d67d66d9-nbv5x\" (UID: \"57de8b8a-3a07-4c88-ae81-f75bf58cc8ec\") " pod="openshift-monitoring/metrics-server-7d67d66d9-nbv5x"
Jul 02 17:15:47.367557 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:47.367548    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/57de8b8a-3a07-4c88-ae81-f75bf58cc8ec-audit-log\") pod \"metrics-server-7d67d66d9-nbv5x\" (UID: \"57de8b8a-3a07-4c88-ae81-f75bf58cc8ec\") " pod="openshift-monitoring/metrics-server-7d67d66d9-nbv5x"
Jul 02 17:15:47.368265 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:47.368235    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57de8b8a-3a07-4c88-ae81-f75bf58cc8ec-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7d67d66d9-nbv5x\" (UID: \"57de8b8a-3a07-4c88-ae81-f75bf58cc8ec\") " pod="openshift-monitoring/metrics-server-7d67d66d9-nbv5x"
Jul 02 17:15:47.368513 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:47.368493    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/57de8b8a-3a07-4c88-ae81-f75bf58cc8ec-metrics-server-audit-profiles\") pod \"metrics-server-7d67d66d9-nbv5x\" (UID: \"57de8b8a-3a07-4c88-ae81-f75bf58cc8ec\") " pod="openshift-monitoring/metrics-server-7d67d66d9-nbv5x"
Jul 02 17:15:47.369836 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:47.369808    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/57de8b8a-3a07-4c88-ae81-f75bf58cc8ec-secret-metrics-server-client-certs\") pod \"metrics-server-7d67d66d9-nbv5x\" (UID: \"57de8b8a-3a07-4c88-ae81-f75bf58cc8ec\") " pod="openshift-monitoring/metrics-server-7d67d66d9-nbv5x"
Jul 02 17:15:47.369925 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:47.369846    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/57de8b8a-3a07-4c88-ae81-f75bf58cc8ec-secret-metrics-server-tls\") pod \"metrics-server-7d67d66d9-nbv5x\" (UID: \"57de8b8a-3a07-4c88-ae81-f75bf58cc8ec\") " pod="openshift-monitoring/metrics-server-7d67d66d9-nbv5x"
Jul 02 17:15:47.369968 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:47.369932    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/57de8b8a-3a07-4c88-ae81-f75bf58cc8ec-client-ca-bundle\") pod \"metrics-server-7d67d66d9-nbv5x\" (UID: \"57de8b8a-3a07-4c88-ae81-f75bf58cc8ec\") " pod="openshift-monitoring/metrics-server-7d67d66d9-nbv5x"
Jul 02 17:15:47.377912 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:47.377893    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v29ck\" (UniqueName: \"kubernetes.io/projected/57de8b8a-3a07-4c88-ae81-f75bf58cc8ec-kube-api-access-v29ck\") pod \"metrics-server-7d67d66d9-nbv5x\" (UID: \"57de8b8a-3a07-4c88-ae81-f75bf58cc8ec\") " pod="openshift-monitoring/metrics-server-7d67d66d9-nbv5x"
Jul 02 17:15:47.522231 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:47.522205    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7d67d66d9-nbv5x"
Jul 02 17:15:47.583107 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:47.583069    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:47.673598 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:47.673557    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:47.686569 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:47.686549    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7d67d66d9-nbv5x"]
Jul 02 17:15:47.689104 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:15:47.689078    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57de8b8a_3a07_4c88_ae81_f75bf58cc8ec.slice/crio-23fc92f75514b6507ae2cfb4b52b3f1aad3055abfdb59e8859fc81c71dbf9667 WatchSource:0}: Error finding container 23fc92f75514b6507ae2cfb4b52b3f1aad3055abfdb59e8859fc81c71dbf9667: Status 404 returned error can't find the container with id 23fc92f75514b6507ae2cfb4b52b3f1aad3055abfdb59e8859fc81c71dbf9667
Jul 02 17:15:47.691121 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:47.691103    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 17:15:47.773583 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:47.773551    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:47.887009 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:47.886979    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:47.978129 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:47.978101    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-57b8c984f-zk758"]
Jul 02 17:15:48.006211 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:48.006184    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-57b8c984f-zk758"]
Jul 02 17:15:48.006344 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:48.006326    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-57b8c984f-zk758"
Jul 02 17:15:48.009605 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:48.009582    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 02 17:15:48.009734 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:48.009623    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 02 17:15:48.009734 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:48.009628    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 02 17:15:48.009951 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:48.009923    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 02 17:15:48.010141 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:48.010116    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 02 17:15:48.010316 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:48.010296    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-bf2q5\""
Jul 02 17:15:48.014700 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:48.014682    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 02 17:15:48.073844 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:48.073769    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b9e18694-4428-4462-9bf5-b1e6b12f45b4-secret-telemeter-client\") pod \"telemeter-client-57b8c984f-zk758\" (UID: \"b9e18694-4428-4462-9bf5-b1e6b12f45b4\") " pod="openshift-monitoring/telemeter-client-57b8c984f-zk758"
Jul 02 17:15:48.073844 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:48.073807    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9e18694-4428-4462-9bf5-b1e6b12f45b4-serving-certs-ca-bundle\") pod \"telemeter-client-57b8c984f-zk758\" (UID: \"b9e18694-4428-4462-9bf5-b1e6b12f45b4\") " pod="openshift-monitoring/telemeter-client-57b8c984f-zk758"
Jul 02 17:15:48.073844 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:48.073828    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9e18694-4428-4462-9bf5-b1e6b12f45b4-metrics-client-ca\") pod \"telemeter-client-57b8c984f-zk758\" (UID: \"b9e18694-4428-4462-9bf5-b1e6b12f45b4\") " pod="openshift-monitoring/telemeter-client-57b8c984f-zk758"
Jul 02 17:15:48.073844 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:48.073845    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9e18694-4428-4462-9bf5-b1e6b12f45b4-telemeter-trusted-ca-bundle\") pod \"telemeter-client-57b8c984f-zk758\" (UID: \"b9e18694-4428-4462-9bf5-b1e6b12f45b4\") " pod="openshift-monitoring/telemeter-client-57b8c984f-zk758"
Jul 02 17:15:48.074160 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:48.073910    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b9e18694-4428-4462-9bf5-b1e6b12f45b4-federate-client-tls\") pod \"telemeter-client-57b8c984f-zk758\" (UID: \"b9e18694-4428-4462-9bf5-b1e6b12f45b4\") " pod="openshift-monitoring/telemeter-client-57b8c984f-zk758"
Jul 02 17:15:48.074160 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:48.073931    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b9e18694-4428-4462-9bf5-b1e6b12f45b4-telemeter-client-tls\") pod \"telemeter-client-57b8c984f-zk758\" (UID: \"b9e18694-4428-4462-9bf5-b1e6b12f45b4\") " pod="openshift-monitoring/telemeter-client-57b8c984f-zk758"
Jul 02 17:15:48.074160 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:48.073948    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkfg7\" (UniqueName: \"kubernetes.io/projected/b9e18694-4428-4462-9bf5-b1e6b12f45b4-kube-api-access-xkfg7\") pod \"telemeter-client-57b8c984f-zk758\" (UID: \"b9e18694-4428-4462-9bf5-b1e6b12f45b4\") " pod="openshift-monitoring/telemeter-client-57b8c984f-zk758"
Jul 02 17:15:48.074160 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:48.074050    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b9e18694-4428-4462-9bf5-b1e6b12f45b4-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-57b8c984f-zk758\" (UID: \"b9e18694-4428-4462-9bf5-b1e6b12f45b4\") " pod="openshift-monitoring/telemeter-client-57b8c984f-zk758"
Jul 02 17:15:48.174838 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:48.174806    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b9e18694-4428-4462-9bf5-b1e6b12f45b4-secret-telemeter-client\") pod \"telemeter-client-57b8c984f-zk758\" (UID: \"b9e18694-4428-4462-9bf5-b1e6b12f45b4\") " pod="openshift-monitoring/telemeter-client-57b8c984f-zk758"
Jul 02 17:15:48.175012 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:48.174845    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9e18694-4428-4462-9bf5-b1e6b12f45b4-serving-certs-ca-bundle\") pod \"telemeter-client-57b8c984f-zk758\" (UID: \"b9e18694-4428-4462-9bf5-b1e6b12f45b4\") " pod="openshift-monitoring/telemeter-client-57b8c984f-zk758"
Jul 02 17:15:48.175012 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:48.174864    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9e18694-4428-4462-9bf5-b1e6b12f45b4-metrics-client-ca\") pod \"telemeter-client-57b8c984f-zk758\" (UID: \"b9e18694-4428-4462-9bf5-b1e6b12f45b4\") " pod="openshift-monitoring/telemeter-client-57b8c984f-zk758"
Jul 02 17:15:48.175012 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:48.174884    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9e18694-4428-4462-9bf5-b1e6b12f45b4-telemeter-trusted-ca-bundle\") pod \"telemeter-client-57b8c984f-zk758\" (UID: \"b9e18694-4428-4462-9bf5-b1e6b12f45b4\") " pod="openshift-monitoring/telemeter-client-57b8c984f-zk758"
Jul 02 17:15:48.175012 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:48.174956    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b9e18694-4428-4462-9bf5-b1e6b12f45b4-federate-client-tls\") pod \"telemeter-client-57b8c984f-zk758\" (UID: \"b9e18694-4428-4462-9bf5-b1e6b12f45b4\") " pod="openshift-monitoring/telemeter-client-57b8c984f-zk758"
Jul 02 17:15:48.175012 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:48.174994    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b9e18694-4428-4462-9bf5-b1e6b12f45b4-telemeter-client-tls\") pod \"telemeter-client-57b8c984f-zk758\" (UID: \"b9e18694-4428-4462-9bf5-b1e6b12f45b4\") " pod="openshift-monitoring/telemeter-client-57b8c984f-zk758"
Jul 02 17:15:48.175012 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:48.175010    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkfg7\" (UniqueName: \"kubernetes.io/projected/b9e18694-4428-4462-9bf5-b1e6b12f45b4-kube-api-access-xkfg7\") pod \"telemeter-client-57b8c984f-zk758\" (UID: \"b9e18694-4428-4462-9bf5-b1e6b12f45b4\") " pod="openshift-monitoring/telemeter-client-57b8c984f-zk758"
Jul 02 17:15:48.175315 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:48.175073    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b9e18694-4428-4462-9bf5-b1e6b12f45b4-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-57b8c984f-zk758\" (UID: \"b9e18694-4428-4462-9bf5-b1e6b12f45b4\") " pod="openshift-monitoring/telemeter-client-57b8c984f-zk758"
Jul 02 17:15:48.175843 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:48.175817    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9e18694-4428-4462-9bf5-b1e6b12f45b4-metrics-client-ca\") pod \"telemeter-client-57b8c984f-zk758\" (UID: \"b9e18694-4428-4462-9bf5-b1e6b12f45b4\") " pod="openshift-monitoring/telemeter-client-57b8c984f-zk758"
Jul 02 17:15:48.175955 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:48.175906    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9e18694-4428-4462-9bf5-b1e6b12f45b4-serving-certs-ca-bundle\") pod \"telemeter-client-57b8c984f-zk758\" (UID: \"b9e18694-4428-4462-9bf5-b1e6b12f45b4\") " pod="openshift-monitoring/telemeter-client-57b8c984f-zk758"
Jul 02 17:15:48.176193 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:48.176167    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9e18694-4428-4462-9bf5-b1e6b12f45b4-telemeter-trusted-ca-bundle\") pod \"telemeter-client-57b8c984f-zk758\" (UID: \"b9e18694-4428-4462-9bf5-b1e6b12f45b4\") " pod="openshift-monitoring/telemeter-client-57b8c984f-zk758"
Jul 02 17:15:48.177555 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:48.177537    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b9e18694-4428-4462-9bf5-b1e6b12f45b4-federate-client-tls\") pod \"telemeter-client-57b8c984f-zk758\" (UID: \"b9e18694-4428-4462-9bf5-b1e6b12f45b4\") " pod="openshift-monitoring/telemeter-client-57b8c984f-zk758"
Jul 02 17:15:48.177647 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:48.177607    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b9e18694-4428-4462-9bf5-b1e6b12f45b4-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-57b8c984f-zk758\" (UID: \"b9e18694-4428-4462-9bf5-b1e6b12f45b4\") " pod="openshift-monitoring/telemeter-client-57b8c984f-zk758"
Jul 02 17:15:48.177824 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:48.177805    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b9e18694-4428-4462-9bf5-b1e6b12f45b4-secret-telemeter-client\") pod \"telemeter-client-57b8c984f-zk758\" (UID: \"b9e18694-4428-4462-9bf5-b1e6b12f45b4\") " pod="openshift-monitoring/telemeter-client-57b8c984f-zk758"
Jul 02 17:15:48.177891 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:48.177863    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b9e18694-4428-4462-9bf5-b1e6b12f45b4-telemeter-client-tls\") pod \"telemeter-client-57b8c984f-zk758\" (UID: \"b9e18694-4428-4462-9bf5-b1e6b12f45b4\") " pod="openshift-monitoring/telemeter-client-57b8c984f-zk758"
Jul 02 17:15:48.183461 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:48.183435    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkfg7\" (UniqueName: \"kubernetes.io/projected/b9e18694-4428-4462-9bf5-b1e6b12f45b4-kube-api-access-xkfg7\") pod \"telemeter-client-57b8c984f-zk758\" (UID: \"b9e18694-4428-4462-9bf5-b1e6b12f45b4\") " pod="openshift-monitoring/telemeter-client-57b8c984f-zk758"
Jul 02 17:15:48.316820 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:48.316789    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-57b8c984f-zk758"
Jul 02 17:15:48.498005 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:48.497959    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-57b8c984f-zk758"]
Jul 02 17:15:48.501580 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:15:48.501551    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9e18694_4428_4462_9bf5_b1e6b12f45b4.slice/crio-96d0439314491e3354d6f0ce9d5eb8a875630d09a000d782598924441a1618a8 WatchSource:0}: Error finding container 96d0439314491e3354d6f0ce9d5eb8a875630d09a000d782598924441a1618a8: Status 404 returned error can't find the container with id 96d0439314491e3354d6f0ce9d5eb8a875630d09a000d782598924441a1618a8
Jul 02 17:15:48.571912 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:48.571886    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7d67d66d9-nbv5x" event={"ID":"57de8b8a-3a07-4c88-ae81-f75bf58cc8ec","Type":"ContainerStarted","Data":"23fc92f75514b6507ae2cfb4b52b3f1aad3055abfdb59e8859fc81c71dbf9667"}
Jul 02 17:15:48.573086 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:48.573051    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-57b8c984f-zk758" event={"ID":"b9e18694-4428-4462-9bf5-b1e6b12f45b4","Type":"ContainerStarted","Data":"96d0439314491e3354d6f0ce9d5eb8a875630d09a000d782598924441a1618a8"}
Jul 02 17:15:48.574525 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:48.574496    2578 generic.go:356] "Generic (PLEG): container finished" podID="0f35dce1-602e-4bd1-9b81-2834013fc9f7" containerID="8932d3b1b7fd1df688347f8ed0884d2cf0bd8e3a5ac2b702a823a3c1970ec567" exitCode=0
Jul 02 17:15:48.574624 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:48.574525    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0f35dce1-602e-4bd1-9b81-2834013fc9f7","Type":"ContainerDied","Data":"8932d3b1b7fd1df688347f8ed0884d2cf0bd8e3a5ac2b702a823a3c1970ec567"}
Jul 02 17:15:49.045032 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:49.044976    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:49.840843 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:49.840806    2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59948b9d98-xlbss"
Jul 02 17:15:49.850495 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:49.849944    2578 scope.go:117] "RemoveContainer" containerID="d1e202c509cbfbd73280485769e3e70b1125cab9e8000b8368a156c91300589c"
Jul 02 17:15:49.850495 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:15:49.850183    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-59948b9d98-xlbss_open-cluster-management-agent-addon(28f6fd07-b48d-428c-8ff7-0ca6eb257587)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59948b9d98-xlbss" podUID="28f6fd07-b48d-428c-8ff7-0ca6eb257587"
Jul 02 17:15:50.591278 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:50.591126    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7d67d66d9-nbv5x" event={"ID":"57de8b8a-3a07-4c88-ae81-f75bf58cc8ec","Type":"ContainerStarted","Data":"6decda43d1009acc98a8d60578f1e88151c2cb68f62f5c43c1b194070ac10e8f"}
Jul 02 17:15:50.610038 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:50.609894    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7d67d66d9-nbv5x" podStartSLOduration=1.377422049 podStartE2EDuration="3.60986675s" totalImagesPullingTime="2.232444701s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:15:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:15:50.609569188 +0000 UTC m=+305.799271850" watchObservedRunningTime="2026-07-02 17:15:50.60986675 +0000 UTC m=+305.799569413"
Jul 02 17:15:50.650969 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:50.650929    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:50.759586 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:50.759484    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:51.607413 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:51.607311    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-57b8c984f-zk758" event={"ID":"b9e18694-4428-4462-9bf5-b1e6b12f45b4","Type":"ContainerStarted","Data":"745c90a2b212a4fc444583f511c005f6eb8664a98ae3d53e429b77759a3f0831"}
Jul 02 17:15:51.610947 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:51.610492    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0f35dce1-602e-4bd1-9b81-2834013fc9f7","Type":"ContainerStarted","Data":"96c6d4b98a91804acf45c345cbf6e88197425d7394b8132a1a120f6c984587b2"}
Jul 02 17:15:52.619519 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:52.619482    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0f35dce1-602e-4bd1-9b81-2834013fc9f7","Type":"ContainerStarted","Data":"55f48dc0b174d8ff36e6d1e7cb49f47bb7eecc5da71e7870f88067366f5a1315"}
Jul 02 17:15:52.620098 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:52.619568    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0f35dce1-602e-4bd1-9b81-2834013fc9f7","Type":"ContainerStarted","Data":"cd4f565948841538be639ca7ee914fcaf95d79f7caddb8bb63f445766b4584ec"}
Jul 02 17:15:52.620098 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:52.619601    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0f35dce1-602e-4bd1-9b81-2834013fc9f7","Type":"ContainerStarted","Data":"43f78558a57ab43b10d4d3d2b1e573fc800b1b72dad668800a84c8ab0588331d"}
Jul 02 17:15:52.620098 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:52.619635    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0f35dce1-602e-4bd1-9b81-2834013fc9f7","Type":"ContainerStarted","Data":"ab72d237ab29fa79e7961190882490ce3b2c4ad0262fc6ad972e380c057b98bf"}
Jul 02 17:15:52.622054 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:52.621999    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-57b8c984f-zk758" event={"ID":"b9e18694-4428-4462-9bf5-b1e6b12f45b4","Type":"ContainerStarted","Data":"a31acfdd4890fb0515f605fadf8a559c8e07836e95890c5c4f5c0b53eabda537"}
Jul 02 17:15:52.622198 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:52.622078    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-57b8c984f-zk758" event={"ID":"b9e18694-4428-4462-9bf5-b1e6b12f45b4","Type":"ContainerStarted","Data":"8bc94d58e4f92dedd57635122e24e15275a80247056ffc47e21b8ee41a87a32c"}
Jul 02 17:15:52.647982 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:52.647932    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-57b8c984f-zk758" podStartSLOduration=2.759034905 podStartE2EDuration="5.647895107s" totalImagesPullingTime="2.888860202s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:15:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:15:52.646808672 +0000 UTC m=+307.836511335" watchObservedRunningTime="2026-07-02 17:15:52.647895107 +0000 UTC m=+307.837597770"
Jul 02 17:15:52.667367 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:52.667336    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:52.766170 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:52.766136    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:52.985552 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:52.985520    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:53.085293 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:53.085268    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:53.629011 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:53.628932    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0f35dce1-602e-4bd1-9b81-2834013fc9f7","Type":"ContainerStarted","Data":"f557cc6dd746288b0af3c0795f9800790bf989c34543d99efb42b42a80f467f5"}
Jul 02 17:15:53.658893 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:53.658844    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.124983055 podStartE2EDuration="10.658829131s" totalImagesPullingTime="6.528162314s" totalInitContainerRuntime="5.683762ms" isStatefulPod=false podCreationTimestamp="2026-07-02 17:15:43 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:15:53.657665256 +0000 UTC m=+308.847367932" watchObservedRunningTime="2026-07-02 17:15:53.658829131 +0000 UTC m=+308.848531793"
Jul 02 17:15:53.807799 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:53.807767    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:53.861773 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:53.861743    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:54.418981 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:54.418948    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:54.476184 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:54.476154    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:15:55.491644 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:15:55.491614    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g67j2"
Jul 02 17:16:00.658662 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:16:00.658633    2578 generic.go:356] "Generic (PLEG): container finished" podID="5180569c-246f-44b6-a676-52300031785d" containerID="d28d02c9f3829318d45c53b0efa525cec68dd702bb191ddac7b07d33d87df3df" exitCode=0
Jul 02 17:16:00.659048 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:16:00.658713    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-nz4p7" event={"ID":"5180569c-246f-44b6-a676-52300031785d","Type":"ContainerDied","Data":"d28d02c9f3829318d45c53b0efa525cec68dd702bb191ddac7b07d33d87df3df"}
Jul 02 17:16:00.659169 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:16:00.659152    2578 scope.go:117] "RemoveContainer" containerID="d28d02c9f3829318d45c53b0efa525cec68dd702bb191ddac7b07d33d87df3df"
Jul 02 17:16:01.664518 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:16:01.664486    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-nz4p7" event={"ID":"5180569c-246f-44b6-a676-52300031785d","Type":"ContainerStarted","Data":"95bcea000ff0a6ba1df185a9cdd3af14c735d7306dba8dc664d494cf879cec7d"}
Jul 02 17:16:01.676055 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:16:01.675997    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:16:01.776990 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:16:01.776952    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:16:03.490995 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:16:03.490959    2578 scope.go:117] "RemoveContainer" containerID="d1e202c509cbfbd73280485769e3e70b1125cab9e8000b8368a156c91300589c"
Jul 02 17:16:03.674573 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:16:03.674534    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59948b9d98-xlbss" event={"ID":"28f6fd07-b48d-428c-8ff7-0ca6eb257587","Type":"ContainerStarted","Data":"08e68dd8eca63cd783f98990e5e849bad5e4c2fda73fceb09c9406c430ee8c21"}
Jul 02 17:16:04.776416 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:16:04.776382    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:16:04.876866 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:16:04.876837    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:16:04.978363 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:16:04.978301    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:16:05.644767 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:16:05.644720    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:16:05.711583 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:16:05.711557    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:16:07.523066 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:16:07.523039    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7d67d66d9-nbv5x"
Jul 02 17:16:07.523431 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:16:07.523083    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7d67d66d9-nbv5x"
Jul 02 17:16:27.527789 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:16:27.527760    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7d67d66d9-nbv5x"
Jul 02 17:16:27.531507 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:16:27.531488    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7d67d66d9-nbv5x"
Jul 02 17:16:50.944159 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:16:50.944128    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:16:51.003502 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:16:51.003466    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:16:58.212910 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:16:58.212861    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1d3526d-01f3-4e77-a78e-ac8954a7a207-metrics-certs\") pod \"network-metrics-daemon-g67j2\" (UID: \"d1d3526d-01f3-4e77-a78e-ac8954a7a207\") " pod="openshift-multus/network-metrics-daemon-g67j2"
Jul 02 17:16:58.215133 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:16:58.215112    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1d3526d-01f3-4e77-a78e-ac8954a7a207-metrics-certs\") pod \"network-metrics-daemon-g67j2\" (UID: \"d1d3526d-01f3-4e77-a78e-ac8954a7a207\") " pod="openshift-multus/network-metrics-daemon-g67j2"
Jul 02 17:16:58.495728 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:16:58.495701    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vg44r\""
Jul 02 17:16:58.502970 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:16:58.502951    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g67j2"
Jul 02 17:16:58.628765 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:16:58.628738    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-g67j2"]
Jul 02 17:16:58.631358 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:16:58.631331    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1d3526d_01f3_4e77_a78e_ac8954a7a207.slice/crio-414affc5b9f580add2b62a48c57cd1ed3cf7db20e833b2fde6dae0dac984c175 WatchSource:0}: Error finding container 414affc5b9f580add2b62a48c57cd1ed3cf7db20e833b2fde6dae0dac984c175: Status 404 returned error can't find the container with id 414affc5b9f580add2b62a48c57cd1ed3cf7db20e833b2fde6dae0dac984c175
Jul 02 17:16:58.872880 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:16:58.872786    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:16:58.883626 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:16:58.883597    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g67j2" event={"ID":"d1d3526d-01f3-4e77-a78e-ac8954a7a207","Type":"ContainerStarted","Data":"414affc5b9f580add2b62a48c57cd1ed3cf7db20e833b2fde6dae0dac984c175"}
Jul 02 17:16:58.941141 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:16:58.941108    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:16:59.889145 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:16:59.889064    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g67j2" event={"ID":"d1d3526d-01f3-4e77-a78e-ac8954a7a207","Type":"ContainerStarted","Data":"511d2848c1aa61f4812a8e8a458dc1ddbeec7991dc3b90fcf874b903df0e43c6"}
Jul 02 17:16:59.889145 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:16:59.889114    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g67j2" event={"ID":"d1d3526d-01f3-4e77-a78e-ac8954a7a207","Type":"ContainerStarted","Data":"9b931d565acb800b3a2c600b9f485a54d8c52f9af8763d4844ce52c956702447"}
Jul 02 17:16:59.906807 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:16:59.906761    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-g67j2" podStartSLOduration=374.06240802 podStartE2EDuration="6m14.906742431s" totalImagesPullingTime="844.334411ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:10:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:16:59.905704129 +0000 UTC m=+375.095406794" watchObservedRunningTime="2026-07-02 17:16:59.906742431 +0000 UTC m=+375.096445094"
Jul 02 17:16:59.936261 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:16:59.936232    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:17:00.037167 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:17:00.037138    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:17:00.091133 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:17:00.091110    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:17:00.336834 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:17:00.336802    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:17:00.437785 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:17:00.437754    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:17:03.253459 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:17:03.253426    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:17:10.702225 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:17:10.702182    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:17:10.802932 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:17:10.802892    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:17:14.053035 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:17:14.052956    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:17:14.106050 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:17:14.105982    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:17:14.157480 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:17:14.157448    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:17:20.661973 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:17:20.661933    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:17:20.760338 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:17:20.760307    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:17:20.813010 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:17:20.812982    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:17:31.542379 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:17:31.542342    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:17:31.643221 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:17:31.643178    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:17:33.578660 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:17:33.578627    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:17:55.361804 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:17:55.361767    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:17:55.462012 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:17:55.461982    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:18:18.575692 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:18:18.575602    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:18:25.300273 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:18:25.300233    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:18:26.077224 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:18:26.077190    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:18:26.532035 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:18:26.531977    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:18:26.632987 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:18:26.632955    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:18:28.712672 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:18:28.712636    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:18:28.812627 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:18:28.812597    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:18:29.573303 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:18:29.573265    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:18:29.677726 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:18:29.677690    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:18:30.998224 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:18:30.998184    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:18:31.102999 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:18:31.102956    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:18:33.009738 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:18:33.009703    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:18:33.416942 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:18:33.416864    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:18:35.512030 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:18:35.511978    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:18:35.612962 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:18:35.612928    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:18:39.120132 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:18:39.120093    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:18:39.219059 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:18:39.219004    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:18:41.613405 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:18:41.613374    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:18:41.994686 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:18:41.994646    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-gzw5j"]
Jul 02 17:18:41.997993 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:18:41.997970    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-gzw5j"
Jul 02 17:18:42.000807 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:18:42.000783    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 02 17:18:42.000949 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:18:42.000895    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 02 17:18:42.002003 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:18:42.001986    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-gmsmd\""
Jul 02 17:18:42.004981 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:18:42.004950    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-gzw5j"]
Jul 02 17:18:42.161796 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:18:42.161768    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e5624f90-7d4d-45d5-bcfd-f46d7f10dce1-bound-sa-token\") pod \"cert-manager-55b4d954d5-gzw5j\" (UID: \"e5624f90-7d4d-45d5-bcfd-f46d7f10dce1\") " pod="cert-manager/cert-manager-55b4d954d5-gzw5j"
Jul 02 17:18:42.161926 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:18:42.161803    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thdvg\" (UniqueName: \"kubernetes.io/projected/e5624f90-7d4d-45d5-bcfd-f46d7f10dce1-kube-api-access-thdvg\") pod \"cert-manager-55b4d954d5-gzw5j\" (UID: \"e5624f90-7d4d-45d5-bcfd-f46d7f10dce1\") " pod="cert-manager/cert-manager-55b4d954d5-gzw5j"
Jul 02 17:18:42.262451 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:18:42.262388    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e5624f90-7d4d-45d5-bcfd-f46d7f10dce1-bound-sa-token\") pod \"cert-manager-55b4d954d5-gzw5j\" (UID: \"e5624f90-7d4d-45d5-bcfd-f46d7f10dce1\") " pod="cert-manager/cert-manager-55b4d954d5-gzw5j"
Jul 02 17:18:42.262451 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:18:42.262426    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thdvg\" (UniqueName: \"kubernetes.io/projected/e5624f90-7d4d-45d5-bcfd-f46d7f10dce1-kube-api-access-thdvg\") pod \"cert-manager-55b4d954d5-gzw5j\" (UID: \"e5624f90-7d4d-45d5-bcfd-f46d7f10dce1\") " pod="cert-manager/cert-manager-55b4d954d5-gzw5j"
Jul 02 17:18:42.270954 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:18:42.270928    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-thdvg\" (UniqueName: \"kubernetes.io/projected/e5624f90-7d4d-45d5-bcfd-f46d7f10dce1-kube-api-access-thdvg\") pod \"cert-manager-55b4d954d5-gzw5j\" (UID: \"e5624f90-7d4d-45d5-bcfd-f46d7f10dce1\") " pod="cert-manager/cert-manager-55b4d954d5-gzw5j"
Jul 02 17:18:42.271432 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:18:42.271409    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e5624f90-7d4d-45d5-bcfd-f46d7f10dce1-bound-sa-token\") pod \"cert-manager-55b4d954d5-gzw5j\" (UID: \"e5624f90-7d4d-45d5-bcfd-f46d7f10dce1\") " pod="cert-manager/cert-manager-55b4d954d5-gzw5j"
Jul 02 17:18:42.309057 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:18:42.309032    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-gzw5j"
Jul 02 17:18:42.436277 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:18:42.436247    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-gzw5j"]
Jul 02 17:18:42.438475 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:18:42.438450    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode5624f90_7d4d_45d5_bcfd_f46d7f10dce1.slice/crio-ca55e354a2e32eee53db7de5aed458a6d04bf30172ebb8de180b3677a6393afe WatchSource:0}: Error finding container ca55e354a2e32eee53db7de5aed458a6d04bf30172ebb8de180b3677a6393afe: Status 404 returned error can't find the container with id ca55e354a2e32eee53db7de5aed458a6d04bf30172ebb8de180b3677a6393afe
Jul 02 17:18:43.298519 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:18:43.298483    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-gzw5j" event={"ID":"e5624f90-7d4d-45d5-bcfd-f46d7f10dce1","Type":"ContainerStarted","Data":"ca55e354a2e32eee53db7de5aed458a6d04bf30172ebb8de180b3677a6393afe"}
Jul 02 17:18:45.961933 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:18:45.961867    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:18:46.063382 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:18:46.063349    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:18:47.318126 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:18:47.318073    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-gzw5j" event={"ID":"e5624f90-7d4d-45d5-bcfd-f46d7f10dce1","Type":"ContainerStarted","Data":"56b661300ed13288b186a1bafd9b1eb1bf27ab9b64a2f876ecd5d5f5349d6e9a"}
Jul 02 17:18:47.335108 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:18:47.335050    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-gzw5j" podStartSLOduration=2.414504843 podStartE2EDuration="6.335001115s" totalImagesPullingTime="3.920496272s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:18:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:18:47.332996162 +0000 UTC m=+482.522698825" watchObservedRunningTime="2026-07-02 17:18:47.335001115 +0000 UTC m=+482.524703777"
Jul 02 17:18:47.761909 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:18:47.761836    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:18:53.158979 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:18:53.158942    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:18:58.478616 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:18:58.478578    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:18:58.579701 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:18:58.579672    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:19:02.504242 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:02.504207    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:19:02.604308 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:02.604278    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:19:03.132304 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:03.132269    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:19:03.403130 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:03.403051    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:19:03.493816 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:03.493776    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:19:03.499471 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:03.499450    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-546844fdf5-j5sp2"]
Jul 02 17:19:03.502975 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:03.502952    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-546844fdf5-j5sp2"
Jul 02 17:19:03.506862 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:03.506838    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 02 17:19:03.506862 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:03.506855    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 02 17:19:03.507305 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:03.506927    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 02 17:19:03.507305 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:03.506980    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-rf7js\""
Jul 02 17:19:03.507305 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:03.507246    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 02 17:19:03.527130 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:03.527109    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/63713c60-9a6d-4d34-9410-a52fa9a31850-manifests\") pod \"opendatahub-operator-controller-manager-546844fdf5-j5sp2\" (UID: \"63713c60-9a6d-4d34-9410-a52fa9a31850\") " pod="opendatahub/opendatahub-operator-controller-manager-546844fdf5-j5sp2"
Jul 02 17:19:03.527233 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:03.527142    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s525h\" (UniqueName: \"kubernetes.io/projected/63713c60-9a6d-4d34-9410-a52fa9a31850-kube-api-access-s525h\") pod \"opendatahub-operator-controller-manager-546844fdf5-j5sp2\" (UID: \"63713c60-9a6d-4d34-9410-a52fa9a31850\") " pod="opendatahub/opendatahub-operator-controller-manager-546844fdf5-j5sp2"
Jul 02 17:19:03.527233 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:03.527174    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/63713c60-9a6d-4d34-9410-a52fa9a31850-tmp\") pod \"opendatahub-operator-controller-manager-546844fdf5-j5sp2\" (UID: \"63713c60-9a6d-4d34-9410-a52fa9a31850\") " pod="opendatahub/opendatahub-operator-controller-manager-546844fdf5-j5sp2"
Jul 02 17:19:03.527333 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:03.527260    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/63713c60-9a6d-4d34-9410-a52fa9a31850-webhook-cert\") pod \"opendatahub-operator-controller-manager-546844fdf5-j5sp2\" (UID: \"63713c60-9a6d-4d34-9410-a52fa9a31850\") " pod="opendatahub/opendatahub-operator-controller-manager-546844fdf5-j5sp2"
Jul 02 17:19:03.527333 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:03.527290    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/63713c60-9a6d-4d34-9410-a52fa9a31850-apiservice-cert\") pod \"opendatahub-operator-controller-manager-546844fdf5-j5sp2\" (UID: \"63713c60-9a6d-4d34-9410-a52fa9a31850\") " pod="opendatahub/opendatahub-operator-controller-manager-546844fdf5-j5sp2"
Jul 02 17:19:03.531145 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:03.531125    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-546844fdf5-j5sp2"]
Jul 02 17:19:03.628470 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:03.628445    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/63713c60-9a6d-4d34-9410-a52fa9a31850-manifests\") pod \"opendatahub-operator-controller-manager-546844fdf5-j5sp2\" (UID: \"63713c60-9a6d-4d34-9410-a52fa9a31850\") " pod="opendatahub/opendatahub-operator-controller-manager-546844fdf5-j5sp2"
Jul 02 17:19:03.628568 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:03.628479    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s525h\" (UniqueName: \"kubernetes.io/projected/63713c60-9a6d-4d34-9410-a52fa9a31850-kube-api-access-s525h\") pod \"opendatahub-operator-controller-manager-546844fdf5-j5sp2\" (UID: \"63713c60-9a6d-4d34-9410-a52fa9a31850\") " pod="opendatahub/opendatahub-operator-controller-manager-546844fdf5-j5sp2"
Jul 02 17:19:03.628568 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:03.628507    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/63713c60-9a6d-4d34-9410-a52fa9a31850-tmp\") pod \"opendatahub-operator-controller-manager-546844fdf5-j5sp2\" (UID: \"63713c60-9a6d-4d34-9410-a52fa9a31850\") " pod="opendatahub/opendatahub-operator-controller-manager-546844fdf5-j5sp2"
Jul 02 17:19:03.628568 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:03.628552    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/63713c60-9a6d-4d34-9410-a52fa9a31850-webhook-cert\") pod \"opendatahub-operator-controller-manager-546844fdf5-j5sp2\" (UID: \"63713c60-9a6d-4d34-9410-a52fa9a31850\") " pod="opendatahub/opendatahub-operator-controller-manager-546844fdf5-j5sp2"
Jul 02 17:19:03.628664 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:03.628569    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/63713c60-9a6d-4d34-9410-a52fa9a31850-apiservice-cert\") pod \"opendatahub-operator-controller-manager-546844fdf5-j5sp2\" (UID: \"63713c60-9a6d-4d34-9410-a52fa9a31850\") " pod="opendatahub/opendatahub-operator-controller-manager-546844fdf5-j5sp2"
Jul 02 17:19:03.628989 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:03.628968    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/63713c60-9a6d-4d34-9410-a52fa9a31850-manifests\") pod \"opendatahub-operator-controller-manager-546844fdf5-j5sp2\" (UID: \"63713c60-9a6d-4d34-9410-a52fa9a31850\") " pod="opendatahub/opendatahub-operator-controller-manager-546844fdf5-j5sp2"
Jul 02 17:19:03.630913 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:03.630870    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/63713c60-9a6d-4d34-9410-a52fa9a31850-tmp\") pod \"opendatahub-operator-controller-manager-546844fdf5-j5sp2\" (UID: \"63713c60-9a6d-4d34-9410-a52fa9a31850\") " pod="opendatahub/opendatahub-operator-controller-manager-546844fdf5-j5sp2"
Jul 02 17:19:03.630993 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:03.630965    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/63713c60-9a6d-4d34-9410-a52fa9a31850-webhook-cert\") pod \"opendatahub-operator-controller-manager-546844fdf5-j5sp2\" (UID: \"63713c60-9a6d-4d34-9410-a52fa9a31850\") " pod="opendatahub/opendatahub-operator-controller-manager-546844fdf5-j5sp2"
Jul 02 17:19:03.631051 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:03.631002    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/63713c60-9a6d-4d34-9410-a52fa9a31850-apiservice-cert\") pod \"opendatahub-operator-controller-manager-546844fdf5-j5sp2\" (UID: \"63713c60-9a6d-4d34-9410-a52fa9a31850\") " pod="opendatahub/opendatahub-operator-controller-manager-546844fdf5-j5sp2"
Jul 02 17:19:03.642963 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:03.642944    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s525h\" (UniqueName: \"kubernetes.io/projected/63713c60-9a6d-4d34-9410-a52fa9a31850-kube-api-access-s525h\") pod \"opendatahub-operator-controller-manager-546844fdf5-j5sp2\" (UID: \"63713c60-9a6d-4d34-9410-a52fa9a31850\") " pod="opendatahub/opendatahub-operator-controller-manager-546844fdf5-j5sp2"
Jul 02 17:19:03.705150 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:03.705096    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:19:03.804869 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:03.804792    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:19:03.813656 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:03.813634    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-546844fdf5-j5sp2"
Jul 02 17:19:03.911974 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:03.911943    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:19:03.945237 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:03.945214    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-546844fdf5-j5sp2"]
Jul 02 17:19:03.947303 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:19:03.947276    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63713c60_9a6d_4d34_9410_a52fa9a31850.slice/crio-07c9ad82fea8f8a6011c6618cd206c6d178801e9b74129f78fae6afbbad962b2 WatchSource:0}: Error finding container 07c9ad82fea8f8a6011c6618cd206c6d178801e9b74129f78fae6afbbad962b2: Status 404 returned error can't find the container with id 07c9ad82fea8f8a6011c6618cd206c6d178801e9b74129f78fae6afbbad962b2
Jul 02 17:19:04.007769 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:04.007737    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:19:04.108858 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:04.108829    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:19:04.206616 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:04.206577    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:19:04.349895 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:04.349796    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:19:04.390806 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:04.390771    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-546844fdf5-j5sp2" event={"ID":"63713c60-9a6d-4d34-9410-a52fa9a31850","Type":"ContainerStarted","Data":"07c9ad82fea8f8a6011c6618cd206c6d178801e9b74129f78fae6afbbad962b2"}
Jul 02 17:19:07.406912 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:07.406881    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-546844fdf5-j5sp2" event={"ID":"63713c60-9a6d-4d34-9410-a52fa9a31850","Type":"ContainerStarted","Data":"26ac3c26c7df7d588c27c6dddce60fe2a06dae75c19a8050e6e928b14c991ad6"}
Jul 02 17:19:08.413099 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:08.413007    2578 generic.go:356] "Generic (PLEG): container finished" podID="63713c60-9a6d-4d34-9410-a52fa9a31850" containerID="26ac3c26c7df7d588c27c6dddce60fe2a06dae75c19a8050e6e928b14c991ad6" exitCode=0
Jul 02 17:19:08.413099 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:08.413088    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-546844fdf5-j5sp2" event={"ID":"63713c60-9a6d-4d34-9410-a52fa9a31850","Type":"ContainerDied","Data":"26ac3c26c7df7d588c27c6dddce60fe2a06dae75c19a8050e6e928b14c991ad6"}
Jul 02 17:19:09.419885 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:09.419854    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-546844fdf5-j5sp2" event={"ID":"63713c60-9a6d-4d34-9410-a52fa9a31850","Type":"ContainerStarted","Data":"0e25cb44ac173be5116cc8d34f1f2a8802f48125f10077b6a964852ade742e2e"}
Jul 02 17:19:09.420287 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:09.419928    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-546844fdf5-j5sp2"
Jul 02 17:19:09.443054 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:09.442983    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-546844fdf5-j5sp2" podStartSLOduration=2.142713517 podStartE2EDuration="6.442965997s" totalImagesPullingTime="3.25767615s" totalInitContainerRuntime="1.04257633s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:19:03 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:19:09.441515878 +0000 UTC m=+504.631218541" watchObservedRunningTime="2026-07-02 17:19:09.442965997 +0000 UTC m=+504.632668660"
Jul 02 17:19:20.426448 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:20.426413    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-546844fdf5-j5sp2"
Jul 02 17:19:22.067151 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:22.067118    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:19:22.206054 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:22.205994    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:19:22.422747 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:22.422657    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:19:22.510340 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:22.510309    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-9bd877769-nlvhd"]
Jul 02 17:19:22.525526 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:22.525497    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-9bd877769-nlvhd"
Jul 02 17:19:22.528820 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:22.528796    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-cf67b\""
Jul 02 17:19:22.529338 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:22.529322    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 02 17:19:22.530108 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:22.530091    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 02 17:19:22.530321 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:22.530123    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 02 17:19:22.530424 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:22.530147    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 02 17:19:22.533159 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:22.533136    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-9bd877769-nlvhd"]
Jul 02 17:19:22.570010 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:22.569988    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/057410fa-77f8-4908-9eb6-148f8551c62a-tmp\") pod \"kube-auth-proxy-9bd877769-nlvhd\" (UID: \"057410fa-77f8-4908-9eb6-148f8551c62a\") " pod="openshift-ingress/kube-auth-proxy-9bd877769-nlvhd"
Jul 02 17:19:22.570115 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:22.570063    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/057410fa-77f8-4908-9eb6-148f8551c62a-tls-certs\") pod \"kube-auth-proxy-9bd877769-nlvhd\" (UID: \"057410fa-77f8-4908-9eb6-148f8551c62a\") " pod="openshift-ingress/kube-auth-proxy-9bd877769-nlvhd"
Jul 02 17:19:22.570115 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:22.570103    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8tm4\" (UniqueName: \"kubernetes.io/projected/057410fa-77f8-4908-9eb6-148f8551c62a-kube-api-access-v8tm4\") pod \"kube-auth-proxy-9bd877769-nlvhd\" (UID: \"057410fa-77f8-4908-9eb6-148f8551c62a\") " pod="openshift-ingress/kube-auth-proxy-9bd877769-nlvhd"
Jul 02 17:19:22.671294 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:22.671263    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/057410fa-77f8-4908-9eb6-148f8551c62a-tls-certs\") pod \"kube-auth-proxy-9bd877769-nlvhd\" (UID: \"057410fa-77f8-4908-9eb6-148f8551c62a\") " pod="openshift-ingress/kube-auth-proxy-9bd877769-nlvhd"
Jul 02 17:19:22.671504 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:22.671331    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8tm4\" (UniqueName: \"kubernetes.io/projected/057410fa-77f8-4908-9eb6-148f8551c62a-kube-api-access-v8tm4\") pod \"kube-auth-proxy-9bd877769-nlvhd\" (UID: \"057410fa-77f8-4908-9eb6-148f8551c62a\") " pod="openshift-ingress/kube-auth-proxy-9bd877769-nlvhd"
Jul 02 17:19:22.671504 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:22.671381    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/057410fa-77f8-4908-9eb6-148f8551c62a-tmp\") pod \"kube-auth-proxy-9bd877769-nlvhd\" (UID: \"057410fa-77f8-4908-9eb6-148f8551c62a\") " pod="openshift-ingress/kube-auth-proxy-9bd877769-nlvhd"
Jul 02 17:19:22.671504 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:19:22.671431    2578 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 02 17:19:22.671666 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:19:22.671514    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/057410fa-77f8-4908-9eb6-148f8551c62a-tls-certs podName:057410fa-77f8-4908-9eb6-148f8551c62a nodeName:}" failed. No retries permitted until 2026-07-02 17:19:23.171492182 +0000 UTC m=+518.361194841 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/057410fa-77f8-4908-9eb6-148f8551c62a-tls-certs") pod "kube-auth-proxy-9bd877769-nlvhd" (UID: "057410fa-77f8-4908-9eb6-148f8551c62a") : secret "kube-auth-proxy-tls" not found
Jul 02 17:19:22.673732 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:22.673679    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/057410fa-77f8-4908-9eb6-148f8551c62a-tmp\") pod \"kube-auth-proxy-9bd877769-nlvhd\" (UID: \"057410fa-77f8-4908-9eb6-148f8551c62a\") " pod="openshift-ingress/kube-auth-proxy-9bd877769-nlvhd"
Jul 02 17:19:22.688814 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:22.688794    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8tm4\" (UniqueName: \"kubernetes.io/projected/057410fa-77f8-4908-9eb6-148f8551c62a-kube-api-access-v8tm4\") pod \"kube-auth-proxy-9bd877769-nlvhd\" (UID: \"057410fa-77f8-4908-9eb6-148f8551c62a\") " pod="openshift-ingress/kube-auth-proxy-9bd877769-nlvhd"
Jul 02 17:19:22.861810 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:22.861758    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-94s9k"]
Jul 02 17:19:22.865196 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:22.865171    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-94s9k"
Jul 02 17:19:22.868332 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:22.868311    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 02 17:19:22.868777 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:22.868757    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-wt5bb\""
Jul 02 17:19:22.874972 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:22.874951    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-94s9k"]
Jul 02 17:19:22.892418 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:22.892392    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:19:22.973623 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:22.973585    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7c8256b7-dd73-4aaf-b4a6-70ca72b4864b-cert\") pod \"odh-model-controller-7998c67dc4-94s9k\" (UID: \"7c8256b7-dd73-4aaf-b4a6-70ca72b4864b\") " pod="opendatahub/odh-model-controller-7998c67dc4-94s9k"
Jul 02 17:19:22.973779 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:22.973641    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47727\" (UniqueName: \"kubernetes.io/projected/7c8256b7-dd73-4aaf-b4a6-70ca72b4864b-kube-api-access-47727\") pod \"odh-model-controller-7998c67dc4-94s9k\" (UID: \"7c8256b7-dd73-4aaf-b4a6-70ca72b4864b\") " pod="opendatahub/odh-model-controller-7998c67dc4-94s9k"
Jul 02 17:19:23.073372 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:23.073338    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:19:23.074264 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:23.074238    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7c8256b7-dd73-4aaf-b4a6-70ca72b4864b-cert\") pod \"odh-model-controller-7998c67dc4-94s9k\" (UID: \"7c8256b7-dd73-4aaf-b4a6-70ca72b4864b\") " pod="opendatahub/odh-model-controller-7998c67dc4-94s9k"
Jul 02 17:19:23.074406 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:23.074273    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47727\" (UniqueName: \"kubernetes.io/projected/7c8256b7-dd73-4aaf-b4a6-70ca72b4864b-kube-api-access-47727\") pod \"odh-model-controller-7998c67dc4-94s9k\" (UID: \"7c8256b7-dd73-4aaf-b4a6-70ca72b4864b\") " pod="opendatahub/odh-model-controller-7998c67dc4-94s9k"
Jul 02 17:19:23.076916 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:23.076892    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7c8256b7-dd73-4aaf-b4a6-70ca72b4864b-cert\") pod \"odh-model-controller-7998c67dc4-94s9k\" (UID: \"7c8256b7-dd73-4aaf-b4a6-70ca72b4864b\") " pod="opendatahub/odh-model-controller-7998c67dc4-94s9k"
Jul 02 17:19:23.084954 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:23.084926    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-47727\" (UniqueName: \"kubernetes.io/projected/7c8256b7-dd73-4aaf-b4a6-70ca72b4864b-kube-api-access-47727\") pod \"odh-model-controller-7998c67dc4-94s9k\" (UID: \"7c8256b7-dd73-4aaf-b4a6-70ca72b4864b\") " pod="opendatahub/odh-model-controller-7998c67dc4-94s9k"
Jul 02 17:19:23.172085 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:23.172044    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:19:23.175140 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:23.175114    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/057410fa-77f8-4908-9eb6-148f8551c62a-tls-certs\") pod \"kube-auth-proxy-9bd877769-nlvhd\" (UID: \"057410fa-77f8-4908-9eb6-148f8551c62a\") " pod="openshift-ingress/kube-auth-proxy-9bd877769-nlvhd"
Jul 02 17:19:23.176600 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:23.176574    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-94s9k"
Jul 02 17:19:23.177457 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:23.177441    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/057410fa-77f8-4908-9eb6-148f8551c62a-tls-certs\") pod \"kube-auth-proxy-9bd877769-nlvhd\" (UID: \"057410fa-77f8-4908-9eb6-148f8551c62a\") " pod="openshift-ingress/kube-auth-proxy-9bd877769-nlvhd"
Jul 02 17:19:23.322076 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:23.322050    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-94s9k"]
Jul 02 17:19:23.324262 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:19:23.324235    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c8256b7_dd73_4aaf_b4a6_70ca72b4864b.slice/crio-ce8c9bbd3efa1f490186775a289b574f8c34a039b1b72adfb7d9d39dbdef32f8 WatchSource:0}: Error finding container ce8c9bbd3efa1f490186775a289b574f8c34a039b1b72adfb7d9d39dbdef32f8: Status 404 returned error can't find the container with id ce8c9bbd3efa1f490186775a289b574f8c34a039b1b72adfb7d9d39dbdef32f8
Jul 02 17:19:23.436770 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:23.436740    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-9bd877769-nlvhd"
Jul 02 17:19:23.483324 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:23.483253    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-94s9k" event={"ID":"7c8256b7-dd73-4aaf-b4a6-70ca72b4864b","Type":"ContainerStarted","Data":"ce8c9bbd3efa1f490186775a289b574f8c34a039b1b72adfb7d9d39dbdef32f8"}
Jul 02 17:19:23.577130 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:23.577105    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-9bd877769-nlvhd"]
Jul 02 17:19:23.579116 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:19:23.579088    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod057410fa_77f8_4908_9eb6_148f8551c62a.slice/crio-777b2172ef09cbd80249fe47da9eee8c21ca49fba94859715afbebdd51b84e7b WatchSource:0}: Error finding container 777b2172ef09cbd80249fe47da9eee8c21ca49fba94859715afbebdd51b84e7b: Status 404 returned error can't find the container with id 777b2172ef09cbd80249fe47da9eee8c21ca49fba94859715afbebdd51b84e7b
Jul 02 17:19:23.704854 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:23.704820    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:19:23.807731 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:23.807641    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7f779dbb76-jk4q7"]
Jul 02 17:19:23.811203 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:23.811180    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7f779dbb76-jk4q7"
Jul 02 17:19:23.815554 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:23.815530    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 02 17:19:23.816419 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:23.816400    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 02 17:19:23.816547 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:23.816423    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 02 17:19:23.816817 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:23.816802    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-55p5f\""
Jul 02 17:19:23.816943 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:23.816887    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 02 17:19:23.817260 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:23.817064    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 02 17:19:23.825507 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:23.825486    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7f779dbb76-jk4q7"]
Jul 02 17:19:23.883440 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:23.883419    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lskgc\" (UniqueName: \"kubernetes.io/projected/7c8d5b08-8ed9-47c0-90fd-1038a2d26c62-kube-api-access-lskgc\") pod \"lws-controller-manager-7f779dbb76-jk4q7\" (UID: \"7c8d5b08-8ed9-47c0-90fd-1038a2d26c62\") " pod="openshift-lws-operator/lws-controller-manager-7f779dbb76-jk4q7"
Jul 02 17:19:23.883565 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:23.883470    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7c8d5b08-8ed9-47c0-90fd-1038a2d26c62-metrics-cert\") pod \"lws-controller-manager-7f779dbb76-jk4q7\" (UID: \"7c8d5b08-8ed9-47c0-90fd-1038a2d26c62\") " pod="openshift-lws-operator/lws-controller-manager-7f779dbb76-jk4q7"
Jul 02 17:19:23.883565 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:23.883492    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7c8d5b08-8ed9-47c0-90fd-1038a2d26c62-cert\") pod \"lws-controller-manager-7f779dbb76-jk4q7\" (UID: \"7c8d5b08-8ed9-47c0-90fd-1038a2d26c62\") " pod="openshift-lws-operator/lws-controller-manager-7f779dbb76-jk4q7"
Jul 02 17:19:23.883639 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:23.883619    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7c8d5b08-8ed9-47c0-90fd-1038a2d26c62-manager-config\") pod \"lws-controller-manager-7f779dbb76-jk4q7\" (UID: \"7c8d5b08-8ed9-47c0-90fd-1038a2d26c62\") " pod="openshift-lws-operator/lws-controller-manager-7f779dbb76-jk4q7"
Jul 02 17:19:23.930996 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:23.930970    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:19:23.984723 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:23.984700    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7c8d5b08-8ed9-47c0-90fd-1038a2d26c62-metrics-cert\") pod \"lws-controller-manager-7f779dbb76-jk4q7\" (UID: \"7c8d5b08-8ed9-47c0-90fd-1038a2d26c62\") " pod="openshift-lws-operator/lws-controller-manager-7f779dbb76-jk4q7"
Jul 02 17:19:23.984843 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:23.984739    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7c8d5b08-8ed9-47c0-90fd-1038a2d26c62-cert\") pod \"lws-controller-manager-7f779dbb76-jk4q7\" (UID: \"7c8d5b08-8ed9-47c0-90fd-1038a2d26c62\") " pod="openshift-lws-operator/lws-controller-manager-7f779dbb76-jk4q7"
Jul 02 17:19:23.984843 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:23.984812    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7c8d5b08-8ed9-47c0-90fd-1038a2d26c62-manager-config\") pod \"lws-controller-manager-7f779dbb76-jk4q7\" (UID: \"7c8d5b08-8ed9-47c0-90fd-1038a2d26c62\") " pod="openshift-lws-operator/lws-controller-manager-7f779dbb76-jk4q7"
Jul 02 17:19:23.984951 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:23.984841    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lskgc\" (UniqueName: \"kubernetes.io/projected/7c8d5b08-8ed9-47c0-90fd-1038a2d26c62-kube-api-access-lskgc\") pod \"lws-controller-manager-7f779dbb76-jk4q7\" (UID: \"7c8d5b08-8ed9-47c0-90fd-1038a2d26c62\") " pod="openshift-lws-operator/lws-controller-manager-7f779dbb76-jk4q7"
Jul 02 17:19:23.985500 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:23.985479    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7c8d5b08-8ed9-47c0-90fd-1038a2d26c62-manager-config\") pod \"lws-controller-manager-7f779dbb76-jk4q7\" (UID: \"7c8d5b08-8ed9-47c0-90fd-1038a2d26c62\") " pod="openshift-lws-operator/lws-controller-manager-7f779dbb76-jk4q7"
Jul 02 17:19:23.987216 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:23.987196    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7c8d5b08-8ed9-47c0-90fd-1038a2d26c62-cert\") pod \"lws-controller-manager-7f779dbb76-jk4q7\" (UID: \"7c8d5b08-8ed9-47c0-90fd-1038a2d26c62\") " pod="openshift-lws-operator/lws-controller-manager-7f779dbb76-jk4q7"
Jul 02 17:19:23.987315 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:23.987276    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7c8d5b08-8ed9-47c0-90fd-1038a2d26c62-metrics-cert\") pod \"lws-controller-manager-7f779dbb76-jk4q7\" (UID: \"7c8d5b08-8ed9-47c0-90fd-1038a2d26c62\") " pod="openshift-lws-operator/lws-controller-manager-7f779dbb76-jk4q7"
Jul 02 17:19:24.004465 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:24.004393    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lskgc\" (UniqueName: \"kubernetes.io/projected/7c8d5b08-8ed9-47c0-90fd-1038a2d26c62-kube-api-access-lskgc\") pod \"lws-controller-manager-7f779dbb76-jk4q7\" (UID: \"7c8d5b08-8ed9-47c0-90fd-1038a2d26c62\") " pod="openshift-lws-operator/lws-controller-manager-7f779dbb76-jk4q7"
Jul 02 17:19:24.028923 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:24.028886    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:19:24.111081 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:24.110961    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:19:24.124167 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:24.123828    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7f779dbb76-jk4q7"
Jul 02 17:19:24.198383 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:24.198304    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:19:24.284104 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:24.284053    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7f779dbb76-jk4q7"]
Jul 02 17:19:24.286631 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:19:24.286603    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c8d5b08_8ed9_47c0_90fd_1038a2d26c62.slice/crio-4ebd0ad638d10de2b24b11fd7e3fec921d06f058491536d36c8ecfd9afd963e8 WatchSource:0}: Error finding container 4ebd0ad638d10de2b24b11fd7e3fec921d06f058491536d36c8ecfd9afd963e8: Status 404 returned error can't find the container with id 4ebd0ad638d10de2b24b11fd7e3fec921d06f058491536d36c8ecfd9afd963e8
Jul 02 17:19:24.490007 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:24.489890    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-9bd877769-nlvhd" event={"ID":"057410fa-77f8-4908-9eb6-148f8551c62a","Type":"ContainerStarted","Data":"777b2172ef09cbd80249fe47da9eee8c21ca49fba94859715afbebdd51b84e7b"}
Jul 02 17:19:24.496705 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:24.496667    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7f779dbb76-jk4q7" event={"ID":"7c8d5b08-8ed9-47c0-90fd-1038a2d26c62","Type":"ContainerStarted","Data":"4ebd0ad638d10de2b24b11fd7e3fec921d06f058491536d36c8ecfd9afd963e8"}
Jul 02 17:19:24.942349 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:24.942260    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:19:28.449117 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:28.449080    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:19:28.547374 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:28.547322    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:19:29.127033 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:29.126927    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:19:29.432763 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:29.432651    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:19:29.524960 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:29.524908    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-94s9k" event={"ID":"7c8256b7-dd73-4aaf-b4a6-70ca72b4864b","Type":"ContainerStarted","Data":"bf911f6a68cb7a11755c035c116e6216ca806b478d7c4f23924e5687def41a99"}
Jul 02 17:19:29.525418 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:29.525071    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-94s9k"
Jul 02 17:19:29.526915 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:29.526887    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-9bd877769-nlvhd" event={"ID":"057410fa-77f8-4908-9eb6-148f8551c62a","Type":"ContainerStarted","Data":"16fe7b259632c1fa5f48dd4dc3aaa93dea4056ec9a140bca601661510adfdaa5"}
Jul 02 17:19:29.528544 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:29.528523    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7f779dbb76-jk4q7" event={"ID":"7c8d5b08-8ed9-47c0-90fd-1038a2d26c62","Type":"ContainerStarted","Data":"f229f1b98ad5aef35045d9acefdd34ac4a0ff07e385ae56d7dc4dd1ea9122acb"}
Jul 02 17:19:29.528744 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:29.528725    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7f779dbb76-jk4q7"
Jul 02 17:19:29.543774 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:29.543734    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-94s9k" podStartSLOduration=1.9939946100000001 podStartE2EDuration="7.543721596s" totalImagesPullingTime="5.549726986s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:19:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:19:29.542996835 +0000 UTC m=+524.732699498" watchObservedRunningTime="2026-07-02 17:19:29.543721596 +0000 UTC m=+524.733424279"
Jul 02 17:19:29.559844 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:29.559795    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-9bd877769-nlvhd" podStartSLOduration=2.262421181 podStartE2EDuration="7.559781155s" totalImagesPullingTime="5.297359974s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:19:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:19:29.559110274 +0000 UTC m=+524.748812937" watchObservedRunningTime="2026-07-02 17:19:29.559781155 +0000 UTC m=+524.749483839"
Jul 02 17:19:29.563580 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:29.563548    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:19:29.580838 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:29.580785    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7f779dbb76-jk4q7" podStartSLOduration=1.987060585 podStartE2EDuration="6.580764452s" totalImagesPullingTime="4.593703867s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:19:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:19:29.578889946 +0000 UTC m=+524.768592609" watchObservedRunningTime="2026-07-02 17:19:29.580764452 +0000 UTC m=+524.770467117"
Jul 02 17:19:33.656010 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:33.655973    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:19:33.764905 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:33.764855    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:19:33.942236 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:33.942142    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:19:34.119453 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:34.119417    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:19:34.946508 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:34.946471    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:19:35.037758 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:35.037722    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:19:35.104676 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:35.104644    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:19:40.535279 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:40.535195    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-94s9k"
Jul 02 17:19:40.535704 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:19:40.535326    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7f779dbb76-jk4q7"
Jul 02 17:20:07.988769 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:20:07.988731    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:20:09.719963 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:20:09.719921    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:20:09.945089 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:20:09.945052    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:20:10.202949 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:20:10.202859    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:20:21.761394 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:20:21.761359    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:20:23.643668 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:20:23.643616    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:20:23.705403 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:20:23.705366    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:20:23.814581 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:20:23.814539    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:20:45.312001 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:20:45.311973    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-62g9m_d6628590-1cf7-4a61-9350-539f3ae7ed91/ovn-acl-logging/0.log"
Jul 02 17:20:45.313245 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:20:45.313218    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-62g9m_d6628590-1cf7-4a61-9350-539f3ae7ed91/ovn-acl-logging/0.log"
Jul 02 17:20:52.648357 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:20:52.648320    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:20:56.234273 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:20:56.234234    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:20:56.376222 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:20:56.376180    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:20:57.234754 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:20:57.234722    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:20:57.335607 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:20:57.335574    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:20:57.436685 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:20:57.436648    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:20:57.966856 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:20:57.966820    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:20:58.038565 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:20:58.038528    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:21:00.889720 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:21:00.889684    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:21:01.223054 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:21:01.223001    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:21:02.676602 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:21:02.676561    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:21:04.245530 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:21:04.245464    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:21:05.116528 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:21:05.116493    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:21:05.235580 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:21:05.235542    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:21:07.069914 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:21:07.069823    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:21:08.296822 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:21:08.296782    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:21:08.388576 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:21:08.388539    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:21:08.493192 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:21:08.493165    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:21:11.638272 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:21:11.638234    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:21:11.740965 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:21:11.740932    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:21:13.059005 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:21:13.058972    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-jxhnn"]
Jul 02 17:21:13.061083 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:21:13.061062    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jxhnn"
Jul 02 17:21:13.062175 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:21:13.062151    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:21:13.063745 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:21:13.063722    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 02 17:21:13.063745 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:21:13.063736    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 02 17:21:13.063988 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:21:13.063972    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 02 17:21:13.065075 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:21:13.065055    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-86b9l\""
Jul 02 17:21:13.065168 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:21:13.065077    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 02 17:21:13.069190 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:21:13.069172    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-jxhnn"]
Jul 02 17:21:13.147310 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:21:13.147281    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpx5n\" (UniqueName: \"kubernetes.io/projected/3287948f-6d6f-4b90-87e8-330a024eeae7-kube-api-access-kpx5n\") pod \"kuadrant-console-plugin-66b5774985-jxhnn\" (UID: \"3287948f-6d6f-4b90-87e8-330a024eeae7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jxhnn"
Jul 02 17:21:13.147401 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:21:13.147313    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3287948f-6d6f-4b90-87e8-330a024eeae7-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-jxhnn\" (UID: \"3287948f-6d6f-4b90-87e8-330a024eeae7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jxhnn"
Jul 02 17:21:13.147401 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:21:13.147333    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/3287948f-6d6f-4b90-87e8-330a024eeae7-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-jxhnn\" (UID: \"3287948f-6d6f-4b90-87e8-330a024eeae7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jxhnn"
Jul 02 17:21:13.188399 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:21:13.188375    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:21:13.248529 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:21:13.248499    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpx5n\" (UniqueName: \"kubernetes.io/projected/3287948f-6d6f-4b90-87e8-330a024eeae7-kube-api-access-kpx5n\") pod \"kuadrant-console-plugin-66b5774985-jxhnn\" (UID: \"3287948f-6d6f-4b90-87e8-330a024eeae7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jxhnn"
Jul 02 17:21:13.248634 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:21:13.248536    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3287948f-6d6f-4b90-87e8-330a024eeae7-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-jxhnn\" (UID: \"3287948f-6d6f-4b90-87e8-330a024eeae7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jxhnn"
Jul 02 17:21:13.248634 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:21:13.248554    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/3287948f-6d6f-4b90-87e8-330a024eeae7-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-jxhnn\" (UID: \"3287948f-6d6f-4b90-87e8-330a024eeae7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jxhnn"
Jul 02 17:21:13.249201 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:21:13.249178    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3287948f-6d6f-4b90-87e8-330a024eeae7-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-jxhnn\" (UID: \"3287948f-6d6f-4b90-87e8-330a024eeae7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jxhnn"
Jul 02 17:21:13.251068 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:21:13.251047    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/3287948f-6d6f-4b90-87e8-330a024eeae7-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-jxhnn\" (UID: \"3287948f-6d6f-4b90-87e8-330a024eeae7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jxhnn"
Jul 02 17:21:13.262485 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:21:13.262467    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpx5n\" (UniqueName: \"kubernetes.io/projected/3287948f-6d6f-4b90-87e8-330a024eeae7-kube-api-access-kpx5n\") pod \"kuadrant-console-plugin-66b5774985-jxhnn\" (UID: \"3287948f-6d6f-4b90-87e8-330a024eeae7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jxhnn"
Jul 02 17:21:13.371558 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:21:13.371508    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jxhnn"
Jul 02 17:21:13.497317 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:21:13.497293    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-jxhnn"]
Jul 02 17:21:13.499854 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:21:13.499830    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3287948f_6d6f_4b90_87e8_330a024eeae7.slice/crio-204ec92a740b7615484324eae26180b81d025a9837f2da58b2d2ad8d055a1f21 WatchSource:0}: Error finding container 204ec92a740b7615484324eae26180b81d025a9837f2da58b2d2ad8d055a1f21: Status 404 returned error can't find the container with id 204ec92a740b7615484324eae26180b81d025a9837f2da58b2d2ad8d055a1f21
Jul 02 17:21:13.501397 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:21:13.501379    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 17:21:13.982827 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:21:13.982798    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jxhnn" event={"ID":"3287948f-6d6f-4b90-87e8-330a024eeae7","Type":"ContainerStarted","Data":"204ec92a740b7615484324eae26180b81d025a9837f2da58b2d2ad8d055a1f21"}
Jul 02 17:21:20.444741 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:21:20.444699    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:21:20.540756 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:21:20.540721    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:21:22.969515 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:21:22.969452    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:21:23.068950 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:21:23.068916    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:21:27.234499 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:21:27.234461    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:21:27.335412 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:21:27.335375    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:21:29.691980 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:21:29.691941    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:21:29.789747 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:21:29.789711    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:21:36.102449 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:21:36.102417    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jxhnn" event={"ID":"3287948f-6d6f-4b90-87e8-330a024eeae7","Type":"ContainerStarted","Data":"98631f53d97343c8ff4254a8a1f16230f57b7a3293be92f78c2a8e27e2769bd5"}
Jul 02 17:21:36.118396 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:21:36.118350    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jxhnn" podStartSLOduration=1.094082111 podStartE2EDuration="23.118335326s" totalImagesPullingTime="22.024253215s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:21:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:21:36.117522422 +0000 UTC m=+651.307225085" watchObservedRunningTime="2026-07-02 17:21:36.118335326 +0000 UTC m=+651.308037987"
Jul 02 17:21:38.464966 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:21:38.464905    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:21:38.579686 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:21:38.579657    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:21:40.904618 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:21:40.904583    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:21:40.965691 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:21:40.965671    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:21:45.265307 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:21:45.265260    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:21:45.366360 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:21:45.366322    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:21:48.942628 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:21:48.942590    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:21:49.041118 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:21:49.041083    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:21:52.618174 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:21:52.618140    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:21:53.148966 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:21:53.148926    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:21:58.454529 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:21:58.454489    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:21:58.508765 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:21:58.508731    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:21:58.858262 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:21:58.858229    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:21:58.925545 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:21:58.925503    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:22:02.264842 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:22:02.264805    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:22:02.362957 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:22:02.362929    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:22:03.191710 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:22:03.191673    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:22:06.219802 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:22:06.219767    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:22:06.323173 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:22:06.323143    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:22:06.424040 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:22:06.423983    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:22:06.617330 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:22:06.617296    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:22:06.658813 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:22:06.658779    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:22:06.658961 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:22:06.658823    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:22:06.658961 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:22:06.658890    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-snffc"
Jul 02 17:22:06.661272 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:22:06.661254    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 02 17:22:06.706107 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:22:06.706075    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fcct\" (UniqueName: \"kubernetes.io/projected/4252bbf4-2b80-4f47-a51c-edda01e32a8f-kube-api-access-4fcct\") pod \"limitador-limitador-54d6d988d5-snffc\" (UID: \"4252bbf4-2b80-4f47-a51c-edda01e32a8f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-snffc"
Jul 02 17:22:06.706242 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:22:06.706150    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4252bbf4-2b80-4f47-a51c-edda01e32a8f-config-file\") pod \"limitador-limitador-54d6d988d5-snffc\" (UID: \"4252bbf4-2b80-4f47-a51c-edda01e32a8f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-snffc"
Jul 02 17:22:06.806840 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:22:06.806805    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4252bbf4-2b80-4f47-a51c-edda01e32a8f-config-file\") pod \"limitador-limitador-54d6d988d5-snffc\" (UID: \"4252bbf4-2b80-4f47-a51c-edda01e32a8f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-snffc"
Jul 02 17:22:06.807001 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:22:06.806881    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fcct\" (UniqueName: \"kubernetes.io/projected/4252bbf4-2b80-4f47-a51c-edda01e32a8f-kube-api-access-4fcct\") pod \"limitador-limitador-54d6d988d5-snffc\" (UID: \"4252bbf4-2b80-4f47-a51c-edda01e32a8f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-snffc"
Jul 02 17:22:06.807487 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:22:06.807467    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4252bbf4-2b80-4f47-a51c-edda01e32a8f-config-file\") pod \"limitador-limitador-54d6d988d5-snffc\" (UID: \"4252bbf4-2b80-4f47-a51c-edda01e32a8f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-snffc"
Jul 02 17:22:06.815460 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:22:06.815433    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fcct\" (UniqueName: \"kubernetes.io/projected/4252bbf4-2b80-4f47-a51c-edda01e32a8f-kube-api-access-4fcct\") pod \"limitador-limitador-54d6d988d5-snffc\" (UID: \"4252bbf4-2b80-4f47-a51c-edda01e32a8f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-snffc"
Jul 02 17:22:06.969453 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:22:06.969367    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-snffc"
Jul 02 17:22:07.048771 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:22:07.048721    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:22:07.110392 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:22:07.110361    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:22:07.161874 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:22:07.161841    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:22:07.164566 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:22:07.164538    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4252bbf4_2b80_4f47_a51c_edda01e32a8f.slice/crio-07b3b5562b210b6158e4688b23d390bbb76694104d150ba2775b35f5d7081df0 WatchSource:0}: Error finding container 07b3b5562b210b6158e4688b23d390bbb76694104d150ba2775b35f5d7081df0: Status 404 returned error can't find the container with id 07b3b5562b210b6158e4688b23d390bbb76694104d150ba2775b35f5d7081df0
Jul 02 17:22:07.193191 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:22:07.193168    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-2ddtl"]
Jul 02 17:22:07.203079 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:22:07.203042    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-2ddtl"]
Jul 02 17:22:07.203191 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:22:07.203110    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-2ddtl"
Jul 02 17:22:07.205692 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:22:07.205673    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-8h58n\""
Jul 02 17:22:07.209664 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:22:07.209640    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgqq7\" (UniqueName: \"kubernetes.io/projected/17515b7d-6a39-4ad4-996e-5cb58ff40696-kube-api-access-lgqq7\") pod \"authorino-75d556bd77-2ddtl\" (UID: \"17515b7d-6a39-4ad4-996e-5cb58ff40696\") " pod="kuadrant-system/authorino-75d556bd77-2ddtl"
Jul 02 17:22:07.244877 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:22:07.244835    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-snffc" event={"ID":"4252bbf4-2b80-4f47-a51c-edda01e32a8f","Type":"ContainerStarted","Data":"07b3b5562b210b6158e4688b23d390bbb76694104d150ba2775b35f5d7081df0"}
Jul 02 17:22:07.310826 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:22:07.310785    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgqq7\" (UniqueName: \"kubernetes.io/projected/17515b7d-6a39-4ad4-996e-5cb58ff40696-kube-api-access-lgqq7\") pod \"authorino-75d556bd77-2ddtl\" (UID: \"17515b7d-6a39-4ad4-996e-5cb58ff40696\") " pod="kuadrant-system/authorino-75d556bd77-2ddtl"
Jul 02 17:22:07.320043 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:22:07.320001    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgqq7\" (UniqueName: \"kubernetes.io/projected/17515b7d-6a39-4ad4-996e-5cb58ff40696-kube-api-access-lgqq7\") pod \"authorino-75d556bd77-2ddtl\" (UID: \"17515b7d-6a39-4ad4-996e-5cb58ff40696\") " pod="kuadrant-system/authorino-75d556bd77-2ddtl"
Jul 02 17:22:07.513483 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:22:07.513417    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-2ddtl"
Jul 02 17:22:07.689543 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:22:07.689481    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-2ddtl"]
Jul 02 17:22:07.694924 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:22:07.694793    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod17515b7d_6a39_4ad4_996e_5cb58ff40696.slice/crio-fc40907931d2a9e8ba51dfe5827e38e26649a3e58f448dbcfeb55762d66b6b24 WatchSource:0}: Error finding container fc40907931d2a9e8ba51dfe5827e38e26649a3e58f448dbcfeb55762d66b6b24: Status 404 returned error can't find the container with id fc40907931d2a9e8ba51dfe5827e38e26649a3e58f448dbcfeb55762d66b6b24
Jul 02 17:22:08.250779 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:22:08.250747    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-2ddtl" event={"ID":"17515b7d-6a39-4ad4-996e-5cb58ff40696","Type":"ContainerStarted","Data":"fc40907931d2a9e8ba51dfe5827e38e26649a3e58f448dbcfeb55762d66b6b24"}
Jul 02 17:22:10.263337 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:22:10.263292    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-snffc" event={"ID":"4252bbf4-2b80-4f47-a51c-edda01e32a8f","Type":"ContainerStarted","Data":"e5026249356d85533dff9f348d5e02d976b0752068cb03e55a57c008586a82ef"}
Jul 02 17:22:10.263818 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:22:10.263447    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-snffc"
Jul 02 17:22:10.286804 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:22:10.286757    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-snffc" podStartSLOduration=1.7931464209999999 podStartE2EDuration="4.286738513s" totalImagesPullingTime="2.493592092s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:22:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:22:10.285256116 +0000 UTC m=+685.474958777" watchObservedRunningTime="2026-07-02 17:22:10.286738513 +0000 UTC m=+685.476441174"
Jul 02 17:22:13.282807 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:22:13.282767    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-2ddtl" event={"ID":"17515b7d-6a39-4ad4-996e-5cb58ff40696","Type":"ContainerStarted","Data":"59926516bf871d2f5aca5b872d15311478f74530aafd84bedef93b0be928f31a"}
Jul 02 17:22:13.298684 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:22:13.298635    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-2ddtl" podStartSLOduration=1.70940147 podStartE2EDuration="6.298616753s" totalImagesPullingTime="4.589215283s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:22:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:22:13.297920293 +0000 UTC m=+688.487622955" watchObservedRunningTime="2026-07-02 17:22:13.298616753 +0000 UTC m=+688.488319417"
Jul 02 17:22:21.273316 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:22:21.273282    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-snffc"
Jul 02 17:22:26.772077 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:22:26.772037    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:22:38.949112 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:22:38.948886    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:22:39.043826 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:22:39.043798    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:22:39.192429 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:22:39.192397    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:23:08.627593 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:08.627551    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:23:08.720894 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:08.720850    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:23:38.107825 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:38.107789    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:23:38.332645 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:38.332611    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-ngthv"]
Jul 02 17:23:38.334947 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:38.334926    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-ngthv"
Jul 02 17:23:38.343711 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:38.343685    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-ngthv"]
Jul 02 17:23:38.408245 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:38.408178    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvt7g\" (UniqueName: \"kubernetes.io/projected/3b8c2fbf-b76a-4f7f-9acd-cf87afda35cc-kube-api-access-rvt7g\") pod \"authorino-5d4b67c446-ngthv\" (UID: \"3b8c2fbf-b76a-4f7f-9acd-cf87afda35cc\") " pod="kuadrant-system/authorino-5d4b67c446-ngthv"
Jul 02 17:23:38.508586 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:38.508564    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvt7g\" (UniqueName: \"kubernetes.io/projected/3b8c2fbf-b76a-4f7f-9acd-cf87afda35cc-kube-api-access-rvt7g\") pod \"authorino-5d4b67c446-ngthv\" (UID: \"3b8c2fbf-b76a-4f7f-9acd-cf87afda35cc\") " pod="kuadrant-system/authorino-5d4b67c446-ngthv"
Jul 02 17:23:38.516469 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:38.516446    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvt7g\" (UniqueName: \"kubernetes.io/projected/3b8c2fbf-b76a-4f7f-9acd-cf87afda35cc-kube-api-access-rvt7g\") pod \"authorino-5d4b67c446-ngthv\" (UID: \"3b8c2fbf-b76a-4f7f-9acd-cf87afda35cc\") " pod="kuadrant-system/authorino-5d4b67c446-ngthv"
Jul 02 17:23:38.578988 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:38.578963    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-ngthv"]
Jul 02 17:23:38.579186 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:38.579174    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-ngthv"
Jul 02 17:23:38.601848 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:38.601810    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6f6754db68-m8c7t"]
Jul 02 17:23:38.604471 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:38.604451    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6754db68-m8c7t"
Jul 02 17:23:38.613750 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:38.613723    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6f6754db68-m8c7t"]
Jul 02 17:23:38.709541 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:38.709511    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-ngthv"]
Jul 02 17:23:38.709848 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:38.709819    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdhqb\" (UniqueName: \"kubernetes.io/projected/5e2545d6-c3a0-4277-9793-fe1f467d8ba7-kube-api-access-xdhqb\") pod \"authorino-6f6754db68-m8c7t\" (UID: \"5e2545d6-c3a0-4277-9793-fe1f467d8ba7\") " pod="kuadrant-system/authorino-6f6754db68-m8c7t"
Jul 02 17:23:38.711559 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:23:38.711534    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3b8c2fbf_b76a_4f7f_9acd_cf87afda35cc.slice/crio-57f76c9fe5c1d48d415308a930f6eb0b4eb728beb308a75ecb8aeb097633a0fa WatchSource:0}: Error finding container 57f76c9fe5c1d48d415308a930f6eb0b4eb728beb308a75ecb8aeb097633a0fa: Status 404 returned error can't find the container with id 57f76c9fe5c1d48d415308a930f6eb0b4eb728beb308a75ecb8aeb097633a0fa
Jul 02 17:23:38.730217 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:38.730194    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:23:38.810578 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:38.810551    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdhqb\" (UniqueName: \"kubernetes.io/projected/5e2545d6-c3a0-4277-9793-fe1f467d8ba7-kube-api-access-xdhqb\") pod \"authorino-6f6754db68-m8c7t\" (UID: \"5e2545d6-c3a0-4277-9793-fe1f467d8ba7\") " pod="kuadrant-system/authorino-6f6754db68-m8c7t"
Jul 02 17:23:38.819193 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:38.819172    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdhqb\" (UniqueName: \"kubernetes.io/projected/5e2545d6-c3a0-4277-9793-fe1f467d8ba7-kube-api-access-xdhqb\") pod \"authorino-6f6754db68-m8c7t\" (UID: \"5e2545d6-c3a0-4277-9793-fe1f467d8ba7\") " pod="kuadrant-system/authorino-6f6754db68-m8c7t"
Jul 02 17:23:38.909650 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:38.909626    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f6754db68-m8c7t"]
Jul 02 17:23:38.909867 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:38.909853    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6754db68-m8c7t"
Jul 02 17:23:38.949772 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:38.949748    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-794758b6b8-f4988"]
Jul 02 17:23:38.951991 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:38.951972    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-794758b6b8-f4988"
Jul 02 17:23:38.956445 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:38.956262    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 02 17:23:38.964539 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:38.964516    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-794758b6b8-f4988"]
Jul 02 17:23:39.011675 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:39.011647    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rnw8\" (UniqueName: \"kubernetes.io/projected/bf65cc14-b329-4a16-befe-50eabc932262-kube-api-access-4rnw8\") pod \"authorino-794758b6b8-f4988\" (UID: \"bf65cc14-b329-4a16-befe-50eabc932262\") " pod="kuadrant-system/authorino-794758b6b8-f4988"
Jul 02 17:23:39.011800 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:39.011679    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bf65cc14-b329-4a16-befe-50eabc932262-tls-cert\") pod \"authorino-794758b6b8-f4988\" (UID: \"bf65cc14-b329-4a16-befe-50eabc932262\") " pod="kuadrant-system/authorino-794758b6b8-f4988"
Jul 02 17:23:39.033307 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:39.033285    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f6754db68-m8c7t"]
Jul 02 17:23:39.035250 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:23:39.035228    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5e2545d6_c3a0_4277_9793_fe1f467d8ba7.slice/crio-99fd7da31954bcfa31ab136c1cc83646bf88d8fd80e5c2a506eee5d94e9ff388 WatchSource:0}: Error finding container 99fd7da31954bcfa31ab136c1cc83646bf88d8fd80e5c2a506eee5d94e9ff388: Status 404 returned error can't find the container with id 99fd7da31954bcfa31ab136c1cc83646bf88d8fd80e5c2a506eee5d94e9ff388
Jul 02 17:23:39.113037 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:39.112995    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rnw8\" (UniqueName: \"kubernetes.io/projected/bf65cc14-b329-4a16-befe-50eabc932262-kube-api-access-4rnw8\") pod \"authorino-794758b6b8-f4988\" (UID: \"bf65cc14-b329-4a16-befe-50eabc932262\") " pod="kuadrant-system/authorino-794758b6b8-f4988"
Jul 02 17:23:39.113323 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:39.113036    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bf65cc14-b329-4a16-befe-50eabc932262-tls-cert\") pod \"authorino-794758b6b8-f4988\" (UID: \"bf65cc14-b329-4a16-befe-50eabc932262\") " pod="kuadrant-system/authorino-794758b6b8-f4988"
Jul 02 17:23:39.115330 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:39.115308    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bf65cc14-b329-4a16-befe-50eabc932262-tls-cert\") pod \"authorino-794758b6b8-f4988\" (UID: \"bf65cc14-b329-4a16-befe-50eabc932262\") " pod="kuadrant-system/authorino-794758b6b8-f4988"
Jul 02 17:23:39.126410 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:39.126392    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rnw8\" (UniqueName: \"kubernetes.io/projected/bf65cc14-b329-4a16-befe-50eabc932262-kube-api-access-4rnw8\") pod \"authorino-794758b6b8-f4988\" (UID: \"bf65cc14-b329-4a16-befe-50eabc932262\") " pod="kuadrant-system/authorino-794758b6b8-f4988"
Jul 02 17:23:39.264836 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:39.264818    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-794758b6b8-f4988"
Jul 02 17:23:39.411988 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:39.411959    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-794758b6b8-f4988"]
Jul 02 17:23:39.415085 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:23:39.415045    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbf65cc14_b329_4a16_befe_50eabc932262.slice/crio-9d356eaf8fc4d2616b466252c8b01f53c41b8528654130d9d44608966d24b7ef WatchSource:0}: Error finding container 9d356eaf8fc4d2616b466252c8b01f53c41b8528654130d9d44608966d24b7ef: Status 404 returned error can't find the container with id 9d356eaf8fc4d2616b466252c8b01f53c41b8528654130d9d44608966d24b7ef
Jul 02 17:23:39.675807 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:39.675716    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f6754db68-m8c7t" event={"ID":"5e2545d6-c3a0-4277-9793-fe1f467d8ba7","Type":"ContainerStarted","Data":"5a65d779ff17a7f0a6ff2030163fb9b441660cfdf6451b9338313117790ff952"}
Jul 02 17:23:39.675807 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:39.675765    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f6754db68-m8c7t" event={"ID":"5e2545d6-c3a0-4277-9793-fe1f467d8ba7","Type":"ContainerStarted","Data":"99fd7da31954bcfa31ab136c1cc83646bf88d8fd80e5c2a506eee5d94e9ff388"}
Jul 02 17:23:39.676080 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:39.675798    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-6f6754db68-m8c7t" podUID="5e2545d6-c3a0-4277-9793-fe1f467d8ba7" containerName="authorino" containerID="cri-o://5a65d779ff17a7f0a6ff2030163fb9b441660cfdf6451b9338313117790ff952" gracePeriod=30
Jul 02 17:23:39.677315 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:39.677287    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-ngthv" podUID="3b8c2fbf-b76a-4f7f-9acd-cf87afda35cc" containerName="authorino" containerID="cri-o://74702cca98bbcf813c201499b0d2dd14c5d88057c559e7f984ffa5b84928b737" gracePeriod=30
Jul 02 17:23:39.677315 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:39.677297    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-ngthv" event={"ID":"3b8c2fbf-b76a-4f7f-9acd-cf87afda35cc","Type":"ContainerStarted","Data":"74702cca98bbcf813c201499b0d2dd14c5d88057c559e7f984ffa5b84928b737"}
Jul 02 17:23:39.677493 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:39.677342    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-ngthv" event={"ID":"3b8c2fbf-b76a-4f7f-9acd-cf87afda35cc","Type":"ContainerStarted","Data":"57f76c9fe5c1d48d415308a930f6eb0b4eb728beb308a75ecb8aeb097633a0fa"}
Jul 02 17:23:39.678596 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:39.678548    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-794758b6b8-f4988" event={"ID":"bf65cc14-b329-4a16-befe-50eabc932262","Type":"ContainerStarted","Data":"9d356eaf8fc4d2616b466252c8b01f53c41b8528654130d9d44608966d24b7ef"}
Jul 02 17:23:39.714088 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:39.714049    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6f6754db68-m8c7t" podStartSLOduration=1.300141439 podStartE2EDuration="1.714033977s" totalImagesPullingTime="413.892538ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:23:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:23:39.695773767 +0000 UTC m=+774.885476420" watchObservedRunningTime="2026-07-02 17:23:39.714033977 +0000 UTC m=+774.903736631"
Jul 02 17:23:39.932303 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:39.932233    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-ngthv"
Jul 02 17:23:39.942466 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:39.942441    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6754db68-m8c7t"
Jul 02 17:23:40.021026 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:40.020999    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rvt7g\" (UniqueName: \"kubernetes.io/projected/3b8c2fbf-b76a-4f7f-9acd-cf87afda35cc-kube-api-access-rvt7g\") pod \"3b8c2fbf-b76a-4f7f-9acd-cf87afda35cc\" (UID: \"3b8c2fbf-b76a-4f7f-9acd-cf87afda35cc\") "
Jul 02 17:23:40.021153 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:40.021048    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xdhqb\" (UniqueName: \"kubernetes.io/projected/5e2545d6-c3a0-4277-9793-fe1f467d8ba7-kube-api-access-xdhqb\") pod \"5e2545d6-c3a0-4277-9793-fe1f467d8ba7\" (UID: \"5e2545d6-c3a0-4277-9793-fe1f467d8ba7\") "
Jul 02 17:23:40.023208 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:40.023179    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b8c2fbf-b76a-4f7f-9acd-cf87afda35cc-kube-api-access-rvt7g" (OuterVolumeSpecName: "kube-api-access-rvt7g") pod "3b8c2fbf-b76a-4f7f-9acd-cf87afda35cc" (UID: "3b8c2fbf-b76a-4f7f-9acd-cf87afda35cc"). InnerVolumeSpecName "kube-api-access-rvt7g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 17:23:40.023302 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:40.023217    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e2545d6-c3a0-4277-9793-fe1f467d8ba7-kube-api-access-xdhqb" (OuterVolumeSpecName: "kube-api-access-xdhqb") pod "5e2545d6-c3a0-4277-9793-fe1f467d8ba7" (UID: "5e2545d6-c3a0-4277-9793-fe1f467d8ba7"). InnerVolumeSpecName "kube-api-access-xdhqb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 17:23:40.122399 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:40.122379    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rvt7g\" (UniqueName: \"kubernetes.io/projected/3b8c2fbf-b76a-4f7f-9acd-cf87afda35cc-kube-api-access-rvt7g\") on node \"ip-10-0-143-67.ec2.internal\" DevicePath \"\""
Jul 02 17:23:40.122399 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:40.122398    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xdhqb\" (UniqueName: \"kubernetes.io/projected/5e2545d6-c3a0-4277-9793-fe1f467d8ba7-kube-api-access-xdhqb\") on node \"ip-10-0-143-67.ec2.internal\" DevicePath \"\""
Jul 02 17:23:40.685070 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:40.685038    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-794758b6b8-f4988" event={"ID":"bf65cc14-b329-4a16-befe-50eabc932262","Type":"ContainerStarted","Data":"ccba0dd38c40a25c002c60e585845f2fc18de21506e7920f441b415706f016c5"}
Jul 02 17:23:40.686242 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:40.686215    2578 generic.go:356] "Generic (PLEG): container finished" podID="5e2545d6-c3a0-4277-9793-fe1f467d8ba7" containerID="5a65d779ff17a7f0a6ff2030163fb9b441660cfdf6451b9338313117790ff952" exitCode=0
Jul 02 17:23:40.686242 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:40.686239    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6754db68-m8c7t"
Jul 02 17:23:40.686409 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:40.686299    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f6754db68-m8c7t" event={"ID":"5e2545d6-c3a0-4277-9793-fe1f467d8ba7","Type":"ContainerDied","Data":"5a65d779ff17a7f0a6ff2030163fb9b441660cfdf6451b9338313117790ff952"}
Jul 02 17:23:40.686409 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:40.686336    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f6754db68-m8c7t" event={"ID":"5e2545d6-c3a0-4277-9793-fe1f467d8ba7","Type":"ContainerDied","Data":"99fd7da31954bcfa31ab136c1cc83646bf88d8fd80e5c2a506eee5d94e9ff388"}
Jul 02 17:23:40.686409 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:40.686355    2578 scope.go:117] "RemoveContainer" containerID="5a65d779ff17a7f0a6ff2030163fb9b441660cfdf6451b9338313117790ff952"
Jul 02 17:23:40.687592 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:40.687413    2578 generic.go:356] "Generic (PLEG): container finished" podID="3b8c2fbf-b76a-4f7f-9acd-cf87afda35cc" containerID="74702cca98bbcf813c201499b0d2dd14c5d88057c559e7f984ffa5b84928b737" exitCode=0
Jul 02 17:23:40.687592 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:40.687439    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-ngthv" event={"ID":"3b8c2fbf-b76a-4f7f-9acd-cf87afda35cc","Type":"ContainerDied","Data":"74702cca98bbcf813c201499b0d2dd14c5d88057c559e7f984ffa5b84928b737"}
Jul 02 17:23:40.687592 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:40.687448    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-ngthv"
Jul 02 17:23:40.687592 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:40.687457    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-ngthv" event={"ID":"3b8c2fbf-b76a-4f7f-9acd-cf87afda35cc","Type":"ContainerDied","Data":"57f76c9fe5c1d48d415308a930f6eb0b4eb728beb308a75ecb8aeb097633a0fa"}
Jul 02 17:23:40.693481 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:40.693459    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:23:40.696215 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:40.696187    2578 scope.go:117] "RemoveContainer" containerID="5a65d779ff17a7f0a6ff2030163fb9b441660cfdf6451b9338313117790ff952"
Jul 02 17:23:40.696483 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:23:40.696466    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a65d779ff17a7f0a6ff2030163fb9b441660cfdf6451b9338313117790ff952\": container with ID starting with 5a65d779ff17a7f0a6ff2030163fb9b441660cfdf6451b9338313117790ff952 not found: ID does not exist" containerID="5a65d779ff17a7f0a6ff2030163fb9b441660cfdf6451b9338313117790ff952"
Jul 02 17:23:40.696552 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:40.696490    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a65d779ff17a7f0a6ff2030163fb9b441660cfdf6451b9338313117790ff952"} err="failed to get container status \"5a65d779ff17a7f0a6ff2030163fb9b441660cfdf6451b9338313117790ff952\": rpc error: code = NotFound desc = could not find container \"5a65d779ff17a7f0a6ff2030163fb9b441660cfdf6451b9338313117790ff952\": container with ID starting with 5a65d779ff17a7f0a6ff2030163fb9b441660cfdf6451b9338313117790ff952 not found: ID does not exist"
Jul 02 17:23:40.696552 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:40.696507    2578 scope.go:117] "RemoveContainer" containerID="74702cca98bbcf813c201499b0d2dd14c5d88057c559e7f984ffa5b84928b737"
Jul 02 17:23:40.704384 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:40.704367    2578 scope.go:117] "RemoveContainer" containerID="74702cca98bbcf813c201499b0d2dd14c5d88057c559e7f984ffa5b84928b737"
Jul 02 17:23:40.704651 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:23:40.704623    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74702cca98bbcf813c201499b0d2dd14c5d88057c559e7f984ffa5b84928b737\": container with ID starting with 74702cca98bbcf813c201499b0d2dd14c5d88057c559e7f984ffa5b84928b737 not found: ID does not exist" containerID="74702cca98bbcf813c201499b0d2dd14c5d88057c559e7f984ffa5b84928b737"
Jul 02 17:23:40.704743 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:40.704657    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74702cca98bbcf813c201499b0d2dd14c5d88057c559e7f984ffa5b84928b737"} err="failed to get container status \"74702cca98bbcf813c201499b0d2dd14c5d88057c559e7f984ffa5b84928b737\": rpc error: code = NotFound desc = could not find container \"74702cca98bbcf813c201499b0d2dd14c5d88057c559e7f984ffa5b84928b737\": container with ID starting with 74702cca98bbcf813c201499b0d2dd14c5d88057c559e7f984ffa5b84928b737 not found: ID does not exist"
Jul 02 17:23:40.705798 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:40.705761    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-794758b6b8-f4988" podStartSLOduration=2.402289487 podStartE2EDuration="2.705748723s" totalImagesPullingTime="303.459236ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:23:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:23:40.7056468 +0000 UTC m=+775.895349462" watchObservedRunningTime="2026-07-02 17:23:40.705748723 +0000 UTC m=+775.895451384"
Jul 02 17:23:40.720347 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:40.720317    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f6754db68-m8c7t"]
Jul 02 17:23:40.724205 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:40.724183    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6f6754db68-m8c7t"]
Jul 02 17:23:40.734776 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:40.734748    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-2ddtl"]
Jul 02 17:23:40.741743 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:40.734953    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-2ddtl" podUID="17515b7d-6a39-4ad4-996e-5cb58ff40696" containerName="authorino" containerID="cri-o://59926516bf871d2f5aca5b872d15311478f74530aafd84bedef93b0be928f31a" gracePeriod=30
Jul 02 17:23:40.747240 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:40.747214    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-ngthv"]
Jul 02 17:23:40.749429 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:40.749409    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-ngthv"]
Jul 02 17:23:41.004337 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:41.004312    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-2ddtl"
Jul 02 17:23:41.130840 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:41.130764    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lgqq7\" (UniqueName: \"kubernetes.io/projected/17515b7d-6a39-4ad4-996e-5cb58ff40696-kube-api-access-lgqq7\") pod \"17515b7d-6a39-4ad4-996e-5cb58ff40696\" (UID: \"17515b7d-6a39-4ad4-996e-5cb58ff40696\") "
Jul 02 17:23:41.132710 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:41.132686    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17515b7d-6a39-4ad4-996e-5cb58ff40696-kube-api-access-lgqq7" (OuterVolumeSpecName: "kube-api-access-lgqq7") pod "17515b7d-6a39-4ad4-996e-5cb58ff40696" (UID: "17515b7d-6a39-4ad4-996e-5cb58ff40696"). InnerVolumeSpecName "kube-api-access-lgqq7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 17:23:41.231448 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:41.231420    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lgqq7\" (UniqueName: \"kubernetes.io/projected/17515b7d-6a39-4ad4-996e-5cb58ff40696-kube-api-access-lgqq7\") on node \"ip-10-0-143-67.ec2.internal\" DevicePath \"\""
Jul 02 17:23:41.497085 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:41.497056    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b8c2fbf-b76a-4f7f-9acd-cf87afda35cc" path="/var/lib/kubelet/pods/3b8c2fbf-b76a-4f7f-9acd-cf87afda35cc/volumes"
Jul 02 17:23:41.497377 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:41.497365    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e2545d6-c3a0-4277-9793-fe1f467d8ba7" path="/var/lib/kubelet/pods/5e2545d6-c3a0-4277-9793-fe1f467d8ba7/volumes"
Jul 02 17:23:41.694976 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:41.694945    2578 generic.go:356] "Generic (PLEG): container finished" podID="17515b7d-6a39-4ad4-996e-5cb58ff40696" containerID="59926516bf871d2f5aca5b872d15311478f74530aafd84bedef93b0be928f31a" exitCode=0
Jul 02 17:23:41.695164 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:41.694986    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-2ddtl"
Jul 02 17:23:41.695164 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:41.695002    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-2ddtl" event={"ID":"17515b7d-6a39-4ad4-996e-5cb58ff40696","Type":"ContainerDied","Data":"59926516bf871d2f5aca5b872d15311478f74530aafd84bedef93b0be928f31a"}
Jul 02 17:23:41.695164 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:41.695064    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-2ddtl" event={"ID":"17515b7d-6a39-4ad4-996e-5cb58ff40696","Type":"ContainerDied","Data":"fc40907931d2a9e8ba51dfe5827e38e26649a3e58f448dbcfeb55762d66b6b24"}
Jul 02 17:23:41.695164 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:41.695082    2578 scope.go:117] "RemoveContainer" containerID="59926516bf871d2f5aca5b872d15311478f74530aafd84bedef93b0be928f31a"
Jul 02 17:23:41.702985 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:41.702971    2578 scope.go:117] "RemoveContainer" containerID="59926516bf871d2f5aca5b872d15311478f74530aafd84bedef93b0be928f31a"
Jul 02 17:23:41.703241 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:23:41.703222    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59926516bf871d2f5aca5b872d15311478f74530aafd84bedef93b0be928f31a\": container with ID starting with 59926516bf871d2f5aca5b872d15311478f74530aafd84bedef93b0be928f31a not found: ID does not exist" containerID="59926516bf871d2f5aca5b872d15311478f74530aafd84bedef93b0be928f31a"
Jul 02 17:23:41.703343 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:41.703251    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59926516bf871d2f5aca5b872d15311478f74530aafd84bedef93b0be928f31a"} err="failed to get container status \"59926516bf871d2f5aca5b872d15311478f74530aafd84bedef93b0be928f31a\": rpc error: code = NotFound desc = could not find container \"59926516bf871d2f5aca5b872d15311478f74530aafd84bedef93b0be928f31a\": container with ID starting with 59926516bf871d2f5aca5b872d15311478f74530aafd84bedef93b0be928f31a not found: ID does not exist"
Jul 02 17:23:41.712100 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:41.712081    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-2ddtl"]
Jul 02 17:23:41.716708 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:41.716681    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-2ddtl"]
Jul 02 17:23:43.496348 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:43.496315    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17515b7d-6a39-4ad4-996e-5cb58ff40696" path="/var/lib/kubelet/pods/17515b7d-6a39-4ad4-996e-5cb58ff40696/volumes"
Jul 02 17:23:45.100868 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:45.100837    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:23:45.199419 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:45.199385    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:23:45.264780 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:45.264749    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:23:45.408431 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:45.408368    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:23:48.595804 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:48.595752    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:23:48.692502 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:23:48.692467    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:24:20.077777 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:24:20.077681    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:24:20.499535 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:24:20.499494    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:24:20.851260 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:24:20.851160    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:24:21.042991 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:24:21.042958    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:24:21.140005 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:24:21.139908    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:24:21.177389 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:24:21.177359    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:24:44.637281 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:24:44.637238    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:25:20.502954 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:20.502919    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5599dfbd86-zg49l"]
Jul 02 17:25:20.503370 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:20.503262    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b8c2fbf-b76a-4f7f-9acd-cf87afda35cc" containerName="authorino"
Jul 02 17:25:20.503370 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:20.503274    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b8c2fbf-b76a-4f7f-9acd-cf87afda35cc" containerName="authorino"
Jul 02 17:25:20.503370 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:20.503290    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e2545d6-c3a0-4277-9793-fe1f467d8ba7" containerName="authorino"
Jul 02 17:25:20.503370 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:20.503296    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e2545d6-c3a0-4277-9793-fe1f467d8ba7" containerName="authorino"
Jul 02 17:25:20.503370 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:20.503311    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17515b7d-6a39-4ad4-996e-5cb58ff40696" containerName="authorino"
Jul 02 17:25:20.503370 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:20.503318    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="17515b7d-6a39-4ad4-996e-5cb58ff40696" containerName="authorino"
Jul 02 17:25:20.503370 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:20.503374    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b8c2fbf-b76a-4f7f-9acd-cf87afda35cc" containerName="authorino"
Jul 02 17:25:20.503584 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:20.503382    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e2545d6-c3a0-4277-9793-fe1f467d8ba7" containerName="authorino"
Jul 02 17:25:20.503584 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:20.503390    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="17515b7d-6a39-4ad4-996e-5cb58ff40696" containerName="authorino"
Jul 02 17:25:20.506260 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:20.506244    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5599dfbd86-zg49l"
Jul 02 17:25:20.508952 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:20.508934    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\""
Jul 02 17:25:20.512266 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:20.512241    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5599dfbd86-zg49l"]
Jul 02 17:25:20.683012 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:20.682985    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7d73293a-befc-40b5-a6c1-1f9b26411eef-tls-cert\") pod \"authorino-5599dfbd86-zg49l\" (UID: \"7d73293a-befc-40b5-a6c1-1f9b26411eef\") " pod="kuadrant-system/authorino-5599dfbd86-zg49l"
Jul 02 17:25:20.683211 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:20.683064    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbs5r\" (UniqueName: \"kubernetes.io/projected/7d73293a-befc-40b5-a6c1-1f9b26411eef-kube-api-access-nbs5r\") pod \"authorino-5599dfbd86-zg49l\" (UID: \"7d73293a-befc-40b5-a6c1-1f9b26411eef\") " pod="kuadrant-system/authorino-5599dfbd86-zg49l"
Jul 02 17:25:20.683211 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:20.683107    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/7d73293a-befc-40b5-a6c1-1f9b26411eef-oidc-ca\") pod \"authorino-5599dfbd86-zg49l\" (UID: \"7d73293a-befc-40b5-a6c1-1f9b26411eef\") " pod="kuadrant-system/authorino-5599dfbd86-zg49l"
Jul 02 17:25:20.783897 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:20.783835    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7d73293a-befc-40b5-a6c1-1f9b26411eef-tls-cert\") pod \"authorino-5599dfbd86-zg49l\" (UID: \"7d73293a-befc-40b5-a6c1-1f9b26411eef\") " pod="kuadrant-system/authorino-5599dfbd86-zg49l"
Jul 02 17:25:20.783897 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:20.783882    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbs5r\" (UniqueName: \"kubernetes.io/projected/7d73293a-befc-40b5-a6c1-1f9b26411eef-kube-api-access-nbs5r\") pod \"authorino-5599dfbd86-zg49l\" (UID: \"7d73293a-befc-40b5-a6c1-1f9b26411eef\") " pod="kuadrant-system/authorino-5599dfbd86-zg49l"
Jul 02 17:25:20.784096 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:20.783909    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/7d73293a-befc-40b5-a6c1-1f9b26411eef-oidc-ca\") pod \"authorino-5599dfbd86-zg49l\" (UID: \"7d73293a-befc-40b5-a6c1-1f9b26411eef\") " pod="kuadrant-system/authorino-5599dfbd86-zg49l"
Jul 02 17:25:20.784517 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:20.784493    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/7d73293a-befc-40b5-a6c1-1f9b26411eef-oidc-ca\") pod \"authorino-5599dfbd86-zg49l\" (UID: \"7d73293a-befc-40b5-a6c1-1f9b26411eef\") " pod="kuadrant-system/authorino-5599dfbd86-zg49l"
Jul 02 17:25:20.786361 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:20.786337    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7d73293a-befc-40b5-a6c1-1f9b26411eef-tls-cert\") pod \"authorino-5599dfbd86-zg49l\" (UID: \"7d73293a-befc-40b5-a6c1-1f9b26411eef\") " pod="kuadrant-system/authorino-5599dfbd86-zg49l"
Jul 02 17:25:20.793381 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:20.793361    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbs5r\" (UniqueName: \"kubernetes.io/projected/7d73293a-befc-40b5-a6c1-1f9b26411eef-kube-api-access-nbs5r\") pod \"authorino-5599dfbd86-zg49l\" (UID: \"7d73293a-befc-40b5-a6c1-1f9b26411eef\") " pod="kuadrant-system/authorino-5599dfbd86-zg49l"
Jul 02 17:25:20.816240 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:20.816222    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5599dfbd86-zg49l"
Jul 02 17:25:20.942360 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:20.942329    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5599dfbd86-zg49l"]
Jul 02 17:25:20.945666 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:25:20.945640    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7d73293a_befc_40b5_a6c1_1f9b26411eef.slice/crio-8c06360355c69987d90ac3afa8ccf7c6e090dfe9174fb816b0af876e6dbfefdd WatchSource:0}: Error finding container 8c06360355c69987d90ac3afa8ccf7c6e090dfe9174fb816b0af876e6dbfefdd: Status 404 returned error can't find the container with id 8c06360355c69987d90ac3afa8ccf7c6e090dfe9174fb816b0af876e6dbfefdd
Jul 02 17:25:21.172057 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:21.171975    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5599dfbd86-zg49l" event={"ID":"7d73293a-befc-40b5-a6c1-1f9b26411eef","Type":"ContainerStarted","Data":"8c06360355c69987d90ac3afa8ccf7c6e090dfe9174fb816b0af876e6dbfefdd"}
Jul 02 17:25:22.178679 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:22.178637    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5599dfbd86-zg49l" event={"ID":"7d73293a-befc-40b5-a6c1-1f9b26411eef","Type":"ContainerStarted","Data":"e91142363da852873d760f5ab52d2b0eeec98833a4e1a11c5d7ac6ece6448370"}
Jul 02 17:25:22.194915 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:22.194869    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5599dfbd86-zg49l" podStartSLOduration=1.916367983 podStartE2EDuration="2.194852152s" totalImagesPullingTime="278.484169ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:25:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:25:22.193461435 +0000 UTC m=+877.383164099" watchObservedRunningTime="2026-07-02 17:25:22.194852152 +0000 UTC m=+877.384554881"
Jul 02 17:25:22.221595 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:22.221565    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-794758b6b8-f4988"]
Jul 02 17:25:22.221767 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:22.221744    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-794758b6b8-f4988" podUID="bf65cc14-b329-4a16-befe-50eabc932262" containerName="authorino" containerID="cri-o://ccba0dd38c40a25c002c60e585845f2fc18de21506e7920f441b415706f016c5" gracePeriod=30
Jul 02 17:25:22.467278 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:22.467255    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-794758b6b8-f4988"
Jul 02 17:25:22.601859 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:22.601821    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4rnw8\" (UniqueName: \"kubernetes.io/projected/bf65cc14-b329-4a16-befe-50eabc932262-kube-api-access-4rnw8\") pod \"bf65cc14-b329-4a16-befe-50eabc932262\" (UID: \"bf65cc14-b329-4a16-befe-50eabc932262\") "
Jul 02 17:25:22.602537 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:22.601936    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bf65cc14-b329-4a16-befe-50eabc932262-tls-cert\") pod \"bf65cc14-b329-4a16-befe-50eabc932262\" (UID: \"bf65cc14-b329-4a16-befe-50eabc932262\") "
Jul 02 17:25:22.603973 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:22.603947    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf65cc14-b329-4a16-befe-50eabc932262-kube-api-access-4rnw8" (OuterVolumeSpecName: "kube-api-access-4rnw8") pod "bf65cc14-b329-4a16-befe-50eabc932262" (UID: "bf65cc14-b329-4a16-befe-50eabc932262"). InnerVolumeSpecName "kube-api-access-4rnw8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 17:25:22.613485 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:22.613465    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf65cc14-b329-4a16-befe-50eabc932262-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "bf65cc14-b329-4a16-befe-50eabc932262" (UID: "bf65cc14-b329-4a16-befe-50eabc932262"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 17:25:22.703379 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:22.703321    2578 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bf65cc14-b329-4a16-befe-50eabc932262-tls-cert\") on node \"ip-10-0-143-67.ec2.internal\" DevicePath \"\""
Jul 02 17:25:22.703379 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:22.703346    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4rnw8\" (UniqueName: \"kubernetes.io/projected/bf65cc14-b329-4a16-befe-50eabc932262-kube-api-access-4rnw8\") on node \"ip-10-0-143-67.ec2.internal\" DevicePath \"\""
Jul 02 17:25:22.843051 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:22.842994    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:25:23.184937 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:23.184906    2578 generic.go:356] "Generic (PLEG): container finished" podID="bf65cc14-b329-4a16-befe-50eabc932262" containerID="ccba0dd38c40a25c002c60e585845f2fc18de21506e7920f441b415706f016c5" exitCode=0
Jul 02 17:25:23.185352 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:23.184946    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-794758b6b8-f4988"
Jul 02 17:25:23.185352 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:23.184996    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-794758b6b8-f4988" event={"ID":"bf65cc14-b329-4a16-befe-50eabc932262","Type":"ContainerDied","Data":"ccba0dd38c40a25c002c60e585845f2fc18de21506e7920f441b415706f016c5"}
Jul 02 17:25:23.185352 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:23.185047    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-794758b6b8-f4988" event={"ID":"bf65cc14-b329-4a16-befe-50eabc932262","Type":"ContainerDied","Data":"9d356eaf8fc4d2616b466252c8b01f53c41b8528654130d9d44608966d24b7ef"}
Jul 02 17:25:23.185352 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:23.185068    2578 scope.go:117] "RemoveContainer" containerID="ccba0dd38c40a25c002c60e585845f2fc18de21506e7920f441b415706f016c5"
Jul 02 17:25:23.193995 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:23.193978    2578 scope.go:117] "RemoveContainer" containerID="ccba0dd38c40a25c002c60e585845f2fc18de21506e7920f441b415706f016c5"
Jul 02 17:25:23.194360 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:25:23.194340    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ccba0dd38c40a25c002c60e585845f2fc18de21506e7920f441b415706f016c5\": container with ID starting with ccba0dd38c40a25c002c60e585845f2fc18de21506e7920f441b415706f016c5 not found: ID does not exist" containerID="ccba0dd38c40a25c002c60e585845f2fc18de21506e7920f441b415706f016c5"
Jul 02 17:25:23.194424 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:23.194368    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ccba0dd38c40a25c002c60e585845f2fc18de21506e7920f441b415706f016c5"} err="failed to get container status \"ccba0dd38c40a25c002c60e585845f2fc18de21506e7920f441b415706f016c5\": rpc error: code = NotFound desc = could not find container \"ccba0dd38c40a25c002c60e585845f2fc18de21506e7920f441b415706f016c5\": container with ID starting with ccba0dd38c40a25c002c60e585845f2fc18de21506e7920f441b415706f016c5 not found: ID does not exist"
Jul 02 17:25:23.206733 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:23.206709    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-794758b6b8-f4988"]
Jul 02 17:25:23.215188 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:23.215167    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-794758b6b8-f4988"]
Jul 02 17:25:23.495892 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:23.495863    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf65cc14-b329-4a16-befe-50eabc932262" path="/var/lib/kubelet/pods/bf65cc14-b329-4a16-befe-50eabc932262/volumes"
Jul 02 17:25:23.983949 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:23.983896    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:25:45.339719 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:45.339690    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-62g9m_d6628590-1cf7-4a61-9350-539f3ae7ed91/ovn-acl-logging/0.log"
Jul 02 17:25:45.341721 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:45.341696    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-62g9m_d6628590-1cf7-4a61-9350-539f3ae7ed91/ovn-acl-logging/0.log"
Jul 02 17:25:48.752388 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:48.752352    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:25:49.149691 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:49.149613    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:25:56.436455 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:56.436423    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-tts5q"]
Jul 02 17:25:56.438814 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:56.436770    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf65cc14-b329-4a16-befe-50eabc932262" containerName="authorino"
Jul 02 17:25:56.438814 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:56.436784    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf65cc14-b329-4a16-befe-50eabc932262" containerName="authorino"
Jul 02 17:25:56.438814 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:56.436874    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf65cc14-b329-4a16-befe-50eabc932262" containerName="authorino"
Jul 02 17:25:56.439768 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:56.439750    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tts5q"
Jul 02 17:25:56.442463 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:56.442444    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 02 17:25:56.442561 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:56.442475    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 02 17:25:56.443776 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:56.443746    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 02 17:25:56.443883 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:56.443784    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-gfvgc\""
Jul 02 17:25:56.455040 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:56.454994    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-tts5q"]
Jul 02 17:25:56.459062 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:56.459035    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:25:56.567952 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:56.567927    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7n6pr\" (UniqueName: \"kubernetes.io/projected/559525f4-b918-470b-bcf2-c74ef8974d92-kube-api-access-7n6pr\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tts5q\" (UID: \"559525f4-b918-470b-bcf2-c74ef8974d92\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tts5q"
Jul 02 17:25:56.568079 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:56.567957    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/559525f4-b918-470b-bcf2-c74ef8974d92-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tts5q\" (UID: \"559525f4-b918-470b-bcf2-c74ef8974d92\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tts5q"
Jul 02 17:25:56.568079 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:56.567986    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/559525f4-b918-470b-bcf2-c74ef8974d92-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tts5q\" (UID: \"559525f4-b918-470b-bcf2-c74ef8974d92\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tts5q"
Jul 02 17:25:56.568079 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:56.568003    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/559525f4-b918-470b-bcf2-c74ef8974d92-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tts5q\" (UID: \"559525f4-b918-470b-bcf2-c74ef8974d92\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tts5q"
Jul 02 17:25:56.568079 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:56.568043    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/559525f4-b918-470b-bcf2-c74ef8974d92-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tts5q\" (UID: \"559525f4-b918-470b-bcf2-c74ef8974d92\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tts5q"
Jul 02 17:25:56.568079 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:56.568065    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/559525f4-b918-470b-bcf2-c74ef8974d92-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tts5q\" (UID: \"559525f4-b918-470b-bcf2-c74ef8974d92\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tts5q"
Jul 02 17:25:56.669125 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:56.669098    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7n6pr\" (UniqueName: \"kubernetes.io/projected/559525f4-b918-470b-bcf2-c74ef8974d92-kube-api-access-7n6pr\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tts5q\" (UID: \"559525f4-b918-470b-bcf2-c74ef8974d92\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tts5q"
Jul 02 17:25:56.669212 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:56.669131    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/559525f4-b918-470b-bcf2-c74ef8974d92-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tts5q\" (UID: \"559525f4-b918-470b-bcf2-c74ef8974d92\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tts5q"
Jul 02 17:25:56.669212 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:56.669157    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/559525f4-b918-470b-bcf2-c74ef8974d92-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tts5q\" (UID: \"559525f4-b918-470b-bcf2-c74ef8974d92\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tts5q"
Jul 02 17:25:56.669212 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:56.669181    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/559525f4-b918-470b-bcf2-c74ef8974d92-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tts5q\" (UID: \"559525f4-b918-470b-bcf2-c74ef8974d92\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tts5q"
Jul 02 17:25:56.669212 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:56.669205    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/559525f4-b918-470b-bcf2-c74ef8974d92-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tts5q\" (UID: \"559525f4-b918-470b-bcf2-c74ef8974d92\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tts5q"
Jul 02 17:25:56.669375 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:56.669230    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/559525f4-b918-470b-bcf2-c74ef8974d92-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tts5q\" (UID: \"559525f4-b918-470b-bcf2-c74ef8974d92\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tts5q"
Jul 02 17:25:56.669487 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:56.669468    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/559525f4-b918-470b-bcf2-c74ef8974d92-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tts5q\" (UID: \"559525f4-b918-470b-bcf2-c74ef8974d92\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tts5q"
Jul 02 17:25:56.669584 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:56.669565    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/559525f4-b918-470b-bcf2-c74ef8974d92-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tts5q\" (UID: \"559525f4-b918-470b-bcf2-c74ef8974d92\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tts5q"
Jul 02 17:25:56.669667 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:56.669649    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/559525f4-b918-470b-bcf2-c74ef8974d92-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tts5q\" (UID: \"559525f4-b918-470b-bcf2-c74ef8974d92\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tts5q"
Jul 02 17:25:56.671377 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:56.671352    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/559525f4-b918-470b-bcf2-c74ef8974d92-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tts5q\" (UID: \"559525f4-b918-470b-bcf2-c74ef8974d92\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tts5q"
Jul 02 17:25:56.671639 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:56.671620    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/559525f4-b918-470b-bcf2-c74ef8974d92-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tts5q\" (UID: \"559525f4-b918-470b-bcf2-c74ef8974d92\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tts5q"
Jul 02 17:25:56.685344 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:56.685323    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7n6pr\" (UniqueName: \"kubernetes.io/projected/559525f4-b918-470b-bcf2-c74ef8974d92-kube-api-access-7n6pr\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tts5q\" (UID: \"559525f4-b918-470b-bcf2-c74ef8974d92\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tts5q"
Jul 02 17:25:56.756849 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:56.756817    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tts5q"
Jul 02 17:25:56.884312 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:56.884289    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-tts5q"]
Jul 02 17:25:56.885966 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:25:56.885940    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod559525f4_b918_470b_bcf2_c74ef8974d92.slice/crio-1946f3ed296167f1de171b53fb21b35a1214b96840639593c63cf322cce703b0 WatchSource:0}: Error finding container 1946f3ed296167f1de171b53fb21b35a1214b96840639593c63cf322cce703b0: Status 404 returned error can't find the container with id 1946f3ed296167f1de171b53fb21b35a1214b96840639593c63cf322cce703b0
Jul 02 17:25:57.142948 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:57.142876    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:25:57.361149 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:57.361112    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tts5q" event={"ID":"559525f4-b918-470b-bcf2-c74ef8974d92","Type":"ContainerStarted","Data":"1946f3ed296167f1de171b53fb21b35a1214b96840639593c63cf322cce703b0"}
Jul 02 17:25:59.372085 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:59.372053    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tts5q" event={"ID":"559525f4-b918-470b-bcf2-c74ef8974d92","Type":"ContainerStarted","Data":"4b217ac25dc3b677e85d739a212b64af00315badf0e3eab4cfae09f6121c1ee1"}
Jul 02 17:25:59.390083 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:25:59.390032    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tts5q" podStartSLOduration=1.967589186 podStartE2EDuration="3.390002021s" totalImagesPullingTime="1.422412835s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:25:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:25:59.387585072 +0000 UTC m=+914.577287733" watchObservedRunningTime="2026-07-02 17:25:59.390002021 +0000 UTC m=+914.579704683"
Jul 02 17:26:05.264886 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:26:05.264846    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:26:06.047311 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:26:06.047277    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:26:06.757252 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:26:06.757216    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tts5q"
Jul 02 17:26:06.757622 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:26:06.757281    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tts5q"
Jul 02 17:26:06.769696 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:26:06.769667    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tts5q"
Jul 02 17:26:07.418957 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:26:07.418929    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tts5q"
Jul 02 17:26:07.974898 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:26:07.974862    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:26:10.071329 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:26:10.071287    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:26:11.739464 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:26:11.739423    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:26:14.642041 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:26:14.641995    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-gg9n4"]
Jul 02 17:26:14.645575 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:26:14.645554    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gg9n4"
Jul 02 17:26:14.648188 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:26:14.648169    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 02 17:26:14.654075 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:26:14.654053    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-gg9n4"]
Jul 02 17:26:14.668129 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:26:14.668109    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:26:14.804434 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:26:14.804410    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aed43e87-7df2-4060-8f6a-cdac8066b200-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gg9n4\" (UID: \"aed43e87-7df2-4060-8f6a-cdac8066b200\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gg9n4"
Jul 02 17:26:14.804551 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:26:14.804453    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aed43e87-7df2-4060-8f6a-cdac8066b200-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gg9n4\" (UID: \"aed43e87-7df2-4060-8f6a-cdac8066b200\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gg9n4"
Jul 02 17:26:14.804551 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:26:14.804501    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aed43e87-7df2-4060-8f6a-cdac8066b200-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gg9n4\" (UID: \"aed43e87-7df2-4060-8f6a-cdac8066b200\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gg9n4"
Jul 02 17:26:14.804551 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:26:14.804521    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aed43e87-7df2-4060-8f6a-cdac8066b200-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gg9n4\" (UID: \"aed43e87-7df2-4060-8f6a-cdac8066b200\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gg9n4"
Jul 02 17:26:14.804551 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:26:14.804543    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9m4mv\" (UniqueName: \"kubernetes.io/projected/aed43e87-7df2-4060-8f6a-cdac8066b200-kube-api-access-9m4mv\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gg9n4\" (UID: \"aed43e87-7df2-4060-8f6a-cdac8066b200\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gg9n4"
Jul 02 17:26:14.804733 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:26:14.804642    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aed43e87-7df2-4060-8f6a-cdac8066b200-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gg9n4\" (UID: \"aed43e87-7df2-4060-8f6a-cdac8066b200\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gg9n4"
Jul 02 17:26:14.905793 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:26:14.905730    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aed43e87-7df2-4060-8f6a-cdac8066b200-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gg9n4\" (UID: \"aed43e87-7df2-4060-8f6a-cdac8066b200\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gg9n4"
Jul 02 17:26:14.905793 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:26:14.905781    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aed43e87-7df2-4060-8f6a-cdac8066b200-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gg9n4\" (UID: \"aed43e87-7df2-4060-8f6a-cdac8066b200\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gg9n4"
Jul 02 17:26:14.905977 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:26:14.905813    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aed43e87-7df2-4060-8f6a-cdac8066b200-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gg9n4\" (UID: \"aed43e87-7df2-4060-8f6a-cdac8066b200\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gg9n4"
Jul 02 17:26:14.905977 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:26:14.905841    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aed43e87-7df2-4060-8f6a-cdac8066b200-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gg9n4\" (UID: \"aed43e87-7df2-4060-8f6a-cdac8066b200\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gg9n4"
Jul 02 17:26:14.905977 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:26:14.905857    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aed43e87-7df2-4060-8f6a-cdac8066b200-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gg9n4\" (UID: \"aed43e87-7df2-4060-8f6a-cdac8066b200\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gg9n4"
Jul 02 17:26:14.905977 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:26:14.905877    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9m4mv\" (UniqueName: \"kubernetes.io/projected/aed43e87-7df2-4060-8f6a-cdac8066b200-kube-api-access-9m4mv\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gg9n4\" (UID: \"aed43e87-7df2-4060-8f6a-cdac8066b200\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gg9n4"
Jul 02 17:26:14.906250 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:26:14.906228    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aed43e87-7df2-4060-8f6a-cdac8066b200-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gg9n4\" (UID: \"aed43e87-7df2-4060-8f6a-cdac8066b200\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gg9n4"
Jul 02 17:26:14.906305 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:26:14.906260    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aed43e87-7df2-4060-8f6a-cdac8066b200-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gg9n4\" (UID: \"aed43e87-7df2-4060-8f6a-cdac8066b200\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gg9n4"
Jul 02 17:26:14.906305 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:26:14.906295    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aed43e87-7df2-4060-8f6a-cdac8066b200-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gg9n4\" (UID: \"aed43e87-7df2-4060-8f6a-cdac8066b200\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gg9n4"
Jul 02 17:26:14.908138 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:26:14.908121    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aed43e87-7df2-4060-8f6a-cdac8066b200-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gg9n4\" (UID: \"aed43e87-7df2-4060-8f6a-cdac8066b200\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gg9n4"
Jul 02 17:26:14.908442 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:26:14.908420    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aed43e87-7df2-4060-8f6a-cdac8066b200-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gg9n4\" (UID: \"aed43e87-7df2-4060-8f6a-cdac8066b200\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gg9n4"
Jul 02 17:26:14.913379 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:26:14.913359    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9m4mv\" (UniqueName: \"kubernetes.io/projected/aed43e87-7df2-4060-8f6a-cdac8066b200-kube-api-access-9m4mv\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gg9n4\" (UID: \"aed43e87-7df2-4060-8f6a-cdac8066b200\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gg9n4"
Jul 02 17:26:14.956368 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:26:14.956343    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gg9n4"
Jul 02 17:26:15.084535 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:26:15.084509    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-gg9n4"]
Jul 02 17:26:15.086242 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:26:15.086206    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaed43e87_7df2_4060_8f6a_cdac8066b200.slice/crio-0ff91bc35e882e03cde1f2ca342e0fc96cbd8f27c5323ec491a2e4bfd02fb94a WatchSource:0}: Error finding container 0ff91bc35e882e03cde1f2ca342e0fc96cbd8f27c5323ec491a2e4bfd02fb94a: Status 404 returned error can't find the container with id 0ff91bc35e882e03cde1f2ca342e0fc96cbd8f27c5323ec491a2e4bfd02fb94a
Jul 02 17:26:15.087834 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:26:15.087812    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 17:26:15.445753 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:26:15.445717    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gg9n4" event={"ID":"aed43e87-7df2-4060-8f6a-cdac8066b200","Type":"ContainerStarted","Data":"d8385a0459263c97c46f204d7fa7b7762a1fd5ce39c5fb7bd54ba41968259181"}
Jul 02 17:26:15.445883 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:26:15.445776    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gg9n4" event={"ID":"aed43e87-7df2-4060-8f6a-cdac8066b200","Type":"ContainerStarted","Data":"0ff91bc35e882e03cde1f2ca342e0fc96cbd8f27c5323ec491a2e4bfd02fb94a"}
Jul 02 17:26:15.463849 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:26:15.463801    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gg9n4" podStartSLOduration=1.236209003 podStartE2EDuration="1.463786931s" totalImagesPullingTime="227.577928ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:26:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:26:15.462731308 +0000 UTC m=+930.652433971" watchObservedRunningTime="2026-07-02 17:26:15.463786931 +0000 UTC m=+930.653489593"
Jul 02 17:26:17.344697 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:26:17.344639    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:26:19.947884 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:26:19.947847    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-27446"]
Jul 02 17:26:19.951655 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:26:19.951632    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-27446"
Jul 02 17:26:19.954243 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:26:19.954220    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 02 17:26:19.960597 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:26:19.960577    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-27446"]
Jul 02 17:26:19.975379 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:26:19.975353    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:26:20.055290 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:26:20.055271    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c229a72-60ac-4b4c-a503-8eb2dbd6a4ea-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-27446\" (UID: \"8c229a72-60ac-4b4c-a503-8eb2dbd6a4ea\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-27446"
Jul 02 17:26:20.055409 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:26:20.055307    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c229a72-60ac-4b4c-a503-8eb2dbd6a4ea-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-27446\" (UID: \"8c229a72-60ac-4b4c-a503-8eb2dbd6a4ea\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-27446"
Jul 02 17:26:20.055409 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:26:20.055334    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c229a72-60ac-4b4c-a503-8eb2dbd6a4ea-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-27446\" (UID: \"8c229a72-60ac-4b4c-a503-8eb2dbd6a4ea\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-27446"
Jul 02 17:26:20.055409 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:26:20.055382    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c229a72-60ac-4b4c-a503-8eb2dbd6a4ea-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-27446\" (UID: \"8c229a72-60ac-4b4c-a503-8eb2dbd6a4ea\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-27446"
Jul 02 17:26:20.055571 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:26:20.055437    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jh4m2\" (UniqueName: \"kubernetes.io/projected/8c229a72-60ac-4b4c-a503-8eb2dbd6a4ea-kube-api-access-jh4m2\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-27446\" (UID: \"8c229a72-60ac-4b4c-a503-8eb2dbd6a4ea\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-27446"
Jul 02 17:26:20.055571 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:26:20.055470    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c229a72-60ac-4b4c-a503-8eb2dbd6a4ea-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-27446\" (UID: \"8c229a72-60ac-4b4c-a503-8eb2dbd6a4ea\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-27446"
Jul 02 17:26:20.156660 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:26:20.156639    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c229a72-60ac-4b4c-a503-8eb2dbd6a4ea-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-27446\" (UID: \"8c229a72-60ac-4b4c-a503-8eb2dbd6a4ea\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-27446"
Jul 02 17:26:20.156754 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:26:20.156669    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c229a72-60ac-4b4c-a503-8eb2dbd6a4ea-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-27446\" (UID: \"8c229a72-60ac-4b4c-a503-8eb2dbd6a4ea\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-27446"
Jul 02 17:26:20.156754 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:26:20.156689    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c229a72-60ac-4b4c-a503-8eb2dbd6a4ea-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-27446\" (UID: \"8c229a72-60ac-4b4c-a503-8eb2dbd6a4ea\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-27446"
Jul 02 17:26:20.156754 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:26:20.156711    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jh4m2\" (UniqueName: \"kubernetes.io/projected/8c229a72-60ac-4b4c-a503-8eb2dbd6a4ea-kube-api-access-jh4m2\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-27446\" (UID: \"8c229a72-60ac-4b4c-a503-8eb2dbd6a4ea\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-27446"
Jul 02 17:26:20.156754 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:26:20.156750    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c229a72-60ac-4b4c-a503-8eb2dbd6a4ea-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-27446\" (UID: \"8c229a72-60ac-4b4c-a503-8eb2dbd6a4ea\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-27446"
Jul 02 17:26:20.156949 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:26:20.156824    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c229a72-60ac-4b4c-a503-8eb2dbd6a4ea-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-27446\" (UID: \"8c229a72-60ac-4b4c-a503-8eb2dbd6a4ea\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-27446"
Jul 02 17:26:20.157118 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:26:20.157094    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c229a72-60ac-4b4c-a503-8eb2dbd6a4ea-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-27446\" (UID: \"8c229a72-60ac-4b4c-a503-8eb2dbd6a4ea\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-27446"
Jul 02 17:26:20.157205 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:26:20.157186    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c229a72-60ac-4b4c-a503-8eb2dbd6a4ea-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-27446\" (UID: \"8c229a72-60ac-4b4c-a503-8eb2dbd6a4ea\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-27446"
Jul 02 17:26:20.157244 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:26:20.157204    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c229a72-60ac-4b4c-a503-8eb2dbd6a4ea-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-27446\" (UID: \"8c229a72-60ac-4b4c-a503-8eb2dbd6a4ea\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-27446"
Jul 02 17:26:20.158999 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:26:20.158981    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c229a72-60ac-4b4c-a503-8eb2dbd6a4ea-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-27446\" (UID: \"8c229a72-60ac-4b4c-a503-8eb2dbd6a4ea\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-27446"
Jul 02 17:26:20.159277 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:26:20.159261    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c229a72-60ac-4b4c-a503-8eb2dbd6a4ea-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-27446\" (UID: \"8c229a72-60ac-4b4c-a503-8eb2dbd6a4ea\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-27446"
Jul 02 17:26:20.164837 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:26:20.164817    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jh4m2\" (UniqueName: \"kubernetes.io/projected/8c229a72-60ac-4b4c-a503-8eb2dbd6a4ea-kube-api-access-jh4m2\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-27446\" (UID: \"8c229a72-60ac-4b4c-a503-8eb2dbd6a4ea\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-27446"
Jul 02 17:26:20.262958 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:26:20.262928    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-27446"
Jul 02 17:26:20.399089 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:26:20.399059    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-27446"]
Jul 02 17:26:20.402442 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:26:20.402418    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8c229a72_60ac_4b4c_a503_8eb2dbd6a4ea.slice/crio-8fdbfe964b99b67d00dbbe5961255928755f7c7284ba0d8d06ac89533926f413 WatchSource:0}: Error finding container 8fdbfe964b99b67d00dbbe5961255928755f7c7284ba0d8d06ac89533926f413: Status 404 returned error can't find the container with id 8fdbfe964b99b67d00dbbe5961255928755f7c7284ba0d8d06ac89533926f413
Jul 02 17:26:20.470461 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:26:20.470420    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-27446" event={"ID":"8c229a72-60ac-4b4c-a503-8eb2dbd6a4ea","Type":"ContainerStarted","Data":"8fdbfe964b99b67d00dbbe5961255928755f7c7284ba0d8d06ac89533926f413"}
Jul 02 17:26:21.476784 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:26:21.476746    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-27446" event={"ID":"8c229a72-60ac-4b4c-a503-8eb2dbd6a4ea","Type":"ContainerStarted","Data":"eba22d96a4146f03fd63e67b019a17fdba43f3abc8d8725c327f009dba0671d8"}
Jul 02 17:26:21.494689 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:26:21.494636    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-27446" podStartSLOduration=2.322600079 podStartE2EDuration="2.494615224s" totalImagesPullingTime="172.015145ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:26:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:26:21.493532813 +0000 UTC m=+936.683235477" watchObservedRunningTime="2026-07-02 17:26:21.494615224 +0000 UTC m=+936.684317887"
Jul 02 17:26:24.956964 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:26:24.956924    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gg9n4"
Jul 02 17:26:24.957517 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:26:24.956994    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gg9n4"
Jul 02 17:26:24.969611 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:26:24.969583    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gg9n4"
Jul 02 17:26:25.507601 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:26:25.507570    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gg9n4"
Jul 02 17:26:28.540711 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:26:28.540678    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:26:30.263375 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:26:30.263342    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-27446"
Jul 02 17:26:30.263375 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:26:30.263385    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-27446"
Jul 02 17:26:30.275887 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:26:30.275861    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-27446"
Jul 02 17:26:30.529309 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:26:30.529229    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-27446"
Jul 02 17:26:34.833343 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:26:34.833295    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:26:34.934712 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:26:34.934682    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:26:36.558169 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:26:36.558133    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:26:40.307591 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:26:40.307546    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:27:18.943757 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:27:18.943671    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-85cb5d9467-289sf"]
Jul 02 17:27:18.947202 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:27:18.947185    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-85cb5d9467-289sf"
Jul 02 17:27:18.958496 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:27:18.958468    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-85cb5d9467-289sf"]
Jul 02 17:27:19.014983 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:27:19.014957    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5npz8\" (UniqueName: \"kubernetes.io/projected/63b0edae-dad2-4846-9292-e68ecef53056-kube-api-access-5npz8\") pod \"authorino-85cb5d9467-289sf\" (UID: \"63b0edae-dad2-4846-9292-e68ecef53056\") " pod="kuadrant-system/authorino-85cb5d9467-289sf"
Jul 02 17:27:19.015090 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:27:19.015002    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/63b0edae-dad2-4846-9292-e68ecef53056-oidc-ca\") pod \"authorino-85cb5d9467-289sf\" (UID: \"63b0edae-dad2-4846-9292-e68ecef53056\") " pod="kuadrant-system/authorino-85cb5d9467-289sf"
Jul 02 17:27:19.015131 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:27:19.015109    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/63b0edae-dad2-4846-9292-e68ecef53056-tls-cert\") pod \"authorino-85cb5d9467-289sf\" (UID: \"63b0edae-dad2-4846-9292-e68ecef53056\") " pod="kuadrant-system/authorino-85cb5d9467-289sf"
Jul 02 17:27:19.115659 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:27:19.115629    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/63b0edae-dad2-4846-9292-e68ecef53056-tls-cert\") pod \"authorino-85cb5d9467-289sf\" (UID: \"63b0edae-dad2-4846-9292-e68ecef53056\") " pod="kuadrant-system/authorino-85cb5d9467-289sf"
Jul 02 17:27:19.115772 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:27:19.115707    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5npz8\" (UniqueName: \"kubernetes.io/projected/63b0edae-dad2-4846-9292-e68ecef53056-kube-api-access-5npz8\") pod \"authorino-85cb5d9467-289sf\" (UID: \"63b0edae-dad2-4846-9292-e68ecef53056\") " pod="kuadrant-system/authorino-85cb5d9467-289sf"
Jul 02 17:27:19.115772 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:27:19.115762    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/63b0edae-dad2-4846-9292-e68ecef53056-oidc-ca\") pod \"authorino-85cb5d9467-289sf\" (UID: \"63b0edae-dad2-4846-9292-e68ecef53056\") " pod="kuadrant-system/authorino-85cb5d9467-289sf"
Jul 02 17:27:19.116361 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:27:19.116340    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/63b0edae-dad2-4846-9292-e68ecef53056-oidc-ca\") pod \"authorino-85cb5d9467-289sf\" (UID: \"63b0edae-dad2-4846-9292-e68ecef53056\") " pod="kuadrant-system/authorino-85cb5d9467-289sf"
Jul 02 17:27:19.118115 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:27:19.118088    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/63b0edae-dad2-4846-9292-e68ecef53056-tls-cert\") pod \"authorino-85cb5d9467-289sf\" (UID: \"63b0edae-dad2-4846-9292-e68ecef53056\") " pod="kuadrant-system/authorino-85cb5d9467-289sf"
Jul 02 17:27:19.129500 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:27:19.129482    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5npz8\" (UniqueName: \"kubernetes.io/projected/63b0edae-dad2-4846-9292-e68ecef53056-kube-api-access-5npz8\") pod \"authorino-85cb5d9467-289sf\" (UID: \"63b0edae-dad2-4846-9292-e68ecef53056\") " pod="kuadrant-system/authorino-85cb5d9467-289sf"
Jul 02 17:27:19.257462 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:27:19.257441    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-85cb5d9467-289sf"
Jul 02 17:27:19.389902 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:27:19.389879    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-85cb5d9467-289sf"]
Jul 02 17:27:19.391463 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:27:19.391436    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod63b0edae_dad2_4846_9292_e68ecef53056.slice/crio-e7e923bab35a59cb6b36a1d31bfba1037f41f5fef456f8d8d069593fbe0c0c3d WatchSource:0}: Error finding container e7e923bab35a59cb6b36a1d31bfba1037f41f5fef456f8d8d069593fbe0c0c3d: Status 404 returned error can't find the container with id e7e923bab35a59cb6b36a1d31bfba1037f41f5fef456f8d8d069593fbe0c0c3d
Jul 02 17:27:19.473542 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:27:19.473501    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:27:19.590032 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:27:19.589944    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:27:19.757909 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:27:19.757882    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-85cb5d9467-289sf" event={"ID":"63b0edae-dad2-4846-9292-e68ecef53056","Type":"ContainerStarted","Data":"e7e923bab35a59cb6b36a1d31bfba1037f41f5fef456f8d8d069593fbe0c0c3d"}
Jul 02 17:27:20.556602 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:27:20.556564    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:27:20.656611 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:27:20.656561    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:27:20.764581 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:27:20.764545    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-85cb5d9467-289sf" event={"ID":"63b0edae-dad2-4846-9292-e68ecef53056","Type":"ContainerStarted","Data":"547548eb602064cafd2b43311328bac94ae04f29679027281a8f329cf343eb5b"}
Jul 02 17:27:20.783744 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:27:20.783694    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-85cb5d9467-289sf" podStartSLOduration=2.324854121 podStartE2EDuration="2.783676849s" totalImagesPullingTime="458.822728ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:27:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:27:20.78106096 +0000 UTC m=+995.970763622" watchObservedRunningTime="2026-07-02 17:27:20.783676849 +0000 UTC m=+995.973379511"
Jul 02 17:27:20.818169 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:27:20.818085    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5599dfbd86-zg49l"]
Jul 02 17:27:20.818323 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:27:20.818294    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5599dfbd86-zg49l" podUID="7d73293a-befc-40b5-a6c1-1f9b26411eef" containerName="authorino" containerID="cri-o://e91142363da852873d760f5ab52d2b0eeec98833a4e1a11c5d7ac6ece6448370" gracePeriod=30
Jul 02 17:27:21.087880 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:27:21.087847    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5599dfbd86-zg49l"
Jul 02 17:27:21.235900 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:27:21.235857    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nbs5r\" (UniqueName: \"kubernetes.io/projected/7d73293a-befc-40b5-a6c1-1f9b26411eef-kube-api-access-nbs5r\") pod \"7d73293a-befc-40b5-a6c1-1f9b26411eef\" (UID: \"7d73293a-befc-40b5-a6c1-1f9b26411eef\") "
Jul 02 17:27:21.236093 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:27:21.235944    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7d73293a-befc-40b5-a6c1-1f9b26411eef-tls-cert\") pod \"7d73293a-befc-40b5-a6c1-1f9b26411eef\" (UID: \"7d73293a-befc-40b5-a6c1-1f9b26411eef\") "
Jul 02 17:27:21.236093 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:27:21.236039    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/7d73293a-befc-40b5-a6c1-1f9b26411eef-oidc-ca\") pod \"7d73293a-befc-40b5-a6c1-1f9b26411eef\" (UID: \"7d73293a-befc-40b5-a6c1-1f9b26411eef\") "
Jul 02 17:27:21.238099 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:27:21.238075    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d73293a-befc-40b5-a6c1-1f9b26411eef-kube-api-access-nbs5r" (OuterVolumeSpecName: "kube-api-access-nbs5r") pod "7d73293a-befc-40b5-a6c1-1f9b26411eef" (UID: "7d73293a-befc-40b5-a6c1-1f9b26411eef"). InnerVolumeSpecName "kube-api-access-nbs5r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 17:27:21.242656 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:27:21.242630    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d73293a-befc-40b5-a6c1-1f9b26411eef-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "7d73293a-befc-40b5-a6c1-1f9b26411eef" (UID: "7d73293a-befc-40b5-a6c1-1f9b26411eef"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 17:27:21.247607 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:27:21.247587    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d73293a-befc-40b5-a6c1-1f9b26411eef-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "7d73293a-befc-40b5-a6c1-1f9b26411eef" (UID: "7d73293a-befc-40b5-a6c1-1f9b26411eef"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 17:27:21.337631 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:27:21.337556    2578 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7d73293a-befc-40b5-a6c1-1f9b26411eef-tls-cert\") on node \"ip-10-0-143-67.ec2.internal\" DevicePath \"\""
Jul 02 17:27:21.337631 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:27:21.337583    2578 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/7d73293a-befc-40b5-a6c1-1f9b26411eef-oidc-ca\") on node \"ip-10-0-143-67.ec2.internal\" DevicePath \"\""
Jul 02 17:27:21.337631 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:27:21.337592    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nbs5r\" (UniqueName: \"kubernetes.io/projected/7d73293a-befc-40b5-a6c1-1f9b26411eef-kube-api-access-nbs5r\") on node \"ip-10-0-143-67.ec2.internal\" DevicePath \"\""
Jul 02 17:27:21.774679 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:27:21.774644    2578 generic.go:356] "Generic (PLEG): container finished" podID="7d73293a-befc-40b5-a6c1-1f9b26411eef" containerID="e91142363da852873d760f5ab52d2b0eeec98833a4e1a11c5d7ac6ece6448370" exitCode=0
Jul 02 17:27:21.775150 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:27:21.774690    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5599dfbd86-zg49l"
Jul 02 17:27:21.775150 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:27:21.774736    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5599dfbd86-zg49l" event={"ID":"7d73293a-befc-40b5-a6c1-1f9b26411eef","Type":"ContainerDied","Data":"e91142363da852873d760f5ab52d2b0eeec98833a4e1a11c5d7ac6ece6448370"}
Jul 02 17:27:21.775150 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:27:21.774772    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5599dfbd86-zg49l" event={"ID":"7d73293a-befc-40b5-a6c1-1f9b26411eef","Type":"ContainerDied","Data":"8c06360355c69987d90ac3afa8ccf7c6e090dfe9174fb816b0af876e6dbfefdd"}
Jul 02 17:27:21.775150 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:27:21.774795    2578 scope.go:117] "RemoveContainer" containerID="e91142363da852873d760f5ab52d2b0eeec98833a4e1a11c5d7ac6ece6448370"
Jul 02 17:27:21.783996 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:27:21.783974    2578 scope.go:117] "RemoveContainer" containerID="e91142363da852873d760f5ab52d2b0eeec98833a4e1a11c5d7ac6ece6448370"
Jul 02 17:27:21.784266 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:27:21.784245    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e91142363da852873d760f5ab52d2b0eeec98833a4e1a11c5d7ac6ece6448370\": container with ID starting with e91142363da852873d760f5ab52d2b0eeec98833a4e1a11c5d7ac6ece6448370 not found: ID does not exist" containerID="e91142363da852873d760f5ab52d2b0eeec98833a4e1a11c5d7ac6ece6448370"
Jul 02 17:27:21.784348 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:27:21.784272    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e91142363da852873d760f5ab52d2b0eeec98833a4e1a11c5d7ac6ece6448370"} err="failed to get container status \"e91142363da852873d760f5ab52d2b0eeec98833a4e1a11c5d7ac6ece6448370\": rpc error: code = NotFound desc = could not find container \"e91142363da852873d760f5ab52d2b0eeec98833a4e1a11c5d7ac6ece6448370\": container with ID starting with e91142363da852873d760f5ab52d2b0eeec98833a4e1a11c5d7ac6ece6448370 not found: ID does not exist"
Jul 02 17:27:21.791593 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:27:21.791571    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5599dfbd86-zg49l"]
Jul 02 17:27:21.797659 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:27:21.797628    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5599dfbd86-zg49l"]
Jul 02 17:27:23.496586 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:27:23.496554    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d73293a-befc-40b5-a6c1-1f9b26411eef" path="/var/lib/kubelet/pods/7d73293a-befc-40b5-a6c1-1f9b26411eef/volumes"
Jul 02 17:27:48.744976 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:27:48.744941    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:27:59.047428 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:27:59.047393    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:28:09.837497 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:28:09.837463    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:28:20.434451 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:28:20.434422    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:28:29.543049 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:28:29.543002    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:28:32.212758 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:28:32.212721    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:28:33.514672 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:28:33.514634    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:29:09.147926 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:29:09.147887    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:29:09.244768 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:29:09.244736    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:29:09.358591 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:29:09.358562    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:29:15.097253 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:29:15.097222    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:29:15.156789 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:29:15.156758    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:29:15.243626 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:29:15.243597    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:29:15.340637 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:29:15.340614    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:29:15.441297 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:29:15.441233    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:29:21.109463 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:29:21.109428    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:29:21.210197 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:29:21.210166    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:29:36.845770 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:29:36.845737    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:29:44.558170 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:29:44.558139    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:29:54.036515 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:29:54.036480    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:30:03.944842 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:30:03.944808    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:30:15.255474 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:30:15.255383    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:30:27.555250 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:30:27.555217    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:30:37.963666 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:30:37.963630    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:30:41.231900 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:30:41.231830    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:30:42.757464 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:30:42.757430    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:30:44.358854 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:30:44.358820    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:30:45.371867 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:30:45.371841    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-62g9m_d6628590-1cf7-4a61-9350-539f3ae7ed91/ovn-acl-logging/0.log"
Jul 02 17:30:45.374892 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:30:45.374872    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-62g9m_d6628590-1cf7-4a61-9350-539f3ae7ed91/ovn-acl-logging/0.log"
Jul 02 17:30:52.535969 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:30:52.535940    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:31:00.795634 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:31:00.795599    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:31:06.487610 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:31:06.487559    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:31:13.343184 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:31:13.343146    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:31:22.650357 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:31:22.650324    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:31:28.269542 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:31:28.269494    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:31:44.847453 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:31:44.847416    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:31:55.149543 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:31:55.149514    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:32:11.504509 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:32:11.504471    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:32:12.452085 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:32:12.452041    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:32:20.645345 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:32:20.645314    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:32:30.648098 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:32:30.648053    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:32:40.154009 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:32:40.153972    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:32:49.248620 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:32:49.248575    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:34:40.352129 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:34:40.352049    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:34:49.847007 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:34:49.846977    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:35:02.551694 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:35:02.551658    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:35:12.705127 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:35:12.705086    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:35:13.943374 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:35:13.943336    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:35:26.742237 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:35:26.742200    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:35:36.046256 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:35:36.046214    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:35:44.947708 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:35:44.947670    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:35:45.399519 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:35:45.399490    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-62g9m_d6628590-1cf7-4a61-9350-539f3ae7ed91/ovn-acl-logging/0.log"
Jul 02 17:35:45.403914 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:35:45.403893    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-62g9m_d6628590-1cf7-4a61-9350-539f3ae7ed91/ovn-acl-logging/0.log"
Jul 02 17:35:55.846452 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:35:55.846415    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:36:07.944760 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:36:07.944684    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:36:16.649128 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:36:16.649095    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:36:28.445170 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:36:28.445137    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:36:51.054095 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:36:51.054055    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:37:00.653331 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:37:00.653295    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:37:01.502824 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:37:01.502794    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:37:10.045852 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:37:10.045819    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:37:15.693218 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:37:15.693162    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:37:22.240237 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:37:22.240202    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:37:31.240689 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:37:31.240655    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:37:38.748135 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:37:38.748062    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:37:48.239909 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:37:48.239878    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:37:57.556156 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:37:57.556128    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:38:05.554515 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:38:05.554474    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:38:14.963589 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:38:14.963552    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:38:24.142519 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:38:24.142487    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:38:37.250542 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:38:37.250507    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:38:46.535775 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:38:46.535741    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:38:56.248748 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:38:56.248710    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:39:08.452031 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:39:08.451939    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:39:18.241669 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:39:18.241637    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:39:25.343208 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:39:25.343172    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:39:41.755698 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:39:41.755654    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:39:53.553989 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:39:53.553955    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:40:05.548555 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:40:05.548523    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:40:06.494503 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:40:06.494466    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:40:14.031399 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:40:14.031345    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:40:17.443096 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:40:17.443063    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:40:22.306410 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:40:22.306369    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:40:26.643652 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:40:26.643616    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:40:27.630673 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:40:27.630642    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:40:30.579245 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:40:30.579214    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:40:30.674774 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:40:30.674747    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:40:31.104686 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:40:31.104634    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:40:36.059445 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:40:36.059408    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:40:36.926458 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:40:36.926422    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:40:37.000684 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:40:37.000656    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:40:37.233712 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:40:37.233671    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:40:37.381412 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:40:37.381379    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:40:38.383209 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:40:38.383170    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:40:38.483079 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:40:38.483048    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:40:38.597967 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:40:38.597936    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:40:39.087916 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:40:39.087887    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:40:39.181533 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:40:39.181498    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:40:40.762170 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:40:40.762135    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:40:43.469921 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:40:43.469880    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:40:43.652000 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:40:43.651970    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:40:43.758225 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:40:43.758161    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:40:43.828162 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:40:43.828124    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:40:44.975132 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:40:44.975099    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:40:45.431475 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:40:45.431449    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-62g9m_d6628590-1cf7-4a61-9350-539f3ae7ed91/ovn-acl-logging/0.log"
Jul 02 17:40:45.436530 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:40:45.436509    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-62g9m_d6628590-1cf7-4a61-9350-539f3ae7ed91/ovn-acl-logging/0.log"
Jul 02 17:40:49.420549 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:40:49.420513    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:40:49.477589 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:40:49.477558    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:40:49.642010 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:40:49.641973    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:40:49.742222 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:40:49.742192    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:40:50.743785 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:40:50.743748    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:40:50.839230 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:40:50.839199    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:40:50.910766 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:40:50.910742    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:40:51.265201 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:40:51.265174    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:40:51.366408 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:40:51.366380    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:40:51.419741 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:40:51.419713    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:40:52.811307 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:40:52.811279    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:40:53.640952 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:40:53.640922    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:40:55.869546 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:40:55.869508    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:40:56.214115 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:40:56.214007    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:41:01.962292 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:41:01.962254    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:41:02.063331 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:41:02.063299    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:41:04.204838 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:41:04.204806    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:41:04.350431 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:41:04.350395    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:41:07.954740 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:41:07.954628    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:41:08.057855 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:41:08.057828    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:41:08.190690 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:41:08.190662    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:41:08.290718 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:41:08.290690    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:41:09.360126 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:41:09.360090    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:41:09.460969 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:41:09.460937    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:41:09.634336 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:41:09.634257    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:41:09.801563 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:41:09.801530    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:41:10.073790 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:41:10.073761    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:41:10.179850 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:41:10.179820    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:41:11.198175 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:41:11.198145    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:41:13.711455 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:41:13.711420    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:41:13.906843 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:41:13.906810    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:41:14.004281 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:41:14.004255    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:41:14.060711 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:41:14.060684    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:41:15.863737 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:41:15.863704    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:41:19.850808 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:41:19.850772    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:41:19.911662 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:41:19.911637    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:41:20.354631 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:41:20.354601    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:41:20.454845 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:41:20.454813    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:41:20.553610 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:41:20.553587    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:41:21.887361 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:41:21.887329    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:41:27.577393 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:41:27.577359    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:41:27.645801 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:41:27.645775    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:41:27.721386 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:41:27.721355    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:41:27.821856 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:41:27.821824    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:41:27.919807 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:41:27.919737    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:41:28.256339 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:41:28.256309    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:41:54.187377 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:41:54.187338    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:41:59.874299 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:41:59.874261    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:41:59.978240 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:41:59.978204    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:42:00.074064 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:42:00.074005    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:42:15.993235 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:42:15.993206    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:42:21.746334 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:42:21.746293    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:42:21.852646 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:42:21.852613    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:42:21.949822 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:42:21.949790    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:42:32.438001 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:42:32.437966    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:42:33.251546 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:42:33.251514    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:42:39.061369 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:42:39.061338    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:42:39.163238 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:42:39.163207    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:42:39.259398 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:42:39.259363    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:42:39.361140 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:42:39.361072    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:42:40.511691 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:42:40.511661    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:42:46.031495 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:42:46.031465    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:42:46.132196 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:42:46.132164    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:42:46.242670 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:42:46.242638    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:42:46.298889 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:42:46.298817    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:42:46.382396 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:42:46.382358    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:42:46.468288 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:42:46.468252    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:42:46.568346 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:42:46.568276    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:42:47.154825 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:42:47.154791    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:42:47.255098 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:42:47.255062    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:42:47.354189 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:42:47.354153    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:42:47.456831 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:42:47.456747    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:42:49.040716 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:42:49.040683    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:42:49.987703 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:42:49.987668    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:42:54.687341 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:42:54.687307    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:42:54.787856 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:42:54.787823    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:42:55.353082 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:42:55.353050    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:42:59.441469 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:42:59.441434    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:43:01.064798 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:43:01.064767    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:43:01.124947 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:43:01.124909    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:43:01.352056 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:43:01.351949    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:43:01.625509 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:43:01.625420    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:43:01.725135 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:43:01.725096    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:43:04.806244 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:43:04.806194    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:43:04.880461 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:43:04.880432    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:43:04.954855 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:43:04.954824    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:43:05.355288 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:43:05.355249    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:43:05.455947 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:43:05.455917    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:43:09.319050 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:43:09.319000    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:43:10.003987 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:43:10.003949    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:43:10.056083 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:43:10.056048    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:43:10.097454 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:43:10.097423    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:43:10.441557 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:43:10.441473    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:43:16.086732 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:43:16.086692    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:43:16.150876 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:43:16.150836    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:43:16.551443 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:43:16.551407    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:43:16.944338 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:43:16.944250    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:43:17.044987 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:43:17.044954    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:43:21.241199 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:43:21.241162    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:43:22.778539 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:43:22.778498    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:43:22.828362 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:43:22.828333    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:43:23.052256 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:43:23.052173    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:43:23.153823 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:43:23.153791    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:43:23.314425 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:43:23.314325    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:43:23.414779 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:43:23.414748    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:43:23.475860 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:43:23.475828    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:43:23.604543 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:43:23.604475    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:43:29.469112 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:43:29.469079    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:43:29.529638 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:43:29.529609    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:43:29.609074 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:43:29.609042    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:43:29.709218 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:43:29.709188    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:43:29.811118 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:43:29.811090    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:43:35.457085 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:43:35.457049    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:43:35.522371 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:43:35.522338    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:43:41.863391 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:43:41.863312    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:43:42.174514 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:43:42.174410    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:43:42.513355 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:43:42.513313    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:43:45.059638 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:43:45.059607    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:43:45.159416 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:43:45.159385    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:43:45.318367 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:43:45.318283    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:43:45.434477 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:43:45.434448    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:43:45.582723 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:43:45.582644    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:43:45.682953 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:43:45.682926    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:43:47.742535 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:43:47.742501    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:43:49.499887 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:43:49.499854    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:43:55.997510 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:43:55.997463    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:43:56.099070 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:43:56.099040    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:43:58.540169 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:43:58.540132    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-6002673f/e2e-lifecycle-model-6002673f-kserve-8586579fc5-9dkzq"]
Jul 02 17:43:58.540754 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:43:58.540734    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d73293a-befc-40b5-a6c1-1f9b26411eef" containerName="authorino"
Jul 02 17:43:58.540754 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:43:58.540754    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d73293a-befc-40b5-a6c1-1f9b26411eef" containerName="authorino"
Jul 02 17:43:58.540897 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:43:58.540843    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d73293a-befc-40b5-a6c1-1f9b26411eef" containerName="authorino"
Jul 02 17:43:58.544186 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:43:58.544165    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-6002673f/e2e-lifecycle-model-6002673f-kserve-8586579fc5-9dkzq"
Jul 02 17:43:58.548045 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:43:58.548003    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-6002673f\"/\"default-dockercfg-c4mtv\""
Jul 02 17:43:58.548159 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:43:58.548099    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-6002673f\"/\"openshift-service-ca.crt\""
Jul 02 17:43:58.548223 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:43:58.548169    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-6002673f\"/\"e2e-lifecycle-model-6002673f-kserve-self-signed-certs\""
Jul 02 17:43:58.548385 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:43:58.548367    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-6002673f\"/\"kube-root-ca.crt\""
Jul 02 17:43:58.553840 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:43:58.553822    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-6002673f/e2e-lifecycle-model-6002673f-kserve-8586579fc5-9dkzq"]
Jul 02 17:43:58.573220 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:43:58.573198    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:43:58.669832 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:43:58.669791    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6-dshm\") pod \"e2e-lifecycle-model-6002673f-kserve-8586579fc5-9dkzq\" (UID: \"e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6\") " pod="ai-tenant-e2e-mt-6002673f/e2e-lifecycle-model-6002673f-kserve-8586579fc5-9dkzq"
Jul 02 17:43:58.669994 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:43:58.669861    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ft7b5\" (UniqueName: \"kubernetes.io/projected/e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6-kube-api-access-ft7b5\") pod \"e2e-lifecycle-model-6002673f-kserve-8586579fc5-9dkzq\" (UID: \"e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6\") " pod="ai-tenant-e2e-mt-6002673f/e2e-lifecycle-model-6002673f-kserve-8586579fc5-9dkzq"
Jul 02 17:43:58.669994 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:43:58.669907    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6-model-cache\") pod \"e2e-lifecycle-model-6002673f-kserve-8586579fc5-9dkzq\" (UID: \"e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6\") " pod="ai-tenant-e2e-mt-6002673f/e2e-lifecycle-model-6002673f-kserve-8586579fc5-9dkzq"
Jul 02 17:43:58.669994 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:43:58.669930    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6-home\") pod \"e2e-lifecycle-model-6002673f-kserve-8586579fc5-9dkzq\" (UID: \"e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6\") " pod="ai-tenant-e2e-mt-6002673f/e2e-lifecycle-model-6002673f-kserve-8586579fc5-9dkzq"
Jul 02 17:43:58.670131 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:43:58.670009    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6-tmp-dir\") pod \"e2e-lifecycle-model-6002673f-kserve-8586579fc5-9dkzq\" (UID: \"e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6\") " pod="ai-tenant-e2e-mt-6002673f/e2e-lifecycle-model-6002673f-kserve-8586579fc5-9dkzq"
Jul 02 17:43:58.670131 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:43:58.670065    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6-tls-certs\") pod \"e2e-lifecycle-model-6002673f-kserve-8586579fc5-9dkzq\" (UID: \"e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6\") " pod="ai-tenant-e2e-mt-6002673f/e2e-lifecycle-model-6002673f-kserve-8586579fc5-9dkzq"
Jul 02 17:43:58.771248 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:43:58.771220    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6-model-cache\") pod \"e2e-lifecycle-model-6002673f-kserve-8586579fc5-9dkzq\" (UID: \"e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6\") " pod="ai-tenant-e2e-mt-6002673f/e2e-lifecycle-model-6002673f-kserve-8586579fc5-9dkzq"
Jul 02 17:43:58.771365 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:43:58.771252    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6-home\") pod \"e2e-lifecycle-model-6002673f-kserve-8586579fc5-9dkzq\" (UID: \"e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6\") " pod="ai-tenant-e2e-mt-6002673f/e2e-lifecycle-model-6002673f-kserve-8586579fc5-9dkzq"
Jul 02 17:43:58.771365 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:43:58.771297    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6-tmp-dir\") pod \"e2e-lifecycle-model-6002673f-kserve-8586579fc5-9dkzq\" (UID: \"e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6\") " pod="ai-tenant-e2e-mt-6002673f/e2e-lifecycle-model-6002673f-kserve-8586579fc5-9dkzq"
Jul 02 17:43:58.771365 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:43:58.771320    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6-tls-certs\") pod \"e2e-lifecycle-model-6002673f-kserve-8586579fc5-9dkzq\" (UID: \"e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6\") " pod="ai-tenant-e2e-mt-6002673f/e2e-lifecycle-model-6002673f-kserve-8586579fc5-9dkzq"
Jul 02 17:43:58.771498 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:43:58.771369    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6-dshm\") pod \"e2e-lifecycle-model-6002673f-kserve-8586579fc5-9dkzq\" (UID: \"e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6\") " pod="ai-tenant-e2e-mt-6002673f/e2e-lifecycle-model-6002673f-kserve-8586579fc5-9dkzq"
Jul 02 17:43:58.771498 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:43:58.771423    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ft7b5\" (UniqueName: \"kubernetes.io/projected/e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6-kube-api-access-ft7b5\") pod \"e2e-lifecycle-model-6002673f-kserve-8586579fc5-9dkzq\" (UID: \"e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6\") " pod="ai-tenant-e2e-mt-6002673f/e2e-lifecycle-model-6002673f-kserve-8586579fc5-9dkzq"
Jul 02 17:43:58.771652 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:43:58.771629    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6-model-cache\") pod \"e2e-lifecycle-model-6002673f-kserve-8586579fc5-9dkzq\" (UID: \"e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6\") " pod="ai-tenant-e2e-mt-6002673f/e2e-lifecycle-model-6002673f-kserve-8586579fc5-9dkzq"
Jul 02 17:43:58.771718 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:43:58.771677    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6-home\") pod \"e2e-lifecycle-model-6002673f-kserve-8586579fc5-9dkzq\" (UID: \"e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6\") " pod="ai-tenant-e2e-mt-6002673f/e2e-lifecycle-model-6002673f-kserve-8586579fc5-9dkzq"
Jul 02 17:43:58.771718 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:43:58.771714    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6-tmp-dir\") pod \"e2e-lifecycle-model-6002673f-kserve-8586579fc5-9dkzq\" (UID: \"e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6\") " pod="ai-tenant-e2e-mt-6002673f/e2e-lifecycle-model-6002673f-kserve-8586579fc5-9dkzq"
Jul 02 17:43:58.773530 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:43:58.773509    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6-dshm\") pod \"e2e-lifecycle-model-6002673f-kserve-8586579fc5-9dkzq\" (UID: \"e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6\") " pod="ai-tenant-e2e-mt-6002673f/e2e-lifecycle-model-6002673f-kserve-8586579fc5-9dkzq"
Jul 02 17:43:58.773948 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:43:58.773933    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6-tls-certs\") pod \"e2e-lifecycle-model-6002673f-kserve-8586579fc5-9dkzq\" (UID: \"e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6\") " pod="ai-tenant-e2e-mt-6002673f/e2e-lifecycle-model-6002673f-kserve-8586579fc5-9dkzq"
Jul 02 17:43:58.779585 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:43:58.779562    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ft7b5\" (UniqueName: \"kubernetes.io/projected/e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6-kube-api-access-ft7b5\") pod \"e2e-lifecycle-model-6002673f-kserve-8586579fc5-9dkzq\" (UID: \"e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6\") " pod="ai-tenant-e2e-mt-6002673f/e2e-lifecycle-model-6002673f-kserve-8586579fc5-9dkzq"
Jul 02 17:43:58.856132 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:43:58.856070    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-6002673f/e2e-lifecycle-model-6002673f-kserve-8586579fc5-9dkzq"
Jul 02 17:43:58.988009 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:43:58.987975    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-6002673f/e2e-lifecycle-model-6002673f-kserve-8586579fc5-9dkzq"]
Jul 02 17:43:58.990947 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:43:58.990920    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode877dcbb_aaa8_4ba2_a9d7_b603f1dac9c6.slice/crio-24f939897d1802d6c15d45d8f30ed6e1cf70c76c9b6631a6b1f0fc687ca70207 WatchSource:0}: Error finding container 24f939897d1802d6c15d45d8f30ed6e1cf70c76c9b6631a6b1f0fc687ca70207: Status 404 returned error can't find the container with id 24f939897d1802d6c15d45d8f30ed6e1cf70c76c9b6631a6b1f0fc687ca70207
Jul 02 17:43:59.451282 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:43:59.451246    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-6002673f/e2e-lifecycle-model-6002673f-kserve-8586579fc5-9dkzq" event={"ID":"e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6","Type":"ContainerStarted","Data":"baa9097179d5604e8db4654b25460c68427db32f207afabc28e738827c3c78c5"}
Jul 02 17:43:59.451443 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:43:59.451292    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-6002673f/e2e-lifecycle-model-6002673f-kserve-8586579fc5-9dkzq" event={"ID":"e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6","Type":"ContainerStarted","Data":"24f939897d1802d6c15d45d8f30ed6e1cf70c76c9b6631a6b1f0fc687ca70207"}
Jul 02 17:43:59.468149 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:43:59.468105    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-6002673f/e2e-lifecycle-model-6002673f-kserve-8586579fc5-9dkzq" podStartSLOduration=1.46809035 podStartE2EDuration="1.46809035s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:43:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:43:59.467092055 +0000 UTC m=+1994.656794719" watchObservedRunningTime="2026-07-02 17:43:59.46809035 +0000 UTC m=+1994.657793012"
Jul 02 17:44:02.836093 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:44:02.836058    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:44:07.003326 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:44:07.003294    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:44:07.104816 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:44:07.104785    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:44:08.857293 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:44:08.857251    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-6002673f/e2e-lifecycle-model-6002673f-kserve-8586579fc5-9dkzq"
Jul 02 17:44:08.857818 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:44:08.857310    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-6002673f/e2e-lifecycle-model-6002673f-kserve-8586579fc5-9dkzq"
Jul 02 17:44:08.869607 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:44:08.869576    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-6002673f/e2e-lifecycle-model-6002673f-kserve-8586579fc5-9dkzq"
Jul 02 17:44:09.510712 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:44:09.510680    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-6002673f/e2e-lifecycle-model-6002673f-kserve-8586579fc5-9dkzq"
Jul 02 17:44:19.447160 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:44:19.447128    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:44:22.042981 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:44:22.042926    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:44:22.359307 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:44:22.359230    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:44:28.082235 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:44:28.082182    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:44:30.884337 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:44:30.884290    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:44:33.060360 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:44:33.060313    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-6002673f/e2e-lifecycle-model-6002673f-kserve-8586579fc5-9dkzq"]
Jul 02 17:44:33.107698 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:44:33.107664    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:44:34.142283 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:44:34.142250    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:44:48.082106 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:44:48.082046    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-6002673f/e2e-lifecycle-model-6002673f-kserve-8586579fc5-9dkzq" podUID="e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6" containerName="main" containerID="cri-o://baa9097179d5604e8db4654b25460c68427db32f207afabc28e738827c3c78c5" gracePeriod=45
Jul 02 17:44:48.318522 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:44:48.318494    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-6002673f/e2e-lifecycle-model-6002673f-kserve-8586579fc5-9dkzq"
Jul 02 17:44:48.383302 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:44:48.383236    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6-model-cache\") pod \"e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6\" (UID: \"e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6\") "
Jul 02 17:44:48.383302 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:44:48.383297    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6-home\") pod \"e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6\" (UID: \"e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6\") "
Jul 02 17:44:48.383507 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:44:48.383337    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6-tls-certs\") pod \"e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6\" (UID: \"e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6\") "
Jul 02 17:44:48.383507 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:44:48.383361    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6-dshm\") pod \"e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6\" (UID: \"e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6\") "
Jul 02 17:44:48.383507 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:44:48.383401    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ft7b5\" (UniqueName: \"kubernetes.io/projected/e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6-kube-api-access-ft7b5\") pod \"e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6\" (UID: \"e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6\") "
Jul 02 17:44:48.383507 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:44:48.383451    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6-tmp-dir\") pod \"e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6\" (UID: \"e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6\") "
Jul 02 17:44:48.383717 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:44:48.383492    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6-model-cache" (OuterVolumeSpecName: "model-cache") pod "e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6" (UID: "e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:44:48.383717 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:44:48.383531    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6-home" (OuterVolumeSpecName: "home") pod "e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6" (UID: "e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:44:48.383816 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:44:48.383732    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6-model-cache\") on node \"ip-10-0-143-67.ec2.internal\" DevicePath \"\""
Jul 02 17:44:48.383816 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:44:48.383755    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6-home\") on node \"ip-10-0-143-67.ec2.internal\" DevicePath \"\""
Jul 02 17:44:48.383816 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:44:48.383732    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6" (UID: "e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:44:48.385497 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:44:48.385478    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6" (UID: "e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 17:44:48.385497 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:44:48.385480    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6-kube-api-access-ft7b5" (OuterVolumeSpecName: "kube-api-access-ft7b5") pod "e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6" (UID: "e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6"). InnerVolumeSpecName "kube-api-access-ft7b5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 17:44:48.385618 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:44:48.385544    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6-dshm" (OuterVolumeSpecName: "dshm") pod "e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6" (UID: "e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:44:48.484732 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:44:48.484708    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6-tls-certs\") on node \"ip-10-0-143-67.ec2.internal\" DevicePath \"\""
Jul 02 17:44:48.484732 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:44:48.484729    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6-dshm\") on node \"ip-10-0-143-67.ec2.internal\" DevicePath \"\""
Jul 02 17:44:48.484859 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:44:48.484738    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ft7b5\" (UniqueName: \"kubernetes.io/projected/e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6-kube-api-access-ft7b5\") on node \"ip-10-0-143-67.ec2.internal\" DevicePath \"\""
Jul 02 17:44:48.484859 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:44:48.484747    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6-tmp-dir\") on node \"ip-10-0-143-67.ec2.internal\" DevicePath \"\""
Jul 02 17:44:48.693146 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:44:48.693087    2578 generic.go:356] "Generic (PLEG): container finished" podID="e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6" containerID="baa9097179d5604e8db4654b25460c68427db32f207afabc28e738827c3c78c5" exitCode=0
Jul 02 17:44:48.693146 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:44:48.693119    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-6002673f/e2e-lifecycle-model-6002673f-kserve-8586579fc5-9dkzq" event={"ID":"e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6","Type":"ContainerDied","Data":"baa9097179d5604e8db4654b25460c68427db32f207afabc28e738827c3c78c5"}
Jul 02 17:44:48.693146 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:44:48.693123    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-6002673f/e2e-lifecycle-model-6002673f-kserve-8586579fc5-9dkzq"
Jul 02 17:44:48.693335 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:44:48.693145    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-6002673f/e2e-lifecycle-model-6002673f-kserve-8586579fc5-9dkzq" event={"ID":"e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6","Type":"ContainerDied","Data":"24f939897d1802d6c15d45d8f30ed6e1cf70c76c9b6631a6b1f0fc687ca70207"}
Jul 02 17:44:48.693335 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:44:48.693170    2578 scope.go:117] "RemoveContainer" containerID="baa9097179d5604e8db4654b25460c68427db32f207afabc28e738827c3c78c5"
Jul 02 17:44:48.702084 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:44:48.702068    2578 scope.go:117] "RemoveContainer" containerID="baa9097179d5604e8db4654b25460c68427db32f207afabc28e738827c3c78c5"
Jul 02 17:44:48.702321 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:44:48.702302    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"baa9097179d5604e8db4654b25460c68427db32f207afabc28e738827c3c78c5\": container with ID starting with baa9097179d5604e8db4654b25460c68427db32f207afabc28e738827c3c78c5 not found: ID does not exist" containerID="baa9097179d5604e8db4654b25460c68427db32f207afabc28e738827c3c78c5"
Jul 02 17:44:48.702389 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:44:48.702329    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"baa9097179d5604e8db4654b25460c68427db32f207afabc28e738827c3c78c5"} err="failed to get container status \"baa9097179d5604e8db4654b25460c68427db32f207afabc28e738827c3c78c5\": rpc error: code = NotFound desc = could not find container \"baa9097179d5604e8db4654b25460c68427db32f207afabc28e738827c3c78c5\": container with ID starting with baa9097179d5604e8db4654b25460c68427db32f207afabc28e738827c3c78c5 not found: ID does not exist"
Jul 02 17:44:48.713908 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:44:48.713871    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-6002673f/e2e-lifecycle-model-6002673f-kserve-8586579fc5-9dkzq"]
Jul 02 17:44:48.717892 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:44:48.717864    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-6002673f/e2e-lifecycle-model-6002673f-kserve-8586579fc5-9dkzq"]
Jul 02 17:44:49.495958 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:44:49.495923    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6" path="/var/lib/kubelet/pods/e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6/volumes"
Jul 02 17:45:09.372775 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:45:09.372695    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:45:10.211350 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:45:10.211301    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:45:12.643532 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:45:12.643499    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:45:15.638119 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:45:15.638068    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:45:15.697033 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:45:15.696991    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:45:15.921330 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:45:15.921252    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:45:16.140805 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:45:16.140772    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:45:17.224899 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:45:17.224861    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:45:17.320243 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:45:17.320204    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:45:17.419849 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:45:17.419820    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:45:18.152632 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:45:18.152583    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:45:18.239895 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:45:18.239861    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:45:18.343251 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:45:18.343214    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:45:19.720565 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:45:19.720530    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:45:25.425164 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:45:25.425124    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:45:25.493301 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:45:25.493270    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:45:26.096274 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:45:26.096236    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:45:31.790458 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:45:31.790421    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:45:31.897295 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:45:31.897262    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:45:31.990537 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:45:31.990506    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:45:41.600863 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:45:41.600825    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:45:42.498120 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:45:42.498078    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:45:42.842975 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:45:42.842897    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:45:45.459687 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:45:45.459657    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-62g9m_d6628590-1cf7-4a61-9350-539f3ae7ed91/ovn-acl-logging/0.log"
Jul 02 17:45:45.465295 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:45:45.465275    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-62g9m_d6628590-1cf7-4a61-9350-539f3ae7ed91/ovn-acl-logging/0.log"
Jul 02 17:46:03.785178 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:46:03.785140    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:46:09.543004 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:46:09.542964    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:46:09.643215 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:46:09.643174    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:46:09.892120 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:46:09.892000    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:46:10.180809 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:46:10.180701    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:46:10.401736 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:46:10.401697    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:46:12.727535 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:46:12.727483    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:46:12.802009 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:46:12.801967    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:46:12.865488 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:46:12.865449    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:46:13.031224 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:46:13.031127    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:46:13.354535 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:46:13.354448    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:46:13.455822 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:46:13.455785    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:46:17.283617 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:46:17.283583    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:46:17.591143 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:46:17.591011    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:46:17.890712 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:46:17.890602    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:46:18.139954 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:46:18.139915    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:46:20.042410 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:46:20.042372    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:46:20.780197 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:46:20.780166    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:46:20.844883 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:46:20.844849    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:46:20.925277 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:46:20.925240    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:46:21.360396 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:46:21.360363    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:46:21.506033 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:46:21.505981    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:46:21.605101 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:46:21.605068    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:46:25.267275 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:46:25.267241    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:46:31.245851 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:46:31.245813    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:46:34.081531 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:46:34.081450    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:46:34.182739 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:46:34.182673    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:46:37.844662 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:46:37.844576    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-1f15ad/test-model-1f15ad-kserve-9db7d4bf-bp6h9"]
Jul 02 17:46:37.845243 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:46:37.845226    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6" containerName="main"
Jul 02 17:46:37.845306 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:46:37.845247    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6" containerName="main"
Jul 02 17:46:37.845348 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:46:37.845340    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e877dcbb-aaa8-4ba2-a9d7-b603f1dac9c6" containerName="main"
Jul 02 17:46:37.848800 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:46:37.848779    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-1f15ad/test-model-1f15ad-kserve-9db7d4bf-bp6h9"
Jul 02 17:46:37.852817 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:46:37.852791    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-1f15ad\"/\"test-model-1f15ad-kserve-self-signed-certs\""
Jul 02 17:46:37.852955 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:46:37.852828    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-1f15ad\"/\"default-dockercfg-t8mnk\""
Jul 02 17:46:37.853005 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:46:37.852962    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-1f15ad\"/\"openshift-service-ca.crt\""
Jul 02 17:46:37.853292 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:46:37.853272    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-1f15ad\"/\"kube-root-ca.crt\""
Jul 02 17:46:37.855616 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:46:37.855593    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-1f15ad/test-model-1f15ad-kserve-9db7d4bf-bp6h9"]
Jul 02 17:46:37.867935 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:46:37.867903    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:46:37.946973 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:46:37.946939    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0c7ca6db-5199-4971-acdd-7f9d656ad4d0-tls-certs\") pod \"test-model-1f15ad-kserve-9db7d4bf-bp6h9\" (UID: \"0c7ca6db-5199-4971-acdd-7f9d656ad4d0\") " pod="ai-tenant-e2e-inf-a-1f15ad/test-model-1f15ad-kserve-9db7d4bf-bp6h9"
Jul 02 17:46:37.947168 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:46:37.947002    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xthc8\" (UniqueName: \"kubernetes.io/projected/0c7ca6db-5199-4971-acdd-7f9d656ad4d0-kube-api-access-xthc8\") pod \"test-model-1f15ad-kserve-9db7d4bf-bp6h9\" (UID: \"0c7ca6db-5199-4971-acdd-7f9d656ad4d0\") " pod="ai-tenant-e2e-inf-a-1f15ad/test-model-1f15ad-kserve-9db7d4bf-bp6h9"
Jul 02 17:46:37.947168 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:46:37.947118    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0c7ca6db-5199-4971-acdd-7f9d656ad4d0-dshm\") pod \"test-model-1f15ad-kserve-9db7d4bf-bp6h9\" (UID: \"0c7ca6db-5199-4971-acdd-7f9d656ad4d0\") " pod="ai-tenant-e2e-inf-a-1f15ad/test-model-1f15ad-kserve-9db7d4bf-bp6h9"
Jul 02 17:46:37.947168 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:46:37.947145    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0c7ca6db-5199-4971-acdd-7f9d656ad4d0-tmp-dir\") pod \"test-model-1f15ad-kserve-9db7d4bf-bp6h9\" (UID: \"0c7ca6db-5199-4971-acdd-7f9d656ad4d0\") " pod="ai-tenant-e2e-inf-a-1f15ad/test-model-1f15ad-kserve-9db7d4bf-bp6h9"
Jul 02 17:46:37.947281 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:46:37.947175    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0c7ca6db-5199-4971-acdd-7f9d656ad4d0-home\") pod \"test-model-1f15ad-kserve-9db7d4bf-bp6h9\" (UID: \"0c7ca6db-5199-4971-acdd-7f9d656ad4d0\") " pod="ai-tenant-e2e-inf-a-1f15ad/test-model-1f15ad-kserve-9db7d4bf-bp6h9"
Jul 02 17:46:37.947281 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:46:37.947233    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0c7ca6db-5199-4971-acdd-7f9d656ad4d0-model-cache\") pod \"test-model-1f15ad-kserve-9db7d4bf-bp6h9\" (UID: \"0c7ca6db-5199-4971-acdd-7f9d656ad4d0\") " pod="ai-tenant-e2e-inf-a-1f15ad/test-model-1f15ad-kserve-9db7d4bf-bp6h9"
Jul 02 17:46:38.047747 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:46:38.047697    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0c7ca6db-5199-4971-acdd-7f9d656ad4d0-tls-certs\") pod \"test-model-1f15ad-kserve-9db7d4bf-bp6h9\" (UID: \"0c7ca6db-5199-4971-acdd-7f9d656ad4d0\") " pod="ai-tenant-e2e-inf-a-1f15ad/test-model-1f15ad-kserve-9db7d4bf-bp6h9"
Jul 02 17:46:38.047958 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:46:38.047772    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xthc8\" (UniqueName: \"kubernetes.io/projected/0c7ca6db-5199-4971-acdd-7f9d656ad4d0-kube-api-access-xthc8\") pod \"test-model-1f15ad-kserve-9db7d4bf-bp6h9\" (UID: \"0c7ca6db-5199-4971-acdd-7f9d656ad4d0\") " pod="ai-tenant-e2e-inf-a-1f15ad/test-model-1f15ad-kserve-9db7d4bf-bp6h9"
Jul 02 17:46:38.047958 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:46:38.047825    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0c7ca6db-5199-4971-acdd-7f9d656ad4d0-dshm\") pod \"test-model-1f15ad-kserve-9db7d4bf-bp6h9\" (UID: \"0c7ca6db-5199-4971-acdd-7f9d656ad4d0\") " pod="ai-tenant-e2e-inf-a-1f15ad/test-model-1f15ad-kserve-9db7d4bf-bp6h9"
Jul 02 17:46:38.047958 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:46:38.047849    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0c7ca6db-5199-4971-acdd-7f9d656ad4d0-tmp-dir\") pod \"test-model-1f15ad-kserve-9db7d4bf-bp6h9\" (UID: \"0c7ca6db-5199-4971-acdd-7f9d656ad4d0\") " pod="ai-tenant-e2e-inf-a-1f15ad/test-model-1f15ad-kserve-9db7d4bf-bp6h9"
Jul 02 17:46:38.047958 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:46:38.047885    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0c7ca6db-5199-4971-acdd-7f9d656ad4d0-home\") pod \"test-model-1f15ad-kserve-9db7d4bf-bp6h9\" (UID: \"0c7ca6db-5199-4971-acdd-7f9d656ad4d0\") " pod="ai-tenant-e2e-inf-a-1f15ad/test-model-1f15ad-kserve-9db7d4bf-bp6h9"
Jul 02 17:46:38.047958 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:46:38.047913    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0c7ca6db-5199-4971-acdd-7f9d656ad4d0-model-cache\") pod \"test-model-1f15ad-kserve-9db7d4bf-bp6h9\" (UID: \"0c7ca6db-5199-4971-acdd-7f9d656ad4d0\") " pod="ai-tenant-e2e-inf-a-1f15ad/test-model-1f15ad-kserve-9db7d4bf-bp6h9"
Jul 02 17:46:38.048333 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:46:38.048312    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0c7ca6db-5199-4971-acdd-7f9d656ad4d0-tmp-dir\") pod \"test-model-1f15ad-kserve-9db7d4bf-bp6h9\" (UID: \"0c7ca6db-5199-4971-acdd-7f9d656ad4d0\") " pod="ai-tenant-e2e-inf-a-1f15ad/test-model-1f15ad-kserve-9db7d4bf-bp6h9"
Jul 02 17:46:38.048422 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:46:38.048331    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0c7ca6db-5199-4971-acdd-7f9d656ad4d0-home\") pod \"test-model-1f15ad-kserve-9db7d4bf-bp6h9\" (UID: \"0c7ca6db-5199-4971-acdd-7f9d656ad4d0\") " pod="ai-tenant-e2e-inf-a-1f15ad/test-model-1f15ad-kserve-9db7d4bf-bp6h9"
Jul 02 17:46:38.048487 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:46:38.048435    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0c7ca6db-5199-4971-acdd-7f9d656ad4d0-model-cache\") pod \"test-model-1f15ad-kserve-9db7d4bf-bp6h9\" (UID: \"0c7ca6db-5199-4971-acdd-7f9d656ad4d0\") " pod="ai-tenant-e2e-inf-a-1f15ad/test-model-1f15ad-kserve-9db7d4bf-bp6h9"
Jul 02 17:46:38.050237 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:46:38.050216    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0c7ca6db-5199-4971-acdd-7f9d656ad4d0-dshm\") pod \"test-model-1f15ad-kserve-9db7d4bf-bp6h9\" (UID: \"0c7ca6db-5199-4971-acdd-7f9d656ad4d0\") " pod="ai-tenant-e2e-inf-a-1f15ad/test-model-1f15ad-kserve-9db7d4bf-bp6h9"
Jul 02 17:46:38.050526 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:46:38.050507    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0c7ca6db-5199-4971-acdd-7f9d656ad4d0-tls-certs\") pod \"test-model-1f15ad-kserve-9db7d4bf-bp6h9\" (UID: \"0c7ca6db-5199-4971-acdd-7f9d656ad4d0\") " pod="ai-tenant-e2e-inf-a-1f15ad/test-model-1f15ad-kserve-9db7d4bf-bp6h9"
Jul 02 17:46:38.057405 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:46:38.057386    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xthc8\" (UniqueName: \"kubernetes.io/projected/0c7ca6db-5199-4971-acdd-7f9d656ad4d0-kube-api-access-xthc8\") pod \"test-model-1f15ad-kserve-9db7d4bf-bp6h9\" (UID: \"0c7ca6db-5199-4971-acdd-7f9d656ad4d0\") " pod="ai-tenant-e2e-inf-a-1f15ad/test-model-1f15ad-kserve-9db7d4bf-bp6h9"
Jul 02 17:46:38.159807 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:46:38.159708    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-1f15ad/test-model-1f15ad-kserve-9db7d4bf-bp6h9"
Jul 02 17:46:38.299611 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:46:38.299575    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-1f15ad/test-model-1f15ad-kserve-9db7d4bf-bp6h9"]
Jul 02 17:46:38.302923 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:46:38.302895    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0c7ca6db_5199_4971_acdd_7f9d656ad4d0.slice/crio-ea117c81ccfc4e8f3b91611b935dc3405a0f97d21fb8ed5b9f640c065189cc5a WatchSource:0}: Error finding container ea117c81ccfc4e8f3b91611b935dc3405a0f97d21fb8ed5b9f640c065189cc5a: Status 404 returned error can't find the container with id ea117c81ccfc4e8f3b91611b935dc3405a0f97d21fb8ed5b9f640c065189cc5a
Jul 02 17:46:39.229824 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:46:39.229788    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-1f15ad/test-model-1f15ad-kserve-9db7d4bf-bp6h9" event={"ID":"0c7ca6db-5199-4971-acdd-7f9d656ad4d0","Type":"ContainerStarted","Data":"85b82e673aa9af809f7b6d6d0c8eec4bc278f672c15971b75e116a5abc221552"}
Jul 02 17:46:39.230256 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:46:39.229835    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-1f15ad/test-model-1f15ad-kserve-9db7d4bf-bp6h9" event={"ID":"0c7ca6db-5199-4971-acdd-7f9d656ad4d0","Type":"ContainerStarted","Data":"ea117c81ccfc4e8f3b91611b935dc3405a0f97d21fb8ed5b9f640c065189cc5a"}
Jul 02 17:46:39.248106 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:46:39.248059    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-1f15ad/test-model-1f15ad-kserve-9db7d4bf-bp6h9" podStartSLOduration=2.248044222 podStartE2EDuration="2.248044222s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:46:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:46:39.245547039 +0000 UTC m=+2154.435249702" watchObservedRunningTime="2026-07-02 17:46:39.248044222 +0000 UTC m=+2154.437746884"
Jul 02 17:46:41.042359 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:46:41.042323    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:46:43.352573 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:46:43.352538    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:46:43.471123 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:46:43.471085    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:46:48.160156 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:46:48.160116    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-1f15ad/test-model-1f15ad-kserve-9db7d4bf-bp6h9"
Jul 02 17:46:48.160648 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:46:48.160179    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-1f15ad/test-model-1f15ad-kserve-9db7d4bf-bp6h9"
Jul 02 17:46:48.173274 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:46:48.173240    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-1f15ad/test-model-1f15ad-kserve-9db7d4bf-bp6h9"
Jul 02 17:46:48.281448 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:46:48.281411    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-1f15ad/test-model-1f15ad-kserve-9db7d4bf-bp6h9"
Jul 02 17:46:53.139512 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:46:53.139475    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:47:43.048810 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:47:43.048769    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-1fad4f/test-model-1fad4f-kserve-5bcb4846df-9m2tf"]
Jul 02 17:47:43.052338 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:47:43.052318    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-1fad4f/test-model-1fad4f-kserve-5bcb4846df-9m2tf"
Jul 02 17:47:43.056162 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:47:43.056131    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-1fad4f\"/\"openshift-service-ca.crt\""
Jul 02 17:47:43.056344 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:47:43.056163    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-1fad4f\"/\"kube-root-ca.crt\""
Jul 02 17:47:43.056344 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:47:43.056197    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-1fad4f\"/\"test-model-1fad4f-kserve-self-signed-certs\""
Jul 02 17:47:43.056344 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:47:43.056283    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-1fad4f\"/\"default-dockercfg-xlgln\""
Jul 02 17:47:43.062194 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:47:43.062171    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-1fad4f/test-model-1fad4f-kserve-5bcb4846df-9m2tf"]
Jul 02 17:47:43.074382 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:47:43.074355    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:47:43.221429 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:47:43.221392    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czsrt\" (UniqueName: \"kubernetes.io/projected/751e740b-f0d4-4265-836e-d754460a9f83-kube-api-access-czsrt\") pod \"test-model-1fad4f-kserve-5bcb4846df-9m2tf\" (UID: \"751e740b-f0d4-4265-836e-d754460a9f83\") " pod="ai-tenant-e2e-inf-b-1fad4f/test-model-1fad4f-kserve-5bcb4846df-9m2tf"
Jul 02 17:47:43.221429 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:47:43.221444    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/751e740b-f0d4-4265-836e-d754460a9f83-home\") pod \"test-model-1fad4f-kserve-5bcb4846df-9m2tf\" (UID: \"751e740b-f0d4-4265-836e-d754460a9f83\") " pod="ai-tenant-e2e-inf-b-1fad4f/test-model-1fad4f-kserve-5bcb4846df-9m2tf"
Jul 02 17:47:43.221689 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:47:43.221486    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/751e740b-f0d4-4265-836e-d754460a9f83-tls-certs\") pod \"test-model-1fad4f-kserve-5bcb4846df-9m2tf\" (UID: \"751e740b-f0d4-4265-836e-d754460a9f83\") " pod="ai-tenant-e2e-inf-b-1fad4f/test-model-1fad4f-kserve-5bcb4846df-9m2tf"
Jul 02 17:47:43.221689 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:47:43.221512    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/751e740b-f0d4-4265-836e-d754460a9f83-model-cache\") pod \"test-model-1fad4f-kserve-5bcb4846df-9m2tf\" (UID: \"751e740b-f0d4-4265-836e-d754460a9f83\") " pod="ai-tenant-e2e-inf-b-1fad4f/test-model-1fad4f-kserve-5bcb4846df-9m2tf"
Jul 02 17:47:43.221689 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:47:43.221590    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/751e740b-f0d4-4265-836e-d754460a9f83-dshm\") pod \"test-model-1fad4f-kserve-5bcb4846df-9m2tf\" (UID: \"751e740b-f0d4-4265-836e-d754460a9f83\") " pod="ai-tenant-e2e-inf-b-1fad4f/test-model-1fad4f-kserve-5bcb4846df-9m2tf"
Jul 02 17:47:43.221689 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:47:43.221606    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/751e740b-f0d4-4265-836e-d754460a9f83-tmp-dir\") pod \"test-model-1fad4f-kserve-5bcb4846df-9m2tf\" (UID: \"751e740b-f0d4-4265-836e-d754460a9f83\") " pod="ai-tenant-e2e-inf-b-1fad4f/test-model-1fad4f-kserve-5bcb4846df-9m2tf"
Jul 02 17:47:43.323174 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:47:43.323082    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/751e740b-f0d4-4265-836e-d754460a9f83-dshm\") pod \"test-model-1fad4f-kserve-5bcb4846df-9m2tf\" (UID: \"751e740b-f0d4-4265-836e-d754460a9f83\") " pod="ai-tenant-e2e-inf-b-1fad4f/test-model-1fad4f-kserve-5bcb4846df-9m2tf"
Jul 02 17:47:43.323174 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:47:43.323121    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/751e740b-f0d4-4265-836e-d754460a9f83-tmp-dir\") pod \"test-model-1fad4f-kserve-5bcb4846df-9m2tf\" (UID: \"751e740b-f0d4-4265-836e-d754460a9f83\") " pod="ai-tenant-e2e-inf-b-1fad4f/test-model-1fad4f-kserve-5bcb4846df-9m2tf"
Jul 02 17:47:43.323400 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:47:43.323247    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czsrt\" (UniqueName: \"kubernetes.io/projected/751e740b-f0d4-4265-836e-d754460a9f83-kube-api-access-czsrt\") pod \"test-model-1fad4f-kserve-5bcb4846df-9m2tf\" (UID: \"751e740b-f0d4-4265-836e-d754460a9f83\") " pod="ai-tenant-e2e-inf-b-1fad4f/test-model-1fad4f-kserve-5bcb4846df-9m2tf"
Jul 02 17:47:43.323400 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:47:43.323319    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/751e740b-f0d4-4265-836e-d754460a9f83-home\") pod \"test-model-1fad4f-kserve-5bcb4846df-9m2tf\" (UID: \"751e740b-f0d4-4265-836e-d754460a9f83\") " pod="ai-tenant-e2e-inf-b-1fad4f/test-model-1fad4f-kserve-5bcb4846df-9m2tf"
Jul 02 17:47:43.323400 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:47:43.323351    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/751e740b-f0d4-4265-836e-d754460a9f83-tls-certs\") pod \"test-model-1fad4f-kserve-5bcb4846df-9m2tf\" (UID: \"751e740b-f0d4-4265-836e-d754460a9f83\") " pod="ai-tenant-e2e-inf-b-1fad4f/test-model-1fad4f-kserve-5bcb4846df-9m2tf"
Jul 02 17:47:43.323400 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:47:43.323398    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/751e740b-f0d4-4265-836e-d754460a9f83-model-cache\") pod \"test-model-1fad4f-kserve-5bcb4846df-9m2tf\" (UID: \"751e740b-f0d4-4265-836e-d754460a9f83\") " pod="ai-tenant-e2e-inf-b-1fad4f/test-model-1fad4f-kserve-5bcb4846df-9m2tf"
Jul 02 17:47:43.323604 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:47:43.323489    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/751e740b-f0d4-4265-836e-d754460a9f83-tmp-dir\") pod \"test-model-1fad4f-kserve-5bcb4846df-9m2tf\" (UID: \"751e740b-f0d4-4265-836e-d754460a9f83\") " pod="ai-tenant-e2e-inf-b-1fad4f/test-model-1fad4f-kserve-5bcb4846df-9m2tf"
Jul 02 17:47:43.323604 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:47:43.323581    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/751e740b-f0d4-4265-836e-d754460a9f83-home\") pod \"test-model-1fad4f-kserve-5bcb4846df-9m2tf\" (UID: \"751e740b-f0d4-4265-836e-d754460a9f83\") " pod="ai-tenant-e2e-inf-b-1fad4f/test-model-1fad4f-kserve-5bcb4846df-9m2tf"
Jul 02 17:47:43.323737 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:47:43.323720    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/751e740b-f0d4-4265-836e-d754460a9f83-model-cache\") pod \"test-model-1fad4f-kserve-5bcb4846df-9m2tf\" (UID: \"751e740b-f0d4-4265-836e-d754460a9f83\") " pod="ai-tenant-e2e-inf-b-1fad4f/test-model-1fad4f-kserve-5bcb4846df-9m2tf"
Jul 02 17:47:43.325464 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:47:43.325440    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/751e740b-f0d4-4265-836e-d754460a9f83-dshm\") pod \"test-model-1fad4f-kserve-5bcb4846df-9m2tf\" (UID: \"751e740b-f0d4-4265-836e-d754460a9f83\") " pod="ai-tenant-e2e-inf-b-1fad4f/test-model-1fad4f-kserve-5bcb4846df-9m2tf"
Jul 02 17:47:43.325756 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:47:43.325738    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/751e740b-f0d4-4265-836e-d754460a9f83-tls-certs\") pod \"test-model-1fad4f-kserve-5bcb4846df-9m2tf\" (UID: \"751e740b-f0d4-4265-836e-d754460a9f83\") " pod="ai-tenant-e2e-inf-b-1fad4f/test-model-1fad4f-kserve-5bcb4846df-9m2tf"
Jul 02 17:47:43.331378 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:47:43.331360    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-czsrt\" (UniqueName: \"kubernetes.io/projected/751e740b-f0d4-4265-836e-d754460a9f83-kube-api-access-czsrt\") pod \"test-model-1fad4f-kserve-5bcb4846df-9m2tf\" (UID: \"751e740b-f0d4-4265-836e-d754460a9f83\") " pod="ai-tenant-e2e-inf-b-1fad4f/test-model-1fad4f-kserve-5bcb4846df-9m2tf"
Jul 02 17:47:43.362384 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:47:43.362348    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-1fad4f/test-model-1fad4f-kserve-5bcb4846df-9m2tf"
Jul 02 17:47:43.501355 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:47:43.501314    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-1fad4f/test-model-1fad4f-kserve-5bcb4846df-9m2tf"]
Jul 02 17:47:43.503959 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:47:43.503924    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod751e740b_f0d4_4265_836e_d754460a9f83.slice/crio-a760be88aa41e2296755b6f50f71f7c5d84cf708e6c2b9663b6609386d5715ac WatchSource:0}: Error finding container a760be88aa41e2296755b6f50f71f7c5d84cf708e6c2b9663b6609386d5715ac: Status 404 returned error can't find the container with id a760be88aa41e2296755b6f50f71f7c5d84cf708e6c2b9663b6609386d5715ac
Jul 02 17:47:43.535722 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:47:43.535695    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-1fad4f/test-model-1fad4f-kserve-5bcb4846df-9m2tf" event={"ID":"751e740b-f0d4-4265-836e-d754460a9f83","Type":"ContainerStarted","Data":"a760be88aa41e2296755b6f50f71f7c5d84cf708e6c2b9663b6609386d5715ac"}
Jul 02 17:47:44.541493 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:47:44.541452    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-1fad4f/test-model-1fad4f-kserve-5bcb4846df-9m2tf" event={"ID":"751e740b-f0d4-4265-836e-d754460a9f83","Type":"ContainerStarted","Data":"b633ae4cd2d7e3a297c8a878afa41a5071a1a48b233401197042f963bd68faec"}
Jul 02 17:47:44.557786 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:47:44.557736    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-1fad4f/test-model-1fad4f-kserve-5bcb4846df-9m2tf" podStartSLOduration=1.5577182010000001 podStartE2EDuration="1.557718201s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:47:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:47:44.557269742 +0000 UTC m=+2219.746972404" watchObservedRunningTime="2026-07-02 17:47:44.557718201 +0000 UTC m=+2219.747420865"
Jul 02 17:47:47.648207 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:47:47.648165    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:47:53.362472 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:47:53.362434    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-1fad4f/test-model-1fad4f-kserve-5bcb4846df-9m2tf"
Jul 02 17:47:53.362872 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:47:53.362560    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-1fad4f/test-model-1fad4f-kserve-5bcb4846df-9m2tf"
Jul 02 17:47:53.375285 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:47:53.375258    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-1fad4f/test-model-1fad4f-kserve-5bcb4846df-9m2tf"
Jul 02 17:47:53.597313 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:47:53.597280    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-1fad4f/test-model-1fad4f-kserve-5bcb4846df-9m2tf"
Jul 02 17:47:59.156943 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:47:59.156904    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:47:59.256783 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:47:59.256748    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:48:04.782212 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:04.781145    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-1f15ad/test-model-1f15ad-kserve-9db7d4bf-bp6h9"]
Jul 02 17:48:04.803650 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:04.803617    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:48:05.767145 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:05.767107    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-1fad4f/test-model-1fad4f-kserve-5bcb4846df-9m2tf"]
Jul 02 17:48:05.780476 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:05.780441    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:48:05.933421 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:05.933380    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:48:06.363068 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:06.363011    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:48:06.478860 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:06.478774    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:48:06.579434 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:06.579401    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:48:06.732995 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:06.732962    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:48:09.545998 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:09.545963    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:48:11.387745 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:11.387707    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:48:15.748416 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:15.748384    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:48:19.804581 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:19.804520    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-1f15ad/test-model-1f15ad-kserve-9db7d4bf-bp6h9" podUID="0c7ca6db-5199-4971-acdd-7f9d656ad4d0" containerName="main" containerID="cri-o://85b82e673aa9af809f7b6d6d0c8eec4bc278f672c15971b75e116a5abc221552" gracePeriod=45
Jul 02 17:48:20.059189 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:20.059132    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-1f15ad/test-model-1f15ad-kserve-9db7d4bf-bp6h9"
Jul 02 17:48:20.162874 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:20.162846    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xthc8\" (UniqueName: \"kubernetes.io/projected/0c7ca6db-5199-4971-acdd-7f9d656ad4d0-kube-api-access-xthc8\") pod \"0c7ca6db-5199-4971-acdd-7f9d656ad4d0\" (UID: \"0c7ca6db-5199-4971-acdd-7f9d656ad4d0\") "
Jul 02 17:48:20.163088 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:20.162892    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0c7ca6db-5199-4971-acdd-7f9d656ad4d0-home\") pod \"0c7ca6db-5199-4971-acdd-7f9d656ad4d0\" (UID: \"0c7ca6db-5199-4971-acdd-7f9d656ad4d0\") "
Jul 02 17:48:20.163088 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:20.162911    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0c7ca6db-5199-4971-acdd-7f9d656ad4d0-tls-certs\") pod \"0c7ca6db-5199-4971-acdd-7f9d656ad4d0\" (UID: \"0c7ca6db-5199-4971-acdd-7f9d656ad4d0\") "
Jul 02 17:48:20.163088 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:20.163064    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0c7ca6db-5199-4971-acdd-7f9d656ad4d0-tmp-dir\") pod \"0c7ca6db-5199-4971-acdd-7f9d656ad4d0\" (UID: \"0c7ca6db-5199-4971-acdd-7f9d656ad4d0\") "
Jul 02 17:48:20.163270 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:20.163117    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0c7ca6db-5199-4971-acdd-7f9d656ad4d0-dshm\") pod \"0c7ca6db-5199-4971-acdd-7f9d656ad4d0\" (UID: \"0c7ca6db-5199-4971-acdd-7f9d656ad4d0\") "
Jul 02 17:48:20.163270 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:20.163173    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0c7ca6db-5199-4971-acdd-7f9d656ad4d0-model-cache\") pod \"0c7ca6db-5199-4971-acdd-7f9d656ad4d0\" (UID: \"0c7ca6db-5199-4971-acdd-7f9d656ad4d0\") "
Jul 02 17:48:20.163270 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:20.163211    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c7ca6db-5199-4971-acdd-7f9d656ad4d0-home" (OuterVolumeSpecName: "home") pod "0c7ca6db-5199-4971-acdd-7f9d656ad4d0" (UID: "0c7ca6db-5199-4971-acdd-7f9d656ad4d0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:48:20.163387 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:20.163334    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c7ca6db-5199-4971-acdd-7f9d656ad4d0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0c7ca6db-5199-4971-acdd-7f9d656ad4d0" (UID: "0c7ca6db-5199-4971-acdd-7f9d656ad4d0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:48:20.163522 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:20.163493    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c7ca6db-5199-4971-acdd-7f9d656ad4d0-model-cache" (OuterVolumeSpecName: "model-cache") pod "0c7ca6db-5199-4971-acdd-7f9d656ad4d0" (UID: "0c7ca6db-5199-4971-acdd-7f9d656ad4d0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:48:20.163621 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:20.163563    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0c7ca6db-5199-4971-acdd-7f9d656ad4d0-home\") on node \"ip-10-0-143-67.ec2.internal\" DevicePath \"\""
Jul 02 17:48:20.163621 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:20.163578    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0c7ca6db-5199-4971-acdd-7f9d656ad4d0-tmp-dir\") on node \"ip-10-0-143-67.ec2.internal\" DevicePath \"\""
Jul 02 17:48:20.165271 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:20.165240    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c7ca6db-5199-4971-acdd-7f9d656ad4d0-kube-api-access-xthc8" (OuterVolumeSpecName: "kube-api-access-xthc8") pod "0c7ca6db-5199-4971-acdd-7f9d656ad4d0" (UID: "0c7ca6db-5199-4971-acdd-7f9d656ad4d0"). InnerVolumeSpecName "kube-api-access-xthc8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 17:48:20.165271 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:20.165249    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c7ca6db-5199-4971-acdd-7f9d656ad4d0-dshm" (OuterVolumeSpecName: "dshm") pod "0c7ca6db-5199-4971-acdd-7f9d656ad4d0" (UID: "0c7ca6db-5199-4971-acdd-7f9d656ad4d0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:48:20.165405 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:20.165318    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c7ca6db-5199-4971-acdd-7f9d656ad4d0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0c7ca6db-5199-4971-acdd-7f9d656ad4d0" (UID: "0c7ca6db-5199-4971-acdd-7f9d656ad4d0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 17:48:20.264308 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:20.264280    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0c7ca6db-5199-4971-acdd-7f9d656ad4d0-model-cache\") on node \"ip-10-0-143-67.ec2.internal\" DevicePath \"\""
Jul 02 17:48:20.264308 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:20.264304    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xthc8\" (UniqueName: \"kubernetes.io/projected/0c7ca6db-5199-4971-acdd-7f9d656ad4d0-kube-api-access-xthc8\") on node \"ip-10-0-143-67.ec2.internal\" DevicePath \"\""
Jul 02 17:48:20.264308 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:20.264312    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0c7ca6db-5199-4971-acdd-7f9d656ad4d0-tls-certs\") on node \"ip-10-0-143-67.ec2.internal\" DevicePath \"\""
Jul 02 17:48:20.264540 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:20.264321    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0c7ca6db-5199-4971-acdd-7f9d656ad4d0-dshm\") on node \"ip-10-0-143-67.ec2.internal\" DevicePath \"\""
Jul 02 17:48:20.715356 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:20.715320    2578 generic.go:356] "Generic (PLEG): container finished" podID="0c7ca6db-5199-4971-acdd-7f9d656ad4d0" containerID="85b82e673aa9af809f7b6d6d0c8eec4bc278f672c15971b75e116a5abc221552" exitCode=0
Jul 02 17:48:20.715537 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:20.715369    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-1f15ad/test-model-1f15ad-kserve-9db7d4bf-bp6h9"
Jul 02 17:48:20.715537 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:20.715401    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-1f15ad/test-model-1f15ad-kserve-9db7d4bf-bp6h9" event={"ID":"0c7ca6db-5199-4971-acdd-7f9d656ad4d0","Type":"ContainerDied","Data":"85b82e673aa9af809f7b6d6d0c8eec4bc278f672c15971b75e116a5abc221552"}
Jul 02 17:48:20.715537 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:20.715446    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-1f15ad/test-model-1f15ad-kserve-9db7d4bf-bp6h9" event={"ID":"0c7ca6db-5199-4971-acdd-7f9d656ad4d0","Type":"ContainerDied","Data":"ea117c81ccfc4e8f3b91611b935dc3405a0f97d21fb8ed5b9f640c065189cc5a"}
Jul 02 17:48:20.715537 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:20.715463    2578 scope.go:117] "RemoveContainer" containerID="85b82e673aa9af809f7b6d6d0c8eec4bc278f672c15971b75e116a5abc221552"
Jul 02 17:48:20.724564 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:20.724533    2578 scope.go:117] "RemoveContainer" containerID="85b82e673aa9af809f7b6d6d0c8eec4bc278f672c15971b75e116a5abc221552"
Jul 02 17:48:20.724836 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:48:20.724817    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85b82e673aa9af809f7b6d6d0c8eec4bc278f672c15971b75e116a5abc221552\": container with ID starting with 85b82e673aa9af809f7b6d6d0c8eec4bc278f672c15971b75e116a5abc221552 not found: ID does not exist" containerID="85b82e673aa9af809f7b6d6d0c8eec4bc278f672c15971b75e116a5abc221552"
Jul 02 17:48:20.724892 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:20.724843    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85b82e673aa9af809f7b6d6d0c8eec4bc278f672c15971b75e116a5abc221552"} err="failed to get container status \"85b82e673aa9af809f7b6d6d0c8eec4bc278f672c15971b75e116a5abc221552\": rpc error: code = NotFound desc = could not find container \"85b82e673aa9af809f7b6d6d0c8eec4bc278f672c15971b75e116a5abc221552\": container with ID starting with 85b82e673aa9af809f7b6d6d0c8eec4bc278f672c15971b75e116a5abc221552 not found: ID does not exist"
Jul 02 17:48:20.736055 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:20.736026    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-1f15ad/test-model-1f15ad-kserve-9db7d4bf-bp6h9"]
Jul 02 17:48:20.739587 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:20.739568    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-1f15ad/test-model-1f15ad-kserve-9db7d4bf-bp6h9"]
Jul 02 17:48:20.788134 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:20.788090    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-1fad4f/test-model-1fad4f-kserve-5bcb4846df-9m2tf" podUID="751e740b-f0d4-4265-836e-d754460a9f83" containerName="main" containerID="cri-o://b633ae4cd2d7e3a297c8a878afa41a5071a1a48b233401197042f963bd68faec" gracePeriod=45
Jul 02 17:48:21.036618 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:21.036597    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-1fad4f/test-model-1fad4f-kserve-5bcb4846df-9m2tf"
Jul 02 17:48:21.173672 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:21.173639    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/751e740b-f0d4-4265-836e-d754460a9f83-tls-certs\") pod \"751e740b-f0d4-4265-836e-d754460a9f83\" (UID: \"751e740b-f0d4-4265-836e-d754460a9f83\") "
Jul 02 17:48:21.173672 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:21.173674    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/751e740b-f0d4-4265-836e-d754460a9f83-tmp-dir\") pod \"751e740b-f0d4-4265-836e-d754460a9f83\" (UID: \"751e740b-f0d4-4265-836e-d754460a9f83\") "
Jul 02 17:48:21.173919 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:21.173697    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-czsrt\" (UniqueName: \"kubernetes.io/projected/751e740b-f0d4-4265-836e-d754460a9f83-kube-api-access-czsrt\") pod \"751e740b-f0d4-4265-836e-d754460a9f83\" (UID: \"751e740b-f0d4-4265-836e-d754460a9f83\") "
Jul 02 17:48:21.173919 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:21.173727    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/751e740b-f0d4-4265-836e-d754460a9f83-home\") pod \"751e740b-f0d4-4265-836e-d754460a9f83\" (UID: \"751e740b-f0d4-4265-836e-d754460a9f83\") "
Jul 02 17:48:21.173919 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:21.173787    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/751e740b-f0d4-4265-836e-d754460a9f83-model-cache\") pod \"751e740b-f0d4-4265-836e-d754460a9f83\" (UID: \"751e740b-f0d4-4265-836e-d754460a9f83\") "
Jul 02 17:48:21.173919 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:21.173821    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/751e740b-f0d4-4265-836e-d754460a9f83-dshm\") pod \"751e740b-f0d4-4265-836e-d754460a9f83\" (UID: \"751e740b-f0d4-4265-836e-d754460a9f83\") "
Jul 02 17:48:21.174134 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:21.173943    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/751e740b-f0d4-4265-836e-d754460a9f83-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "751e740b-f0d4-4265-836e-d754460a9f83" (UID: "751e740b-f0d4-4265-836e-d754460a9f83"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:48:21.174134 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:21.174008    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/751e740b-f0d4-4265-836e-d754460a9f83-home" (OuterVolumeSpecName: "home") pod "751e740b-f0d4-4265-836e-d754460a9f83" (UID: "751e740b-f0d4-4265-836e-d754460a9f83"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:48:21.174134 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:21.174058    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/751e740b-f0d4-4265-836e-d754460a9f83-model-cache" (OuterVolumeSpecName: "model-cache") pod "751e740b-f0d4-4265-836e-d754460a9f83" (UID: "751e740b-f0d4-4265-836e-d754460a9f83"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:48:21.174245 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:21.174235    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/751e740b-f0d4-4265-836e-d754460a9f83-home\") on node \"ip-10-0-143-67.ec2.internal\" DevicePath \"\""
Jul 02 17:48:21.174279 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:21.174252    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/751e740b-f0d4-4265-836e-d754460a9f83-model-cache\") on node \"ip-10-0-143-67.ec2.internal\" DevicePath \"\""
Jul 02 17:48:21.174279 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:21.174263    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/751e740b-f0d4-4265-836e-d754460a9f83-tmp-dir\") on node \"ip-10-0-143-67.ec2.internal\" DevicePath \"\""
Jul 02 17:48:21.175947 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:21.175926    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/751e740b-f0d4-4265-836e-d754460a9f83-dshm" (OuterVolumeSpecName: "dshm") pod "751e740b-f0d4-4265-836e-d754460a9f83" (UID: "751e740b-f0d4-4265-836e-d754460a9f83"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:48:21.176335 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:21.176309    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/751e740b-f0d4-4265-836e-d754460a9f83-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "751e740b-f0d4-4265-836e-d754460a9f83" (UID: "751e740b-f0d4-4265-836e-d754460a9f83"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 17:48:21.176335 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:21.176315    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/751e740b-f0d4-4265-836e-d754460a9f83-kube-api-access-czsrt" (OuterVolumeSpecName: "kube-api-access-czsrt") pod "751e740b-f0d4-4265-836e-d754460a9f83" (UID: "751e740b-f0d4-4265-836e-d754460a9f83"). InnerVolumeSpecName "kube-api-access-czsrt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 17:48:21.275468 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:21.275401    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/751e740b-f0d4-4265-836e-d754460a9f83-tls-certs\") on node \"ip-10-0-143-67.ec2.internal\" DevicePath \"\""
Jul 02 17:48:21.275468 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:21.275424    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-czsrt\" (UniqueName: \"kubernetes.io/projected/751e740b-f0d4-4265-836e-d754460a9f83-kube-api-access-czsrt\") on node \"ip-10-0-143-67.ec2.internal\" DevicePath \"\""
Jul 02 17:48:21.275468 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:21.275433    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/751e740b-f0d4-4265-836e-d754460a9f83-dshm\") on node \"ip-10-0-143-67.ec2.internal\" DevicePath \"\""
Jul 02 17:48:21.496499 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:21.496464    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c7ca6db-5199-4971-acdd-7f9d656ad4d0" path="/var/lib/kubelet/pods/0c7ca6db-5199-4971-acdd-7f9d656ad4d0/volumes"
Jul 02 17:48:21.721395 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:21.721369    2578 generic.go:356] "Generic (PLEG): container finished" podID="751e740b-f0d4-4265-836e-d754460a9f83" containerID="b633ae4cd2d7e3a297c8a878afa41a5071a1a48b233401197042f963bd68faec" exitCode=0
Jul 02 17:48:21.721549 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:21.721411    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-1fad4f/test-model-1fad4f-kserve-5bcb4846df-9m2tf"
Jul 02 17:48:21.721549 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:21.721461    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-1fad4f/test-model-1fad4f-kserve-5bcb4846df-9m2tf" event={"ID":"751e740b-f0d4-4265-836e-d754460a9f83","Type":"ContainerDied","Data":"b633ae4cd2d7e3a297c8a878afa41a5071a1a48b233401197042f963bd68faec"}
Jul 02 17:48:21.721549 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:21.721514    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-1fad4f/test-model-1fad4f-kserve-5bcb4846df-9m2tf" event={"ID":"751e740b-f0d4-4265-836e-d754460a9f83","Type":"ContainerDied","Data":"a760be88aa41e2296755b6f50f71f7c5d84cf708e6c2b9663b6609386d5715ac"}
Jul 02 17:48:21.721549 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:21.721537    2578 scope.go:117] "RemoveContainer" containerID="b633ae4cd2d7e3a297c8a878afa41a5071a1a48b233401197042f963bd68faec"
Jul 02 17:48:21.736743 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:21.736725    2578 scope.go:117] "RemoveContainer" containerID="b633ae4cd2d7e3a297c8a878afa41a5071a1a48b233401197042f963bd68faec"
Jul 02 17:48:21.736987 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:48:21.736968    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b633ae4cd2d7e3a297c8a878afa41a5071a1a48b233401197042f963bd68faec\": container with ID starting with b633ae4cd2d7e3a297c8a878afa41a5071a1a48b233401197042f963bd68faec not found: ID does not exist" containerID="b633ae4cd2d7e3a297c8a878afa41a5071a1a48b233401197042f963bd68faec"
Jul 02 17:48:21.737059 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:21.736995    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b633ae4cd2d7e3a297c8a878afa41a5071a1a48b233401197042f963bd68faec"} err="failed to get container status \"b633ae4cd2d7e3a297c8a878afa41a5071a1a48b233401197042f963bd68faec\": rpc error: code = NotFound desc = could not find container \"b633ae4cd2d7e3a297c8a878afa41a5071a1a48b233401197042f963bd68faec\": container with ID starting with b633ae4cd2d7e3a297c8a878afa41a5071a1a48b233401197042f963bd68faec not found: ID does not exist"
Jul 02 17:48:21.745907 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:21.745885    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-1fad4f/test-model-1fad4f-kserve-5bcb4846df-9m2tf"]
Jul 02 17:48:21.749687 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:21.749664    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-1fad4f/test-model-1fad4f-kserve-5bcb4846df-9m2tf"]
Jul 02 17:48:23.496885 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:23.496852    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="751e740b-f0d4-4265-836e-d754460a9f83" path="/var/lib/kubelet/pods/751e740b-f0d4-4265-836e-d754460a9f83/volumes"
Jul 02 17:48:47.921313 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:47.921263    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:48:48.196409 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:48.196268    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:48:48.416650 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:48.416614    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:48:48.570601 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:48.570565    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:48:48.983596 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:48.983565    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:48:49.084369 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:49.084328    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:48:49.183594 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:49.183562    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:48:49.284436 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:49.284347    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:48:52.140338 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:52.140303    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:48:54.678383 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:54.678330    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:48:54.748652 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:54.748617    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:48:54.948450 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:54.948357    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:48:55.180213 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:55.180171    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:48:55.598197 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:55.598162    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:48:55.815157 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:55.815120    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:48:55.923266 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:55.923164    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:48:56.695277 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:56.695238    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:48:56.795501 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:56.795448    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:48:58.589897 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:58.589866    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:48:58.661955 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:58.661919    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:48:58.769618 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:58.769575    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:48:59.255722 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:59.255673    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:48:59.356620 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:59.356586    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:48:59.407464 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:48:59.407432    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:49:03.081218 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:03.081162    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:49:03.541237 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:03.541204    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:49:03.851334 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:03.851236    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:49:04.208160 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:04.208056    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:49:06.543090 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:06.543053    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:49:06.603730 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:06.603676    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:49:06.698616 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:06.698578    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:49:06.769887 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:06.769847    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:49:07.017295 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:07.017255    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:49:07.197140 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:07.197105    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:49:07.298169 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:07.298086    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:49:11.090075 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:11.090005    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:49:19.143821 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:19.143785    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:49:19.155739 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:19.155713    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:49:19.504963 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:19.504921    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:49:19.695812 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:19.695773    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:49:19.799231 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:19.799145    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:49:19.966789 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:19.966755    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:49:25.157711 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:25.157645    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:49:25.259481 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:25.259445    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:49:25.512412 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:25.512382    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:49:25.665082 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:25.665044    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:49:25.816055 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:25.815965    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:49:26.203137 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:26.203056    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:49:26.302925 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:26.302896    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:49:26.403975 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:26.403941    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:49:26.535736 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:26.535704    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:49:29.044071 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:29.044037    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:49:31.920186 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:31.920149    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:49:32.019754 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:32.019722    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:49:32.170573 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:32.170487    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:49:32.395190 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:32.395159    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:49:32.728005 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:32.727974    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:49:33.080436 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:33.080358    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:49:33.274903 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:33.274870    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:49:35.766687 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:35.766655    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:49:35.840757 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:35.840726    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:49:35.915229 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:35.915199    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:49:36.069240 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:36.069162    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:49:36.309486 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:36.309444    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:49:36.410182 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:36.410100    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:49:40.240622 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:40.240585    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:49:40.560991 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:40.560913    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:49:40.858384 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:40.858308    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:49:40.956761 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:40.956731    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:49:43.543756 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:43.543723    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:49:43.822720 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:43.822652    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:49:43.892825 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:43.892787    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:49:43.963062 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:43.963005    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:49:44.068707 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:44.068679    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:49:44.480241 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:44.480208    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:49:44.580436 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:44.580411    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:49:48.340031 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:48.339991    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:49:54.966926 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:54.966890    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:49:56.728562 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:56.728529    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-1381a9/auth-test-model-1381a9-kserve-db7c57659-8vh56"]
Jul 02 17:49:56.728998 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:56.728979    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c7ca6db-5199-4971-acdd-7f9d656ad4d0" containerName="main"
Jul 02 17:49:56.729097 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:56.729002    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c7ca6db-5199-4971-acdd-7f9d656ad4d0" containerName="main"
Jul 02 17:49:56.729097 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:56.729084    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="751e740b-f0d4-4265-836e-d754460a9f83" containerName="main"
Jul 02 17:49:56.729097 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:56.729093    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="751e740b-f0d4-4265-836e-d754460a9f83" containerName="main"
Jul 02 17:49:56.729237 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:56.729213    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c7ca6db-5199-4971-acdd-7f9d656ad4d0" containerName="main"
Jul 02 17:49:56.729286 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:56.729241    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="751e740b-f0d4-4265-836e-d754460a9f83" containerName="main"
Jul 02 17:49:56.732386 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:56.732368    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-1381a9/auth-test-model-1381a9-kserve-db7c57659-8vh56"
Jul 02 17:49:56.736591 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:56.736570    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-1381a9\"/\"openshift-service-ca.crt\""
Jul 02 17:49:56.736703 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:56.736589    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-1381a9\"/\"kube-root-ca.crt\""
Jul 02 17:49:56.736703 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:56.736570    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-1381a9\"/\"default-dockercfg-t5qqf\""
Jul 02 17:49:56.736703 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:56.736589    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-1381a9\"/\"auth-test-model-1381a9-kserve-self-signed-certs\""
Jul 02 17:49:56.744528 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:56.744506    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-1381a9/auth-test-model-1381a9-kserve-db7c57659-8vh56"]
Jul 02 17:49:56.778811 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:56.778776    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:49:56.833933 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:56.833905    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/389ab8ec-401b-4f20-811c-31cd22aea2aa-tmp-dir\") pod \"auth-test-model-1381a9-kserve-db7c57659-8vh56\" (UID: \"389ab8ec-401b-4f20-811c-31cd22aea2aa\") " pod="ai-tenant-e2e-shared-a-1381a9/auth-test-model-1381a9-kserve-db7c57659-8vh56"
Jul 02 17:49:56.834070 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:56.833984    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4zjc\" (UniqueName: \"kubernetes.io/projected/389ab8ec-401b-4f20-811c-31cd22aea2aa-kube-api-access-t4zjc\") pod \"auth-test-model-1381a9-kserve-db7c57659-8vh56\" (UID: \"389ab8ec-401b-4f20-811c-31cd22aea2aa\") " pod="ai-tenant-e2e-shared-a-1381a9/auth-test-model-1381a9-kserve-db7c57659-8vh56"
Jul 02 17:49:56.834070 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:56.834008    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/389ab8ec-401b-4f20-811c-31cd22aea2aa-dshm\") pod \"auth-test-model-1381a9-kserve-db7c57659-8vh56\" (UID: \"389ab8ec-401b-4f20-811c-31cd22aea2aa\") " pod="ai-tenant-e2e-shared-a-1381a9/auth-test-model-1381a9-kserve-db7c57659-8vh56"
Jul 02 17:49:56.834070 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:56.834055    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/389ab8ec-401b-4f20-811c-31cd22aea2aa-home\") pod \"auth-test-model-1381a9-kserve-db7c57659-8vh56\" (UID: \"389ab8ec-401b-4f20-811c-31cd22aea2aa\") " pod="ai-tenant-e2e-shared-a-1381a9/auth-test-model-1381a9-kserve-db7c57659-8vh56"
Jul 02 17:49:56.834202 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:56.834077    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/389ab8ec-401b-4f20-811c-31cd22aea2aa-model-cache\") pod \"auth-test-model-1381a9-kserve-db7c57659-8vh56\" (UID: \"389ab8ec-401b-4f20-811c-31cd22aea2aa\") " pod="ai-tenant-e2e-shared-a-1381a9/auth-test-model-1381a9-kserve-db7c57659-8vh56"
Jul 02 17:49:56.834202 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:56.834096    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/389ab8ec-401b-4f20-811c-31cd22aea2aa-tls-certs\") pod \"auth-test-model-1381a9-kserve-db7c57659-8vh56\" (UID: \"389ab8ec-401b-4f20-811c-31cd22aea2aa\") " pod="ai-tenant-e2e-shared-a-1381a9/auth-test-model-1381a9-kserve-db7c57659-8vh56"
Jul 02 17:49:56.935338 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:56.935318    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4zjc\" (UniqueName: \"kubernetes.io/projected/389ab8ec-401b-4f20-811c-31cd22aea2aa-kube-api-access-t4zjc\") pod \"auth-test-model-1381a9-kserve-db7c57659-8vh56\" (UID: \"389ab8ec-401b-4f20-811c-31cd22aea2aa\") " pod="ai-tenant-e2e-shared-a-1381a9/auth-test-model-1381a9-kserve-db7c57659-8vh56"
Jul 02 17:49:56.935443 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:56.935346    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/389ab8ec-401b-4f20-811c-31cd22aea2aa-dshm\") pod \"auth-test-model-1381a9-kserve-db7c57659-8vh56\" (UID: \"389ab8ec-401b-4f20-811c-31cd22aea2aa\") " pod="ai-tenant-e2e-shared-a-1381a9/auth-test-model-1381a9-kserve-db7c57659-8vh56"
Jul 02 17:49:56.935443 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:56.935363    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/389ab8ec-401b-4f20-811c-31cd22aea2aa-home\") pod \"auth-test-model-1381a9-kserve-db7c57659-8vh56\" (UID: \"389ab8ec-401b-4f20-811c-31cd22aea2aa\") " pod="ai-tenant-e2e-shared-a-1381a9/auth-test-model-1381a9-kserve-db7c57659-8vh56"
Jul 02 17:49:56.935443 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:56.935427    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/389ab8ec-401b-4f20-811c-31cd22aea2aa-model-cache\") pod \"auth-test-model-1381a9-kserve-db7c57659-8vh56\" (UID: \"389ab8ec-401b-4f20-811c-31cd22aea2aa\") " pod="ai-tenant-e2e-shared-a-1381a9/auth-test-model-1381a9-kserve-db7c57659-8vh56"
Jul 02 17:49:56.935552 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:56.935470    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/389ab8ec-401b-4f20-811c-31cd22aea2aa-tls-certs\") pod \"auth-test-model-1381a9-kserve-db7c57659-8vh56\" (UID: \"389ab8ec-401b-4f20-811c-31cd22aea2aa\") " pod="ai-tenant-e2e-shared-a-1381a9/auth-test-model-1381a9-kserve-db7c57659-8vh56"
Jul 02 17:49:56.935552 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:56.935517    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/389ab8ec-401b-4f20-811c-31cd22aea2aa-tmp-dir\") pod \"auth-test-model-1381a9-kserve-db7c57659-8vh56\" (UID: \"389ab8ec-401b-4f20-811c-31cd22aea2aa\") " pod="ai-tenant-e2e-shared-a-1381a9/auth-test-model-1381a9-kserve-db7c57659-8vh56"
Jul 02 17:49:56.935813 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:56.935790    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/389ab8ec-401b-4f20-811c-31cd22aea2aa-home\") pod \"auth-test-model-1381a9-kserve-db7c57659-8vh56\" (UID: \"389ab8ec-401b-4f20-811c-31cd22aea2aa\") " pod="ai-tenant-e2e-shared-a-1381a9/auth-test-model-1381a9-kserve-db7c57659-8vh56"
Jul 02 17:49:56.935813 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:56.935805    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/389ab8ec-401b-4f20-811c-31cd22aea2aa-model-cache\") pod \"auth-test-model-1381a9-kserve-db7c57659-8vh56\" (UID: \"389ab8ec-401b-4f20-811c-31cd22aea2aa\") " pod="ai-tenant-e2e-shared-a-1381a9/auth-test-model-1381a9-kserve-db7c57659-8vh56"
Jul 02 17:49:56.935927 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:56.935844    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/389ab8ec-401b-4f20-811c-31cd22aea2aa-tmp-dir\") pod \"auth-test-model-1381a9-kserve-db7c57659-8vh56\" (UID: \"389ab8ec-401b-4f20-811c-31cd22aea2aa\") " pod="ai-tenant-e2e-shared-a-1381a9/auth-test-model-1381a9-kserve-db7c57659-8vh56"
Jul 02 17:49:56.937556 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:56.937532    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/389ab8ec-401b-4f20-811c-31cd22aea2aa-dshm\") pod \"auth-test-model-1381a9-kserve-db7c57659-8vh56\" (UID: \"389ab8ec-401b-4f20-811c-31cd22aea2aa\") " pod="ai-tenant-e2e-shared-a-1381a9/auth-test-model-1381a9-kserve-db7c57659-8vh56"
Jul 02 17:49:56.937797 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:56.937783    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/389ab8ec-401b-4f20-811c-31cd22aea2aa-tls-certs\") pod \"auth-test-model-1381a9-kserve-db7c57659-8vh56\" (UID: \"389ab8ec-401b-4f20-811c-31cd22aea2aa\") " pod="ai-tenant-e2e-shared-a-1381a9/auth-test-model-1381a9-kserve-db7c57659-8vh56"
Jul 02 17:49:56.944395 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:56.944372    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4zjc\" (UniqueName: \"kubernetes.io/projected/389ab8ec-401b-4f20-811c-31cd22aea2aa-kube-api-access-t4zjc\") pod \"auth-test-model-1381a9-kserve-db7c57659-8vh56\" (UID: \"389ab8ec-401b-4f20-811c-31cd22aea2aa\") " pod="ai-tenant-e2e-shared-a-1381a9/auth-test-model-1381a9-kserve-db7c57659-8vh56"
Jul 02 17:49:57.041570 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:57.041518    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-1381a9/auth-test-model-1381a9-kserve-db7c57659-8vh56"
Jul 02 17:49:57.140886 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:57.140850    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:49:57.176451 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:57.176423    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-1381a9/auth-test-model-1381a9-kserve-db7c57659-8vh56"]
Jul 02 17:49:57.179866 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:49:57.179837    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod389ab8ec_401b_4f20_811c_31cd22aea2aa.slice/crio-5513c47f107c182be41bc31bd5e83735a6d2d05937d117ad503127f33adff6cd WatchSource:0}: Error finding container 5513c47f107c182be41bc31bd5e83735a6d2d05937d117ad503127f33adff6cd: Status 404 returned error can't find the container with id 5513c47f107c182be41bc31bd5e83735a6d2d05937d117ad503127f33adff6cd
Jul 02 17:49:57.243253 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:57.243228    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:49:58.186356 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:58.186320    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-1381a9/auth-test-model-1381a9-kserve-db7c57659-8vh56" event={"ID":"389ab8ec-401b-4f20-811c-31cd22aea2aa","Type":"ContainerStarted","Data":"81a5e7b1a7651161eabb1632c6d3f7d859649fe29458b4bd911160917e3ad388"}
Jul 02 17:49:58.186356 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:58.186359    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-1381a9/auth-test-model-1381a9-kserve-db7c57659-8vh56" event={"ID":"389ab8ec-401b-4f20-811c-31cd22aea2aa","Type":"ContainerStarted","Data":"5513c47f107c182be41bc31bd5e83735a6d2d05937d117ad503127f33adff6cd"}
Jul 02 17:49:58.204249 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:49:58.204204    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-1381a9/auth-test-model-1381a9-kserve-db7c57659-8vh56" podStartSLOduration=2.204185816 podStartE2EDuration="2.204185816s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:49:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:49:58.202130983 +0000 UTC m=+2353.391833646" watchObservedRunningTime="2026-07-02 17:49:58.204185816 +0000 UTC m=+2353.393888478"
Jul 02 17:50:05.202945 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:50:05.202917    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:50:05.302951 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:50:05.302918    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:50:07.042163 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:50:07.042128    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-1381a9/auth-test-model-1381a9-kserve-db7c57659-8vh56"
Jul 02 17:50:07.042639 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:50:07.042178    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-1381a9/auth-test-model-1381a9-kserve-db7c57659-8vh56"
Jul 02 17:50:07.047386 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:50:07.047359    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:50:07.054603 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:50:07.054579    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-1381a9/auth-test-model-1381a9-kserve-db7c57659-8vh56"
Jul 02 17:50:07.241383 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:50:07.241360    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-1381a9/auth-test-model-1381a9-kserve-db7c57659-8vh56"
Jul 02 17:50:17.917815 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:50:17.917775    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:50:24.601455 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:50:24.601412    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:50:24.661037 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:50:24.660980    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:50:28.948170 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:50:28.948133    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:50:45.488097 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:50:45.488071    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-62g9m_d6628590-1cf7-4a61-9350-539f3ae7ed91/ovn-acl-logging/0.log"
Jul 02 17:50:45.495631 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:50:45.495606    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-62g9m_d6628590-1cf7-4a61-9350-539f3ae7ed91/ovn-acl-logging/0.log"
Jul 02 17:50:53.755719 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:50:53.755680    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-d1bf18/auth-test-model-d1bf18-kserve-6569d55cf5-ccm2h"]
Jul 02 17:50:53.759169 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:50:53.759150    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d1bf18/auth-test-model-d1bf18-kserve-6569d55cf5-ccm2h"
Jul 02 17:50:53.761986 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:50:53.761961    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-d1bf18\"/\"openshift-service-ca.crt\""
Jul 02 17:50:53.763267 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:50:53.763248    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-d1bf18\"/\"kube-root-ca.crt\""
Jul 02 17:50:53.763267 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:50:53.763258    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-d1bf18\"/\"default-dockercfg-nvs86\""
Jul 02 17:50:53.763413 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:50:53.763276    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-d1bf18\"/\"auth-test-model-d1bf18-kserve-self-signed-certs\""
Jul 02 17:50:53.767573 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:50:53.767548    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-d1bf18/auth-test-model-d1bf18-kserve-6569d55cf5-ccm2h"]
Jul 02 17:50:53.832301 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:50:53.832275    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:50:53.897354 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:50:53.897332    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/275623ef-1a90-43e8-a8a8-ffefc4a84e3e-home\") pod \"auth-test-model-d1bf18-kserve-6569d55cf5-ccm2h\" (UID: \"275623ef-1a90-43e8-a8a8-ffefc4a84e3e\") " pod="ai-tenant-e2e-shared-b-d1bf18/auth-test-model-d1bf18-kserve-6569d55cf5-ccm2h"
Jul 02 17:50:53.897461 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:50:53.897360    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/275623ef-1a90-43e8-a8a8-ffefc4a84e3e-tls-certs\") pod \"auth-test-model-d1bf18-kserve-6569d55cf5-ccm2h\" (UID: \"275623ef-1a90-43e8-a8a8-ffefc4a84e3e\") " pod="ai-tenant-e2e-shared-b-d1bf18/auth-test-model-d1bf18-kserve-6569d55cf5-ccm2h"
Jul 02 17:50:53.897461 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:50:53.897404    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/275623ef-1a90-43e8-a8a8-ffefc4a84e3e-tmp-dir\") pod \"auth-test-model-d1bf18-kserve-6569d55cf5-ccm2h\" (UID: \"275623ef-1a90-43e8-a8a8-ffefc4a84e3e\") " pod="ai-tenant-e2e-shared-b-d1bf18/auth-test-model-d1bf18-kserve-6569d55cf5-ccm2h"
Jul 02 17:50:53.897461 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:50:53.897447    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/275623ef-1a90-43e8-a8a8-ffefc4a84e3e-model-cache\") pod \"auth-test-model-d1bf18-kserve-6569d55cf5-ccm2h\" (UID: \"275623ef-1a90-43e8-a8a8-ffefc4a84e3e\") " pod="ai-tenant-e2e-shared-b-d1bf18/auth-test-model-d1bf18-kserve-6569d55cf5-ccm2h"
Jul 02 17:50:53.897565 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:50:53.897482    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fm8w4\" (UniqueName: \"kubernetes.io/projected/275623ef-1a90-43e8-a8a8-ffefc4a84e3e-kube-api-access-fm8w4\") pod \"auth-test-model-d1bf18-kserve-6569d55cf5-ccm2h\" (UID: \"275623ef-1a90-43e8-a8a8-ffefc4a84e3e\") " pod="ai-tenant-e2e-shared-b-d1bf18/auth-test-model-d1bf18-kserve-6569d55cf5-ccm2h"
Jul 02 17:50:53.897565 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:50:53.897517    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/275623ef-1a90-43e8-a8a8-ffefc4a84e3e-dshm\") pod \"auth-test-model-d1bf18-kserve-6569d55cf5-ccm2h\" (UID: \"275623ef-1a90-43e8-a8a8-ffefc4a84e3e\") " pod="ai-tenant-e2e-shared-b-d1bf18/auth-test-model-d1bf18-kserve-6569d55cf5-ccm2h"
Jul 02 17:50:53.998119 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:50:53.998091    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/275623ef-1a90-43e8-a8a8-ffefc4a84e3e-home\") pod \"auth-test-model-d1bf18-kserve-6569d55cf5-ccm2h\" (UID: \"275623ef-1a90-43e8-a8a8-ffefc4a84e3e\") " pod="ai-tenant-e2e-shared-b-d1bf18/auth-test-model-d1bf18-kserve-6569d55cf5-ccm2h"
Jul 02 17:50:53.998119 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:50:53.998121    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/275623ef-1a90-43e8-a8a8-ffefc4a84e3e-tls-certs\") pod \"auth-test-model-d1bf18-kserve-6569d55cf5-ccm2h\" (UID: \"275623ef-1a90-43e8-a8a8-ffefc4a84e3e\") " pod="ai-tenant-e2e-shared-b-d1bf18/auth-test-model-d1bf18-kserve-6569d55cf5-ccm2h"
Jul 02 17:50:53.998241 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:50:53.998155    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/275623ef-1a90-43e8-a8a8-ffefc4a84e3e-tmp-dir\") pod \"auth-test-model-d1bf18-kserve-6569d55cf5-ccm2h\" (UID: \"275623ef-1a90-43e8-a8a8-ffefc4a84e3e\") " pod="ai-tenant-e2e-shared-b-d1bf18/auth-test-model-d1bf18-kserve-6569d55cf5-ccm2h"
Jul 02 17:50:53.998241 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:50:53.998178    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/275623ef-1a90-43e8-a8a8-ffefc4a84e3e-model-cache\") pod \"auth-test-model-d1bf18-kserve-6569d55cf5-ccm2h\" (UID: \"275623ef-1a90-43e8-a8a8-ffefc4a84e3e\") " pod="ai-tenant-e2e-shared-b-d1bf18/auth-test-model-d1bf18-kserve-6569d55cf5-ccm2h"
Jul 02 17:50:53.998241 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:50:53.998208    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fm8w4\" (UniqueName: \"kubernetes.io/projected/275623ef-1a90-43e8-a8a8-ffefc4a84e3e-kube-api-access-fm8w4\") pod \"auth-test-model-d1bf18-kserve-6569d55cf5-ccm2h\" (UID: \"275623ef-1a90-43e8-a8a8-ffefc4a84e3e\") " pod="ai-tenant-e2e-shared-b-d1bf18/auth-test-model-d1bf18-kserve-6569d55cf5-ccm2h"
Jul 02 17:50:53.998241 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:50:53.998236    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/275623ef-1a90-43e8-a8a8-ffefc4a84e3e-dshm\") pod \"auth-test-model-d1bf18-kserve-6569d55cf5-ccm2h\" (UID: \"275623ef-1a90-43e8-a8a8-ffefc4a84e3e\") " pod="ai-tenant-e2e-shared-b-d1bf18/auth-test-model-d1bf18-kserve-6569d55cf5-ccm2h"
Jul 02 17:50:53.998520 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:50:53.998494    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/275623ef-1a90-43e8-a8a8-ffefc4a84e3e-home\") pod \"auth-test-model-d1bf18-kserve-6569d55cf5-ccm2h\" (UID: \"275623ef-1a90-43e8-a8a8-ffefc4a84e3e\") " pod="ai-tenant-e2e-shared-b-d1bf18/auth-test-model-d1bf18-kserve-6569d55cf5-ccm2h"
Jul 02 17:50:53.998586 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:50:53.998563    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/275623ef-1a90-43e8-a8a8-ffefc4a84e3e-tmp-dir\") pod \"auth-test-model-d1bf18-kserve-6569d55cf5-ccm2h\" (UID: \"275623ef-1a90-43e8-a8a8-ffefc4a84e3e\") " pod="ai-tenant-e2e-shared-b-d1bf18/auth-test-model-d1bf18-kserve-6569d55cf5-ccm2h"
Jul 02 17:50:53.998630 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:50:53.998599    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/275623ef-1a90-43e8-a8a8-ffefc4a84e3e-model-cache\") pod \"auth-test-model-d1bf18-kserve-6569d55cf5-ccm2h\" (UID: \"275623ef-1a90-43e8-a8a8-ffefc4a84e3e\") " pod="ai-tenant-e2e-shared-b-d1bf18/auth-test-model-d1bf18-kserve-6569d55cf5-ccm2h"
Jul 02 17:50:54.000446 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:50:54.000426    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/275623ef-1a90-43e8-a8a8-ffefc4a84e3e-dshm\") pod \"auth-test-model-d1bf18-kserve-6569d55cf5-ccm2h\" (UID: \"275623ef-1a90-43e8-a8a8-ffefc4a84e3e\") " pod="ai-tenant-e2e-shared-b-d1bf18/auth-test-model-d1bf18-kserve-6569d55cf5-ccm2h"
Jul 02 17:50:54.000735 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:50:54.000715    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/275623ef-1a90-43e8-a8a8-ffefc4a84e3e-tls-certs\") pod \"auth-test-model-d1bf18-kserve-6569d55cf5-ccm2h\" (UID: \"275623ef-1a90-43e8-a8a8-ffefc4a84e3e\") " pod="ai-tenant-e2e-shared-b-d1bf18/auth-test-model-d1bf18-kserve-6569d55cf5-ccm2h"
Jul 02 17:50:54.005972 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:50:54.005916    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fm8w4\" (UniqueName: \"kubernetes.io/projected/275623ef-1a90-43e8-a8a8-ffefc4a84e3e-kube-api-access-fm8w4\") pod \"auth-test-model-d1bf18-kserve-6569d55cf5-ccm2h\" (UID: \"275623ef-1a90-43e8-a8a8-ffefc4a84e3e\") " pod="ai-tenant-e2e-shared-b-d1bf18/auth-test-model-d1bf18-kserve-6569d55cf5-ccm2h"
Jul 02 17:50:54.069172 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:50:54.069146    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d1bf18/auth-test-model-d1bf18-kserve-6569d55cf5-ccm2h"
Jul 02 17:50:54.198717 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:50:54.198152    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-d1bf18/auth-test-model-d1bf18-kserve-6569d55cf5-ccm2h"]
Jul 02 17:50:54.461740 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:50:54.461699    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d1bf18/auth-test-model-d1bf18-kserve-6569d55cf5-ccm2h" event={"ID":"275623ef-1a90-43e8-a8a8-ffefc4a84e3e","Type":"ContainerStarted","Data":"b130c49e062f16ebda3f233a05dd9210a4efa6e82fc5da9cac3fefbbd9eb4a69"}
Jul 02 17:50:54.461740 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:50:54.461742    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d1bf18/auth-test-model-d1bf18-kserve-6569d55cf5-ccm2h" event={"ID":"275623ef-1a90-43e8-a8a8-ffefc4a84e3e","Type":"ContainerStarted","Data":"0a1d3afd53199e5fdf83f55f60c57e0a0e2566d2fb463d4f97321311963c53ad"}
Jul 02 17:50:54.478795 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:50:54.478747    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-d1bf18/auth-test-model-d1bf18-kserve-6569d55cf5-ccm2h" podStartSLOduration=1.478734446 podStartE2EDuration="1.478734446s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:50:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:50:54.477596768 +0000 UTC m=+2409.667299430" watchObservedRunningTime="2026-07-02 17:50:54.478734446 +0000 UTC m=+2409.668437107"
Jul 02 17:50:57.962776 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:50:57.962735    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:51:04.069612 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:51:04.069579    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-d1bf18/auth-test-model-d1bf18-kserve-6569d55cf5-ccm2h"
Jul 02 17:51:04.070137 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:51:04.069627    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-d1bf18/auth-test-model-d1bf18-kserve-6569d55cf5-ccm2h"
Jul 02 17:51:04.081841 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:51:04.081815    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-d1bf18/auth-test-model-d1bf18-kserve-6569d55cf5-ccm2h"
Jul 02 17:51:04.520109 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:51:04.520081    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-d1bf18/auth-test-model-d1bf18-kserve-6569d55cf5-ccm2h"
Jul 02 17:51:15.245327 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:51:15.245288    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:51:33.643644 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:51:33.643603    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:51:47.650744 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:51:47.650701    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:52:05.245742 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:52:05.245709    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:52:23.040707 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:52:23.040672    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:52:39.737277 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:52:39.737193    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:52:53.249036 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:52:53.248982    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-1381a9/auth-test-model-1381a9-kserve-db7c57659-8vh56"]
Jul 02 17:52:53.287543 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:52:53.287512    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:52:54.355528 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:52:54.355493    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-d1bf18/auth-test-model-d1bf18-kserve-6569d55cf5-ccm2h"]
Jul 02 17:52:54.531151 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:52:54.531117    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:52:57.252482 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:52:57.252449    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:53:08.270453 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:08.270386    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-1381a9/auth-test-model-1381a9-kserve-db7c57659-8vh56" podUID="389ab8ec-401b-4f20-811c-31cd22aea2aa" containerName="main" containerID="cri-o://81a5e7b1a7651161eabb1632c6d3f7d859649fe29458b4bd911160917e3ad388" gracePeriod=45
Jul 02 17:53:08.509573 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:08.509549    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-1381a9/auth-test-model-1381a9-kserve-db7c57659-8vh56"
Jul 02 17:53:08.587841 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:08.587775    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/389ab8ec-401b-4f20-811c-31cd22aea2aa-tmp-dir\") pod \"389ab8ec-401b-4f20-811c-31cd22aea2aa\" (UID: \"389ab8ec-401b-4f20-811c-31cd22aea2aa\") "
Jul 02 17:53:08.587841 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:08.587806    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/389ab8ec-401b-4f20-811c-31cd22aea2aa-tls-certs\") pod \"389ab8ec-401b-4f20-811c-31cd22aea2aa\" (UID: \"389ab8ec-401b-4f20-811c-31cd22aea2aa\") "
Jul 02 17:53:08.587841 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:08.587835    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t4zjc\" (UniqueName: \"kubernetes.io/projected/389ab8ec-401b-4f20-811c-31cd22aea2aa-kube-api-access-t4zjc\") pod \"389ab8ec-401b-4f20-811c-31cd22aea2aa\" (UID: \"389ab8ec-401b-4f20-811c-31cd22aea2aa\") "
Jul 02 17:53:08.588110 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:08.587859    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/389ab8ec-401b-4f20-811c-31cd22aea2aa-home\") pod \"389ab8ec-401b-4f20-811c-31cd22aea2aa\" (UID: \"389ab8ec-401b-4f20-811c-31cd22aea2aa\") "
Jul 02 17:53:08.588110 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:08.587901    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/389ab8ec-401b-4f20-811c-31cd22aea2aa-dshm\") pod \"389ab8ec-401b-4f20-811c-31cd22aea2aa\" (UID: \"389ab8ec-401b-4f20-811c-31cd22aea2aa\") "
Jul 02 17:53:08.588110 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:08.587966    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/389ab8ec-401b-4f20-811c-31cd22aea2aa-model-cache\") pod \"389ab8ec-401b-4f20-811c-31cd22aea2aa\" (UID: \"389ab8ec-401b-4f20-811c-31cd22aea2aa\") "
Jul 02 17:53:08.588110 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:08.588096    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/389ab8ec-401b-4f20-811c-31cd22aea2aa-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "389ab8ec-401b-4f20-811c-31cd22aea2aa" (UID: "389ab8ec-401b-4f20-811c-31cd22aea2aa"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:53:08.588315 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:08.588192    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/389ab8ec-401b-4f20-811c-31cd22aea2aa-home" (OuterVolumeSpecName: "home") pod "389ab8ec-401b-4f20-811c-31cd22aea2aa" (UID: "389ab8ec-401b-4f20-811c-31cd22aea2aa"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:53:08.588375 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:08.588323    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/389ab8ec-401b-4f20-811c-31cd22aea2aa-model-cache" (OuterVolumeSpecName: "model-cache") pod "389ab8ec-401b-4f20-811c-31cd22aea2aa" (UID: "389ab8ec-401b-4f20-811c-31cd22aea2aa"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:53:08.588697 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:08.588679    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/389ab8ec-401b-4f20-811c-31cd22aea2aa-model-cache\") on node \"ip-10-0-143-67.ec2.internal\" DevicePath \"\""
Jul 02 17:53:08.588790 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:08.588701    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/389ab8ec-401b-4f20-811c-31cd22aea2aa-tmp-dir\") on node \"ip-10-0-143-67.ec2.internal\" DevicePath \"\""
Jul 02 17:53:08.588790 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:08.588715    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/389ab8ec-401b-4f20-811c-31cd22aea2aa-home\") on node \"ip-10-0-143-67.ec2.internal\" DevicePath \"\""
Jul 02 17:53:08.590297 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:08.590277    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/389ab8ec-401b-4f20-811c-31cd22aea2aa-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "389ab8ec-401b-4f20-811c-31cd22aea2aa" (UID: "389ab8ec-401b-4f20-811c-31cd22aea2aa"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 17:53:08.590393 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:08.590372    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/389ab8ec-401b-4f20-811c-31cd22aea2aa-dshm" (OuterVolumeSpecName: "dshm") pod "389ab8ec-401b-4f20-811c-31cd22aea2aa" (UID: "389ab8ec-401b-4f20-811c-31cd22aea2aa"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:53:08.590433 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:08.590385    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/389ab8ec-401b-4f20-811c-31cd22aea2aa-kube-api-access-t4zjc" (OuterVolumeSpecName: "kube-api-access-t4zjc") pod "389ab8ec-401b-4f20-811c-31cd22aea2aa" (UID: "389ab8ec-401b-4f20-811c-31cd22aea2aa"). InnerVolumeSpecName "kube-api-access-t4zjc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 17:53:08.689194 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:08.689169    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/389ab8ec-401b-4f20-811c-31cd22aea2aa-tls-certs\") on node \"ip-10-0-143-67.ec2.internal\" DevicePath \"\""
Jul 02 17:53:08.689283 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:08.689198    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t4zjc\" (UniqueName: \"kubernetes.io/projected/389ab8ec-401b-4f20-811c-31cd22aea2aa-kube-api-access-t4zjc\") on node \"ip-10-0-143-67.ec2.internal\" DevicePath \"\""
Jul 02 17:53:08.689283 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:08.689210    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/389ab8ec-401b-4f20-811c-31cd22aea2aa-dshm\") on node \"ip-10-0-143-67.ec2.internal\" DevicePath \"\""
Jul 02 17:53:09.110777 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:09.110743    2578 generic.go:356] "Generic (PLEG): container finished" podID="389ab8ec-401b-4f20-811c-31cd22aea2aa" containerID="81a5e7b1a7651161eabb1632c6d3f7d859649fe29458b4bd911160917e3ad388" exitCode=0
Jul 02 17:53:09.110984 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:09.110801    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-1381a9/auth-test-model-1381a9-kserve-db7c57659-8vh56"
Jul 02 17:53:09.110984 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:09.110837    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-1381a9/auth-test-model-1381a9-kserve-db7c57659-8vh56" event={"ID":"389ab8ec-401b-4f20-811c-31cd22aea2aa","Type":"ContainerDied","Data":"81a5e7b1a7651161eabb1632c6d3f7d859649fe29458b4bd911160917e3ad388"}
Jul 02 17:53:09.110984 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:09.110882    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-1381a9/auth-test-model-1381a9-kserve-db7c57659-8vh56" event={"ID":"389ab8ec-401b-4f20-811c-31cd22aea2aa","Type":"ContainerDied","Data":"5513c47f107c182be41bc31bd5e83735a6d2d05937d117ad503127f33adff6cd"}
Jul 02 17:53:09.110984 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:09.110908    2578 scope.go:117] "RemoveContainer" containerID="81a5e7b1a7651161eabb1632c6d3f7d859649fe29458b4bd911160917e3ad388"
Jul 02 17:53:09.121254 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:09.121237    2578 scope.go:117] "RemoveContainer" containerID="81a5e7b1a7651161eabb1632c6d3f7d859649fe29458b4bd911160917e3ad388"
Jul 02 17:53:09.121573 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:53:09.121550    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81a5e7b1a7651161eabb1632c6d3f7d859649fe29458b4bd911160917e3ad388\": container with ID starting with 81a5e7b1a7651161eabb1632c6d3f7d859649fe29458b4bd911160917e3ad388 not found: ID does not exist" containerID="81a5e7b1a7651161eabb1632c6d3f7d859649fe29458b4bd911160917e3ad388"
Jul 02 17:53:09.121625 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:09.121582    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81a5e7b1a7651161eabb1632c6d3f7d859649fe29458b4bd911160917e3ad388"} err="failed to get container status \"81a5e7b1a7651161eabb1632c6d3f7d859649fe29458b4bd911160917e3ad388\": rpc error: code = NotFound desc = could not find container \"81a5e7b1a7651161eabb1632c6d3f7d859649fe29458b4bd911160917e3ad388\": container with ID starting with 81a5e7b1a7651161eabb1632c6d3f7d859649fe29458b4bd911160917e3ad388 not found: ID does not exist"
Jul 02 17:53:09.132796 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:09.132768    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-1381a9/auth-test-model-1381a9-kserve-db7c57659-8vh56"]
Jul 02 17:53:09.136394 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:09.136371    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-1381a9/auth-test-model-1381a9-kserve-db7c57659-8vh56"]
Jul 02 17:53:09.252555 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:09.252526    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-1381a9/sub-test-model-1381a9-kserve-59449849bf-4gwhp"]
Jul 02 17:53:09.252988 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:09.252962    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="389ab8ec-401b-4f20-811c-31cd22aea2aa" containerName="main"
Jul 02 17:53:09.252988 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:09.252983    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="389ab8ec-401b-4f20-811c-31cd22aea2aa" containerName="main"
Jul 02 17:53:09.253116 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:09.253066    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="389ab8ec-401b-4f20-811c-31cd22aea2aa" containerName="main"
Jul 02 17:53:09.257302 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:09.257284    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-1381a9/sub-test-model-1381a9-kserve-59449849bf-4gwhp"
Jul 02 17:53:09.260229 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:09.260206    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-1381a9\"/\"openshift-service-ca.crt\""
Jul 02 17:53:09.260229 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:09.260221    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-1381a9\"/\"sub-test-model-1381a9-kserve-self-signed-certs\""
Jul 02 17:53:09.260379 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:09.260261    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-1381a9\"/\"default-dockercfg-t5qqf\""
Jul 02 17:53:09.260379 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:09.260209    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-1381a9\"/\"kube-root-ca.crt\""
Jul 02 17:53:09.265404 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:09.265381    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-1381a9/sub-test-model-1381a9-kserve-59449849bf-4gwhp"]
Jul 02 17:53:09.276053 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:09.276003    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:53:09.294465 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:09.294449    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/46580ed5-4a2f-4ca5-be71-19d2870e4dcf-home\") pod \"sub-test-model-1381a9-kserve-59449849bf-4gwhp\" (UID: \"46580ed5-4a2f-4ca5-be71-19d2870e4dcf\") " pod="ai-tenant-e2e-shared-a-1381a9/sub-test-model-1381a9-kserve-59449849bf-4gwhp"
Jul 02 17:53:09.294572 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:09.294479    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46580ed5-4a2f-4ca5-be71-19d2870e4dcf-tmp-dir\") pod \"sub-test-model-1381a9-kserve-59449849bf-4gwhp\" (UID: \"46580ed5-4a2f-4ca5-be71-19d2870e4dcf\") " pod="ai-tenant-e2e-shared-a-1381a9/sub-test-model-1381a9-kserve-59449849bf-4gwhp"
Jul 02 17:53:09.294572 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:09.294501    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/46580ed5-4a2f-4ca5-be71-19d2870e4dcf-model-cache\") pod \"sub-test-model-1381a9-kserve-59449849bf-4gwhp\" (UID: \"46580ed5-4a2f-4ca5-be71-19d2870e4dcf\") " pod="ai-tenant-e2e-shared-a-1381a9/sub-test-model-1381a9-kserve-59449849bf-4gwhp"
Jul 02 17:53:09.294572 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:09.294518    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46580ed5-4a2f-4ca5-be71-19d2870e4dcf-tls-certs\") pod \"sub-test-model-1381a9-kserve-59449849bf-4gwhp\" (UID: \"46580ed5-4a2f-4ca5-be71-19d2870e4dcf\") " pod="ai-tenant-e2e-shared-a-1381a9/sub-test-model-1381a9-kserve-59449849bf-4gwhp"
Jul 02 17:53:09.294726 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:09.294575    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/46580ed5-4a2f-4ca5-be71-19d2870e4dcf-dshm\") pod \"sub-test-model-1381a9-kserve-59449849bf-4gwhp\" (UID: \"46580ed5-4a2f-4ca5-be71-19d2870e4dcf\") " pod="ai-tenant-e2e-shared-a-1381a9/sub-test-model-1381a9-kserve-59449849bf-4gwhp"
Jul 02 17:53:09.294726 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:09.294618    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9l54x\" (UniqueName: \"kubernetes.io/projected/46580ed5-4a2f-4ca5-be71-19d2870e4dcf-kube-api-access-9l54x\") pod \"sub-test-model-1381a9-kserve-59449849bf-4gwhp\" (UID: \"46580ed5-4a2f-4ca5-be71-19d2870e4dcf\") " pod="ai-tenant-e2e-shared-a-1381a9/sub-test-model-1381a9-kserve-59449849bf-4gwhp"
Jul 02 17:53:09.377779 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:09.377720    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-d1bf18/auth-test-model-d1bf18-kserve-6569d55cf5-ccm2h" podUID="275623ef-1a90-43e8-a8a8-ffefc4a84e3e" containerName="main" containerID="cri-o://b130c49e062f16ebda3f233a05dd9210a4efa6e82fc5da9cac3fefbbd9eb4a69" gracePeriod=45
Jul 02 17:53:09.395621 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:09.395602    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46580ed5-4a2f-4ca5-be71-19d2870e4dcf-tmp-dir\") pod \"sub-test-model-1381a9-kserve-59449849bf-4gwhp\" (UID: \"46580ed5-4a2f-4ca5-be71-19d2870e4dcf\") " pod="ai-tenant-e2e-shared-a-1381a9/sub-test-model-1381a9-kserve-59449849bf-4gwhp"
Jul 02 17:53:09.395704 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:09.395633    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/46580ed5-4a2f-4ca5-be71-19d2870e4dcf-model-cache\") pod \"sub-test-model-1381a9-kserve-59449849bf-4gwhp\" (UID: \"46580ed5-4a2f-4ca5-be71-19d2870e4dcf\") " pod="ai-tenant-e2e-shared-a-1381a9/sub-test-model-1381a9-kserve-59449849bf-4gwhp"
Jul 02 17:53:09.395704 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:09.395651    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46580ed5-4a2f-4ca5-be71-19d2870e4dcf-tls-certs\") pod \"sub-test-model-1381a9-kserve-59449849bf-4gwhp\" (UID: \"46580ed5-4a2f-4ca5-be71-19d2870e4dcf\") " pod="ai-tenant-e2e-shared-a-1381a9/sub-test-model-1381a9-kserve-59449849bf-4gwhp"
Jul 02 17:53:09.395704 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:09.395670    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/46580ed5-4a2f-4ca5-be71-19d2870e4dcf-dshm\") pod \"sub-test-model-1381a9-kserve-59449849bf-4gwhp\" (UID: \"46580ed5-4a2f-4ca5-be71-19d2870e4dcf\") " pod="ai-tenant-e2e-shared-a-1381a9/sub-test-model-1381a9-kserve-59449849bf-4gwhp"
Jul 02 17:53:09.395704 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:09.395685    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9l54x\" (UniqueName: \"kubernetes.io/projected/46580ed5-4a2f-4ca5-be71-19d2870e4dcf-kube-api-access-9l54x\") pod \"sub-test-model-1381a9-kserve-59449849bf-4gwhp\" (UID: \"46580ed5-4a2f-4ca5-be71-19d2870e4dcf\") " pod="ai-tenant-e2e-shared-a-1381a9/sub-test-model-1381a9-kserve-59449849bf-4gwhp"
Jul 02 17:53:09.395866 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:09.395746    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/46580ed5-4a2f-4ca5-be71-19d2870e4dcf-home\") pod \"sub-test-model-1381a9-kserve-59449849bf-4gwhp\" (UID: \"46580ed5-4a2f-4ca5-be71-19d2870e4dcf\") " pod="ai-tenant-e2e-shared-a-1381a9/sub-test-model-1381a9-kserve-59449849bf-4gwhp"
Jul 02 17:53:09.396010 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:09.395988    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46580ed5-4a2f-4ca5-be71-19d2870e4dcf-tmp-dir\") pod \"sub-test-model-1381a9-kserve-59449849bf-4gwhp\" (UID: \"46580ed5-4a2f-4ca5-be71-19d2870e4dcf\") " pod="ai-tenant-e2e-shared-a-1381a9/sub-test-model-1381a9-kserve-59449849bf-4gwhp"
Jul 02 17:53:09.396094 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:09.396047    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/46580ed5-4a2f-4ca5-be71-19d2870e4dcf-model-cache\") pod \"sub-test-model-1381a9-kserve-59449849bf-4gwhp\" (UID: \"46580ed5-4a2f-4ca5-be71-19d2870e4dcf\") " pod="ai-tenant-e2e-shared-a-1381a9/sub-test-model-1381a9-kserve-59449849bf-4gwhp"
Jul 02 17:53:09.396135 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:09.396099    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/46580ed5-4a2f-4ca5-be71-19d2870e4dcf-home\") pod \"sub-test-model-1381a9-kserve-59449849bf-4gwhp\" (UID: \"46580ed5-4a2f-4ca5-be71-19d2870e4dcf\") " pod="ai-tenant-e2e-shared-a-1381a9/sub-test-model-1381a9-kserve-59449849bf-4gwhp"
Jul 02 17:53:09.397747 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:09.397729    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/46580ed5-4a2f-4ca5-be71-19d2870e4dcf-dshm\") pod \"sub-test-model-1381a9-kserve-59449849bf-4gwhp\" (UID: \"46580ed5-4a2f-4ca5-be71-19d2870e4dcf\") " pod="ai-tenant-e2e-shared-a-1381a9/sub-test-model-1381a9-kserve-59449849bf-4gwhp"
Jul 02 17:53:09.397937 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:09.397923    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46580ed5-4a2f-4ca5-be71-19d2870e4dcf-tls-certs\") pod \"sub-test-model-1381a9-kserve-59449849bf-4gwhp\" (UID: \"46580ed5-4a2f-4ca5-be71-19d2870e4dcf\") " pod="ai-tenant-e2e-shared-a-1381a9/sub-test-model-1381a9-kserve-59449849bf-4gwhp"
Jul 02 17:53:09.403723 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:09.403705    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9l54x\" (UniqueName: \"kubernetes.io/projected/46580ed5-4a2f-4ca5-be71-19d2870e4dcf-kube-api-access-9l54x\") pod \"sub-test-model-1381a9-kserve-59449849bf-4gwhp\" (UID: \"46580ed5-4a2f-4ca5-be71-19d2870e4dcf\") " pod="ai-tenant-e2e-shared-a-1381a9/sub-test-model-1381a9-kserve-59449849bf-4gwhp"
Jul 02 17:53:09.496370 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:09.496347    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="389ab8ec-401b-4f20-811c-31cd22aea2aa" path="/var/lib/kubelet/pods/389ab8ec-401b-4f20-811c-31cd22aea2aa/volumes"
Jul 02 17:53:09.567371 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:09.567346    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-1381a9/sub-test-model-1381a9-kserve-59449849bf-4gwhp"
Jul 02 17:53:09.624193 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:09.624168    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d1bf18/auth-test-model-d1bf18-kserve-6569d55cf5-ccm2h"
Jul 02 17:53:09.698679 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:09.698641    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/275623ef-1a90-43e8-a8a8-ffefc4a84e3e-home\") pod \"275623ef-1a90-43e8-a8a8-ffefc4a84e3e\" (UID: \"275623ef-1a90-43e8-a8a8-ffefc4a84e3e\") "
Jul 02 17:53:09.698890 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:09.698874    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/275623ef-1a90-43e8-a8a8-ffefc4a84e3e-model-cache\") pod \"275623ef-1a90-43e8-a8a8-ffefc4a84e3e\" (UID: \"275623ef-1a90-43e8-a8a8-ffefc4a84e3e\") "
Jul 02 17:53:09.699009 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:09.698997    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/275623ef-1a90-43e8-a8a8-ffefc4a84e3e-tls-certs\") pod \"275623ef-1a90-43e8-a8a8-ffefc4a84e3e\" (UID: \"275623ef-1a90-43e8-a8a8-ffefc4a84e3e\") "
Jul 02 17:53:09.699141 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:09.699127    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fm8w4\" (UniqueName: \"kubernetes.io/projected/275623ef-1a90-43e8-a8a8-ffefc4a84e3e-kube-api-access-fm8w4\") pod \"275623ef-1a90-43e8-a8a8-ffefc4a84e3e\" (UID: \"275623ef-1a90-43e8-a8a8-ffefc4a84e3e\") "
Jul 02 17:53:09.699291 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:09.699276    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/275623ef-1a90-43e8-a8a8-ffefc4a84e3e-dshm\") pod \"275623ef-1a90-43e8-a8a8-ffefc4a84e3e\" (UID: \"275623ef-1a90-43e8-a8a8-ffefc4a84e3e\") "
Jul 02 17:53:09.699438 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:09.699426    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/275623ef-1a90-43e8-a8a8-ffefc4a84e3e-tmp-dir\") pod \"275623ef-1a90-43e8-a8a8-ffefc4a84e3e\" (UID: \"275623ef-1a90-43e8-a8a8-ffefc4a84e3e\") "
Jul 02 17:53:09.700229 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:09.700207    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/275623ef-1a90-43e8-a8a8-ffefc4a84e3e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "275623ef-1a90-43e8-a8a8-ffefc4a84e3e" (UID: "275623ef-1a90-43e8-a8a8-ffefc4a84e3e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:53:09.700534 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:09.700517    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/275623ef-1a90-43e8-a8a8-ffefc4a84e3e-home" (OuterVolumeSpecName: "home") pod "275623ef-1a90-43e8-a8a8-ffefc4a84e3e" (UID: "275623ef-1a90-43e8-a8a8-ffefc4a84e3e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:53:09.700789 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:09.700773    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/275623ef-1a90-43e8-a8a8-ffefc4a84e3e-model-cache" (OuterVolumeSpecName: "model-cache") pod "275623ef-1a90-43e8-a8a8-ffefc4a84e3e" (UID: "275623ef-1a90-43e8-a8a8-ffefc4a84e3e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:53:09.705961 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:09.705134    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/275623ef-1a90-43e8-a8a8-ffefc4a84e3e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "275623ef-1a90-43e8-a8a8-ffefc4a84e3e" (UID: "275623ef-1a90-43e8-a8a8-ffefc4a84e3e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 17:53:09.706582 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:09.706404    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-1381a9/sub-test-model-1381a9-kserve-59449849bf-4gwhp"]
Jul 02 17:53:09.707416 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:09.707392    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/275623ef-1a90-43e8-a8a8-ffefc4a84e3e-kube-api-access-fm8w4" (OuterVolumeSpecName: "kube-api-access-fm8w4") pod "275623ef-1a90-43e8-a8a8-ffefc4a84e3e" (UID: "275623ef-1a90-43e8-a8a8-ffefc4a84e3e"). InnerVolumeSpecName "kube-api-access-fm8w4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 17:53:09.707945 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:09.707922    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/275623ef-1a90-43e8-a8a8-ffefc4a84e3e-dshm" (OuterVolumeSpecName: "dshm") pod "275623ef-1a90-43e8-a8a8-ffefc4a84e3e" (UID: "275623ef-1a90-43e8-a8a8-ffefc4a84e3e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:53:09.708130 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:53:09.708105    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod46580ed5_4a2f_4ca5_be71_19d2870e4dcf.slice/crio-b198cad7964460b834d6caa8f3d13250ac7a96318e8f056ef5eb1481bb0f2aed WatchSource:0}: Error finding container b198cad7964460b834d6caa8f3d13250ac7a96318e8f056ef5eb1481bb0f2aed: Status 404 returned error can't find the container with id b198cad7964460b834d6caa8f3d13250ac7a96318e8f056ef5eb1481bb0f2aed
Jul 02 17:53:09.800798 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:09.800765    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/275623ef-1a90-43e8-a8a8-ffefc4a84e3e-home\") on node \"ip-10-0-143-67.ec2.internal\" DevicePath \"\""
Jul 02 17:53:09.800798 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:09.800790    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/275623ef-1a90-43e8-a8a8-ffefc4a84e3e-model-cache\") on node \"ip-10-0-143-67.ec2.internal\" DevicePath \"\""
Jul 02 17:53:09.800798 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:09.800800    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/275623ef-1a90-43e8-a8a8-ffefc4a84e3e-tls-certs\") on node \"ip-10-0-143-67.ec2.internal\" DevicePath \"\""
Jul 02 17:53:09.801007 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:09.800808    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fm8w4\" (UniqueName: \"kubernetes.io/projected/275623ef-1a90-43e8-a8a8-ffefc4a84e3e-kube-api-access-fm8w4\") on node \"ip-10-0-143-67.ec2.internal\" DevicePath \"\""
Jul 02 17:53:09.801007 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:09.800818    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/275623ef-1a90-43e8-a8a8-ffefc4a84e3e-dshm\") on node \"ip-10-0-143-67.ec2.internal\" DevicePath \"\""
Jul 02 17:53:09.801007 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:09.800828    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/275623ef-1a90-43e8-a8a8-ffefc4a84e3e-tmp-dir\") on node \"ip-10-0-143-67.ec2.internal\" DevicePath \"\""
Jul 02 17:53:10.117397 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:10.117363    2578 generic.go:356] "Generic (PLEG): container finished" podID="275623ef-1a90-43e8-a8a8-ffefc4a84e3e" containerID="b130c49e062f16ebda3f233a05dd9210a4efa6e82fc5da9cac3fefbbd9eb4a69" exitCode=0
Jul 02 17:53:10.117576 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:10.117422    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d1bf18/auth-test-model-d1bf18-kserve-6569d55cf5-ccm2h"
Jul 02 17:53:10.117576 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:10.117454    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d1bf18/auth-test-model-d1bf18-kserve-6569d55cf5-ccm2h" event={"ID":"275623ef-1a90-43e8-a8a8-ffefc4a84e3e","Type":"ContainerDied","Data":"b130c49e062f16ebda3f233a05dd9210a4efa6e82fc5da9cac3fefbbd9eb4a69"}
Jul 02 17:53:10.117576 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:10.117493    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d1bf18/auth-test-model-d1bf18-kserve-6569d55cf5-ccm2h" event={"ID":"275623ef-1a90-43e8-a8a8-ffefc4a84e3e","Type":"ContainerDied","Data":"0a1d3afd53199e5fdf83f55f60c57e0a0e2566d2fb463d4f97321311963c53ad"}
Jul 02 17:53:10.117576 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:10.117513    2578 scope.go:117] "RemoveContainer" containerID="b130c49e062f16ebda3f233a05dd9210a4efa6e82fc5da9cac3fefbbd9eb4a69"
Jul 02 17:53:10.119240 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:10.119213    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-1381a9/sub-test-model-1381a9-kserve-59449849bf-4gwhp" event={"ID":"46580ed5-4a2f-4ca5-be71-19d2870e4dcf","Type":"ContainerStarted","Data":"ecedd75bf991eb3ede9b2d46fd126a3bb16845cbf59bc6acb166a4124f79f61e"}
Jul 02 17:53:10.119373 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:10.119250    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-1381a9/sub-test-model-1381a9-kserve-59449849bf-4gwhp" event={"ID":"46580ed5-4a2f-4ca5-be71-19d2870e4dcf","Type":"ContainerStarted","Data":"b198cad7964460b834d6caa8f3d13250ac7a96318e8f056ef5eb1481bb0f2aed"}
Jul 02 17:53:10.128209 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:10.128168    2578 scope.go:117] "RemoveContainer" containerID="b130c49e062f16ebda3f233a05dd9210a4efa6e82fc5da9cac3fefbbd9eb4a69"
Jul 02 17:53:10.128463 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:53:10.128444    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b130c49e062f16ebda3f233a05dd9210a4efa6e82fc5da9cac3fefbbd9eb4a69\": container with ID starting with b130c49e062f16ebda3f233a05dd9210a4efa6e82fc5da9cac3fefbbd9eb4a69 not found: ID does not exist" containerID="b130c49e062f16ebda3f233a05dd9210a4efa6e82fc5da9cac3fefbbd9eb4a69"
Jul 02 17:53:10.128530 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:10.128475    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b130c49e062f16ebda3f233a05dd9210a4efa6e82fc5da9cac3fefbbd9eb4a69"} err="failed to get container status \"b130c49e062f16ebda3f233a05dd9210a4efa6e82fc5da9cac3fefbbd9eb4a69\": rpc error: code = NotFound desc = could not find container \"b130c49e062f16ebda3f233a05dd9210a4efa6e82fc5da9cac3fefbbd9eb4a69\": container with ID starting with b130c49e062f16ebda3f233a05dd9210a4efa6e82fc5da9cac3fefbbd9eb4a69 not found: ID does not exist"
Jul 02 17:53:10.138194 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:10.138157    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-1381a9/sub-test-model-1381a9-kserve-59449849bf-4gwhp" podStartSLOduration=1.138144005 podStartE2EDuration="1.138144005s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:53:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:53:10.137124606 +0000 UTC m=+2545.326827270" watchObservedRunningTime="2026-07-02 17:53:10.138144005 +0000 UTC m=+2545.327846667"
Jul 02 17:53:10.150548 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:10.150525    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-d1bf18/auth-test-model-d1bf18-kserve-6569d55cf5-ccm2h"]
Jul 02 17:53:10.154605 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:10.154580    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-d1bf18/auth-test-model-d1bf18-kserve-6569d55cf5-ccm2h"]
Jul 02 17:53:11.496305 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:11.496270    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="275623ef-1a90-43e8-a8a8-ffefc4a84e3e" path="/var/lib/kubelet/pods/275623ef-1a90-43e8-a8a8-ffefc4a84e3e/volumes"
Jul 02 17:53:11.536674 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:11.536642    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:53:19.567756 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:19.567715    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-1381a9/sub-test-model-1381a9-kserve-59449849bf-4gwhp"
Jul 02 17:53:19.567756 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:19.567766    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-1381a9/sub-test-model-1381a9-kserve-59449849bf-4gwhp"
Jul 02 17:53:19.580709 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:19.580672    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-1381a9/sub-test-model-1381a9-kserve-59449849bf-4gwhp"
Jul 02 17:53:20.187935 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:20.187907    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-1381a9/sub-test-model-1381a9-kserve-59449849bf-4gwhp"
Jul 02 17:53:22.748257 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:22.748225    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:53:27.146138 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:27.146106    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-d1bf18/sub-test-model-d1bf18-kserve-5c99878979-7pm5k"]
Jul 02 17:53:27.146586 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:27.146457    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="275623ef-1a90-43e8-a8a8-ffefc4a84e3e" containerName="main"
Jul 02 17:53:27.146586 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:27.146467    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="275623ef-1a90-43e8-a8a8-ffefc4a84e3e" containerName="main"
Jul 02 17:53:27.146586 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:27.146542    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="275623ef-1a90-43e8-a8a8-ffefc4a84e3e" containerName="main"
Jul 02 17:53:27.149639 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:27.149621    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d1bf18/sub-test-model-d1bf18-kserve-5c99878979-7pm5k"
Jul 02 17:53:27.152426 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:27.152405    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-d1bf18\"/\"kube-root-ca.crt\""
Jul 02 17:53:27.154024 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:27.153982    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-d1bf18\"/\"default-dockercfg-nvs86\""
Jul 02 17:53:27.154119 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:27.154043    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-d1bf18\"/\"openshift-service-ca.crt\""
Jul 02 17:53:27.154119 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:27.154046    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-d1bf18\"/\"sub-test-model-d1bf18-kserve-self-signed-certs\""
Jul 02 17:53:27.159593 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:27.159238    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-d1bf18/sub-test-model-d1bf18-kserve-5c99878979-7pm5k"]
Jul 02 17:53:27.222327 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:27.222292    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:53:27.248101 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:27.248066    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67b0d698-5003-4770-9c28-384f01946da0-tmp-dir\") pod \"sub-test-model-d1bf18-kserve-5c99878979-7pm5k\" (UID: \"67b0d698-5003-4770-9c28-384f01946da0\") " pod="ai-tenant-e2e-shared-b-d1bf18/sub-test-model-d1bf18-kserve-5c99878979-7pm5k"
Jul 02 17:53:27.248240 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:27.248124    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/67b0d698-5003-4770-9c28-384f01946da0-home\") pod \"sub-test-model-d1bf18-kserve-5c99878979-7pm5k\" (UID: \"67b0d698-5003-4770-9c28-384f01946da0\") " pod="ai-tenant-e2e-shared-b-d1bf18/sub-test-model-d1bf18-kserve-5c99878979-7pm5k"
Jul 02 17:53:27.248240 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:27.248208    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngksg\" (UniqueName: \"kubernetes.io/projected/67b0d698-5003-4770-9c28-384f01946da0-kube-api-access-ngksg\") pod \"sub-test-model-d1bf18-kserve-5c99878979-7pm5k\" (UID: \"67b0d698-5003-4770-9c28-384f01946da0\") " pod="ai-tenant-e2e-shared-b-d1bf18/sub-test-model-d1bf18-kserve-5c99878979-7pm5k"
Jul 02 17:53:27.248369 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:27.248245    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/67b0d698-5003-4770-9c28-384f01946da0-model-cache\") pod \"sub-test-model-d1bf18-kserve-5c99878979-7pm5k\" (UID: \"67b0d698-5003-4770-9c28-384f01946da0\") " pod="ai-tenant-e2e-shared-b-d1bf18/sub-test-model-d1bf18-kserve-5c99878979-7pm5k"
Jul 02 17:53:27.248369 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:27.248309    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67b0d698-5003-4770-9c28-384f01946da0-tls-certs\") pod \"sub-test-model-d1bf18-kserve-5c99878979-7pm5k\" (UID: \"67b0d698-5003-4770-9c28-384f01946da0\") " pod="ai-tenant-e2e-shared-b-d1bf18/sub-test-model-d1bf18-kserve-5c99878979-7pm5k"
Jul 02 17:53:27.248446 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:27.248383    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/67b0d698-5003-4770-9c28-384f01946da0-dshm\") pod \"sub-test-model-d1bf18-kserve-5c99878979-7pm5k\" (UID: \"67b0d698-5003-4770-9c28-384f01946da0\") " pod="ai-tenant-e2e-shared-b-d1bf18/sub-test-model-d1bf18-kserve-5c99878979-7pm5k"
Jul 02 17:53:27.349830 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:27.349792    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/67b0d698-5003-4770-9c28-384f01946da0-home\") pod \"sub-test-model-d1bf18-kserve-5c99878979-7pm5k\" (UID: \"67b0d698-5003-4770-9c28-384f01946da0\") " pod="ai-tenant-e2e-shared-b-d1bf18/sub-test-model-d1bf18-kserve-5c99878979-7pm5k"
Jul 02 17:53:27.350005 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:27.349845    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngksg\" (UniqueName: \"kubernetes.io/projected/67b0d698-5003-4770-9c28-384f01946da0-kube-api-access-ngksg\") pod \"sub-test-model-d1bf18-kserve-5c99878979-7pm5k\" (UID: \"67b0d698-5003-4770-9c28-384f01946da0\") " pod="ai-tenant-e2e-shared-b-d1bf18/sub-test-model-d1bf18-kserve-5c99878979-7pm5k"
Jul 02 17:53:27.350005 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:27.349969    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/67b0d698-5003-4770-9c28-384f01946da0-model-cache\") pod \"sub-test-model-d1bf18-kserve-5c99878979-7pm5k\" (UID: \"67b0d698-5003-4770-9c28-384f01946da0\") " pod="ai-tenant-e2e-shared-b-d1bf18/sub-test-model-d1bf18-kserve-5c99878979-7pm5k"
Jul 02 17:53:27.350134 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:27.350059    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67b0d698-5003-4770-9c28-384f01946da0-tls-certs\") pod \"sub-test-model-d1bf18-kserve-5c99878979-7pm5k\" (UID: \"67b0d698-5003-4770-9c28-384f01946da0\") " pod="ai-tenant-e2e-shared-b-d1bf18/sub-test-model-d1bf18-kserve-5c99878979-7pm5k"
Jul 02 17:53:27.350175 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:27.350151    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/67b0d698-5003-4770-9c28-384f01946da0-dshm\") pod \"sub-test-model-d1bf18-kserve-5c99878979-7pm5k\" (UID: \"67b0d698-5003-4770-9c28-384f01946da0\") " pod="ai-tenant-e2e-shared-b-d1bf18/sub-test-model-d1bf18-kserve-5c99878979-7pm5k"
Jul 02 17:53:27.350217 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:27.350201    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67b0d698-5003-4770-9c28-384f01946da0-tmp-dir\") pod \"sub-test-model-d1bf18-kserve-5c99878979-7pm5k\" (UID: \"67b0d698-5003-4770-9c28-384f01946da0\") " pod="ai-tenant-e2e-shared-b-d1bf18/sub-test-model-d1bf18-kserve-5c99878979-7pm5k"
Jul 02 17:53:27.350290 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:27.350269    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/67b0d698-5003-4770-9c28-384f01946da0-home\") pod \"sub-test-model-d1bf18-kserve-5c99878979-7pm5k\" (UID: \"67b0d698-5003-4770-9c28-384f01946da0\") " pod="ai-tenant-e2e-shared-b-d1bf18/sub-test-model-d1bf18-kserve-5c99878979-7pm5k"
Jul 02 17:53:27.350373 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:27.350352    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/67b0d698-5003-4770-9c28-384f01946da0-model-cache\") pod \"sub-test-model-d1bf18-kserve-5c99878979-7pm5k\" (UID: \"67b0d698-5003-4770-9c28-384f01946da0\") " pod="ai-tenant-e2e-shared-b-d1bf18/sub-test-model-d1bf18-kserve-5c99878979-7pm5k"
Jul 02 17:53:27.350457 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:27.350440    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67b0d698-5003-4770-9c28-384f01946da0-tmp-dir\") pod \"sub-test-model-d1bf18-kserve-5c99878979-7pm5k\" (UID: \"67b0d698-5003-4770-9c28-384f01946da0\") " pod="ai-tenant-e2e-shared-b-d1bf18/sub-test-model-d1bf18-kserve-5c99878979-7pm5k"
Jul 02 17:53:27.352407 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:27.352380    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/67b0d698-5003-4770-9c28-384f01946da0-dshm\") pod \"sub-test-model-d1bf18-kserve-5c99878979-7pm5k\" (UID: \"67b0d698-5003-4770-9c28-384f01946da0\") " pod="ai-tenant-e2e-shared-b-d1bf18/sub-test-model-d1bf18-kserve-5c99878979-7pm5k"
Jul 02 17:53:27.352547 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:27.352531    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67b0d698-5003-4770-9c28-384f01946da0-tls-certs\") pod \"sub-test-model-d1bf18-kserve-5c99878979-7pm5k\" (UID: \"67b0d698-5003-4770-9c28-384f01946da0\") " pod="ai-tenant-e2e-shared-b-d1bf18/sub-test-model-d1bf18-kserve-5c99878979-7pm5k"
Jul 02 17:53:27.357321 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:27.357298    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngksg\" (UniqueName: \"kubernetes.io/projected/67b0d698-5003-4770-9c28-384f01946da0-kube-api-access-ngksg\") pod \"sub-test-model-d1bf18-kserve-5c99878979-7pm5k\" (UID: \"67b0d698-5003-4770-9c28-384f01946da0\") " pod="ai-tenant-e2e-shared-b-d1bf18/sub-test-model-d1bf18-kserve-5c99878979-7pm5k"
Jul 02 17:53:27.461753 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:27.461670    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d1bf18/sub-test-model-d1bf18-kserve-5c99878979-7pm5k"
Jul 02 17:53:27.599276 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:27.599239    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-d1bf18/sub-test-model-d1bf18-kserve-5c99878979-7pm5k"]
Jul 02 17:53:27.601635 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:53:27.601610    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod67b0d698_5003_4770_9c28_384f01946da0.slice/crio-1b587b31c76d32df7f730deff0048abec0de1d5b0b74ca456aaa6d9d431f0bb6 WatchSource:0}: Error finding container 1b587b31c76d32df7f730deff0048abec0de1d5b0b74ca456aaa6d9d431f0bb6: Status 404 returned error can't find the container with id 1b587b31c76d32df7f730deff0048abec0de1d5b0b74ca456aaa6d9d431f0bb6
Jul 02 17:53:28.215432 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:28.215399    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d1bf18/sub-test-model-d1bf18-kserve-5c99878979-7pm5k" event={"ID":"67b0d698-5003-4770-9c28-384f01946da0","Type":"ContainerStarted","Data":"9fc911b2a985da9313fab95a8f77ad5ee90641dede679802dd22b37f5333fe04"}
Jul 02 17:53:28.215814 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:28.215441    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d1bf18/sub-test-model-d1bf18-kserve-5c99878979-7pm5k" event={"ID":"67b0d698-5003-4770-9c28-384f01946da0","Type":"ContainerStarted","Data":"1b587b31c76d32df7f730deff0048abec0de1d5b0b74ca456aaa6d9d431f0bb6"}
Jul 02 17:53:28.233062 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:28.233003    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-d1bf18/sub-test-model-d1bf18-kserve-5c99878979-7pm5k" podStartSLOduration=1.232990005 podStartE2EDuration="1.232990005s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:53:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:53:28.230711293 +0000 UTC m=+2563.420413957" watchObservedRunningTime="2026-07-02 17:53:28.232990005 +0000 UTC m=+2563.422692667"
Jul 02 17:53:33.653850 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:33.653811    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:53:34.797742 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:34.797708    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:53:37.462112 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:37.462074    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-d1bf18/sub-test-model-d1bf18-kserve-5c99878979-7pm5k"
Jul 02 17:53:37.462112 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:37.462119    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-d1bf18/sub-test-model-d1bf18-kserve-5c99878979-7pm5k"
Jul 02 17:53:37.474257 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:37.474231    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-d1bf18/sub-test-model-d1bf18-kserve-5c99878979-7pm5k"
Jul 02 17:53:38.281101 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:38.281073    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-d1bf18/sub-test-model-d1bf18-kserve-5c99878979-7pm5k"
Jul 02 17:53:44.978009 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:44.977976    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:53:47.645386 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:47.645347    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:53:57.352435 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:57.352403    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:53:57.450826 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:53:57.450794    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:54:02.929229 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:02.929194    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-1381a9/sub-test-model-1381a9-kserve-59449849bf-4gwhp"]
Jul 02 17:54:02.947925 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:02.947900    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:54:03.841870 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:03.841840    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-d1bf18/sub-test-model-d1bf18-kserve-5c99878979-7pm5k"]
Jul 02 17:54:03.854538 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:03.854515    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:54:07.874934 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:07.874842    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:54:16.350468 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:16.350427    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-1381a9/rate-test-model-1381a9-kserve-dbbb7875f-w8n78"]
Jul 02 17:54:16.354237 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:16.354216    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-1381a9/rate-test-model-1381a9-kserve-dbbb7875f-w8n78"
Jul 02 17:54:16.356868 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:16.356846    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-1381a9\"/\"rate-test-model-1381a9-kserve-self-signed-certs\""
Jul 02 17:54:16.364931 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:16.364906    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-1381a9/rate-test-model-1381a9-kserve-dbbb7875f-w8n78"]
Jul 02 17:54:16.386663 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:16.386636    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:54:16.467641 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:16.467615    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd28622b-6c88-49c6-b4d9-a8208ce3e081-tls-certs\") pod \"rate-test-model-1381a9-kserve-dbbb7875f-w8n78\" (UID: \"cd28622b-6c88-49c6-b4d9-a8208ce3e081\") " pod="ai-tenant-e2e-shared-a-1381a9/rate-test-model-1381a9-kserve-dbbb7875f-w8n78"
Jul 02 17:54:16.467745 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:16.467652    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd28622b-6c88-49c6-b4d9-a8208ce3e081-dshm\") pod \"rate-test-model-1381a9-kserve-dbbb7875f-w8n78\" (UID: \"cd28622b-6c88-49c6-b4d9-a8208ce3e081\") " pod="ai-tenant-e2e-shared-a-1381a9/rate-test-model-1381a9-kserve-dbbb7875f-w8n78"
Jul 02 17:54:16.467745 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:16.467681    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd28622b-6c88-49c6-b4d9-a8208ce3e081-tmp-dir\") pod \"rate-test-model-1381a9-kserve-dbbb7875f-w8n78\" (UID: \"cd28622b-6c88-49c6-b4d9-a8208ce3e081\") " pod="ai-tenant-e2e-shared-a-1381a9/rate-test-model-1381a9-kserve-dbbb7875f-w8n78"
Jul 02 17:54:16.467847 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:16.467780    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd28622b-6c88-49c6-b4d9-a8208ce3e081-home\") pod \"rate-test-model-1381a9-kserve-dbbb7875f-w8n78\" (UID: \"cd28622b-6c88-49c6-b4d9-a8208ce3e081\") " pod="ai-tenant-e2e-shared-a-1381a9/rate-test-model-1381a9-kserve-dbbb7875f-w8n78"
Jul 02 17:54:16.467847 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:16.467816    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ngkp\" (UniqueName: \"kubernetes.io/projected/cd28622b-6c88-49c6-b4d9-a8208ce3e081-kube-api-access-8ngkp\") pod \"rate-test-model-1381a9-kserve-dbbb7875f-w8n78\" (UID: \"cd28622b-6c88-49c6-b4d9-a8208ce3e081\") " pod="ai-tenant-e2e-shared-a-1381a9/rate-test-model-1381a9-kserve-dbbb7875f-w8n78"
Jul 02 17:54:16.467923 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:16.467865    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd28622b-6c88-49c6-b4d9-a8208ce3e081-model-cache\") pod \"rate-test-model-1381a9-kserve-dbbb7875f-w8n78\" (UID: \"cd28622b-6c88-49c6-b4d9-a8208ce3e081\") " pod="ai-tenant-e2e-shared-a-1381a9/rate-test-model-1381a9-kserve-dbbb7875f-w8n78"
Jul 02 17:54:16.569216 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:16.569191    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd28622b-6c88-49c6-b4d9-a8208ce3e081-model-cache\") pod \"rate-test-model-1381a9-kserve-dbbb7875f-w8n78\" (UID: \"cd28622b-6c88-49c6-b4d9-a8208ce3e081\") " pod="ai-tenant-e2e-shared-a-1381a9/rate-test-model-1381a9-kserve-dbbb7875f-w8n78"
Jul 02 17:54:16.569328 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:16.569259    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd28622b-6c88-49c6-b4d9-a8208ce3e081-tls-certs\") pod \"rate-test-model-1381a9-kserve-dbbb7875f-w8n78\" (UID: \"cd28622b-6c88-49c6-b4d9-a8208ce3e081\") " pod="ai-tenant-e2e-shared-a-1381a9/rate-test-model-1381a9-kserve-dbbb7875f-w8n78"
Jul 02 17:54:16.569328 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:16.569294    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd28622b-6c88-49c6-b4d9-a8208ce3e081-dshm\") pod \"rate-test-model-1381a9-kserve-dbbb7875f-w8n78\" (UID: \"cd28622b-6c88-49c6-b4d9-a8208ce3e081\") " pod="ai-tenant-e2e-shared-a-1381a9/rate-test-model-1381a9-kserve-dbbb7875f-w8n78"
Jul 02 17:54:16.569328 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:16.569321    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd28622b-6c88-49c6-b4d9-a8208ce3e081-tmp-dir\") pod \"rate-test-model-1381a9-kserve-dbbb7875f-w8n78\" (UID: \"cd28622b-6c88-49c6-b4d9-a8208ce3e081\") " pod="ai-tenant-e2e-shared-a-1381a9/rate-test-model-1381a9-kserve-dbbb7875f-w8n78"
Jul 02 17:54:16.569489 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:16.569355    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd28622b-6c88-49c6-b4d9-a8208ce3e081-home\") pod \"rate-test-model-1381a9-kserve-dbbb7875f-w8n78\" (UID: \"cd28622b-6c88-49c6-b4d9-a8208ce3e081\") " pod="ai-tenant-e2e-shared-a-1381a9/rate-test-model-1381a9-kserve-dbbb7875f-w8n78"
Jul 02 17:54:16.569489 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:16.569399    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ngkp\" (UniqueName: \"kubernetes.io/projected/cd28622b-6c88-49c6-b4d9-a8208ce3e081-kube-api-access-8ngkp\") pod \"rate-test-model-1381a9-kserve-dbbb7875f-w8n78\" (UID: \"cd28622b-6c88-49c6-b4d9-a8208ce3e081\") " pod="ai-tenant-e2e-shared-a-1381a9/rate-test-model-1381a9-kserve-dbbb7875f-w8n78"
Jul 02 17:54:16.569633 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:16.569608    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd28622b-6c88-49c6-b4d9-a8208ce3e081-model-cache\") pod \"rate-test-model-1381a9-kserve-dbbb7875f-w8n78\" (UID: \"cd28622b-6c88-49c6-b4d9-a8208ce3e081\") " pod="ai-tenant-e2e-shared-a-1381a9/rate-test-model-1381a9-kserve-dbbb7875f-w8n78"
Jul 02 17:54:16.569747 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:16.569635    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd28622b-6c88-49c6-b4d9-a8208ce3e081-tmp-dir\") pod \"rate-test-model-1381a9-kserve-dbbb7875f-w8n78\" (UID: \"cd28622b-6c88-49c6-b4d9-a8208ce3e081\") " pod="ai-tenant-e2e-shared-a-1381a9/rate-test-model-1381a9-kserve-dbbb7875f-w8n78"
Jul 02 17:54:16.569800 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:16.569755    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd28622b-6c88-49c6-b4d9-a8208ce3e081-home\") pod \"rate-test-model-1381a9-kserve-dbbb7875f-w8n78\" (UID: \"cd28622b-6c88-49c6-b4d9-a8208ce3e081\") " pod="ai-tenant-e2e-shared-a-1381a9/rate-test-model-1381a9-kserve-dbbb7875f-w8n78"
Jul 02 17:54:16.571646 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:16.571627    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd28622b-6c88-49c6-b4d9-a8208ce3e081-dshm\") pod \"rate-test-model-1381a9-kserve-dbbb7875f-w8n78\" (UID: \"cd28622b-6c88-49c6-b4d9-a8208ce3e081\") " pod="ai-tenant-e2e-shared-a-1381a9/rate-test-model-1381a9-kserve-dbbb7875f-w8n78"
Jul 02 17:54:16.571788 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:16.571772    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd28622b-6c88-49c6-b4d9-a8208ce3e081-tls-certs\") pod \"rate-test-model-1381a9-kserve-dbbb7875f-w8n78\" (UID: \"cd28622b-6c88-49c6-b4d9-a8208ce3e081\") " pod="ai-tenant-e2e-shared-a-1381a9/rate-test-model-1381a9-kserve-dbbb7875f-w8n78"
Jul 02 17:54:16.577603 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:16.577586    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ngkp\" (UniqueName: \"kubernetes.io/projected/cd28622b-6c88-49c6-b4d9-a8208ce3e081-kube-api-access-8ngkp\") pod \"rate-test-model-1381a9-kserve-dbbb7875f-w8n78\" (UID: \"cd28622b-6c88-49c6-b4d9-a8208ce3e081\") " pod="ai-tenant-e2e-shared-a-1381a9/rate-test-model-1381a9-kserve-dbbb7875f-w8n78"
Jul 02 17:54:16.664305 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:16.664252    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-1381a9/rate-test-model-1381a9-kserve-dbbb7875f-w8n78"
Jul 02 17:54:16.794985 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:16.794956    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-1381a9/rate-test-model-1381a9-kserve-dbbb7875f-w8n78"]
Jul 02 17:54:16.797431 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:54:16.797409    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcd28622b_6c88_49c6_b4d9_a8208ce3e081.slice/crio-126e630f20db3ca2ebf9880afc0697da65041b6e5fee62ba3bc786ea107f3983 WatchSource:0}: Error finding container 126e630f20db3ca2ebf9880afc0697da65041b6e5fee62ba3bc786ea107f3983: Status 404 returned error can't find the container with id 126e630f20db3ca2ebf9880afc0697da65041b6e5fee62ba3bc786ea107f3983
Jul 02 17:54:17.469546 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:17.469511    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-1381a9/rate-test-model-1381a9-kserve-dbbb7875f-w8n78" event={"ID":"cd28622b-6c88-49c6-b4d9-a8208ce3e081","Type":"ContainerStarted","Data":"2e8b256b3054738773f139fde79c5ae9b84889c1a4fec895a4cca83c7157e191"}
Jul 02 17:54:17.469921 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:17.469554    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-1381a9/rate-test-model-1381a9-kserve-dbbb7875f-w8n78" event={"ID":"cd28622b-6c88-49c6-b4d9-a8208ce3e081","Type":"ContainerStarted","Data":"126e630f20db3ca2ebf9880afc0697da65041b6e5fee62ba3bc786ea107f3983"}
Jul 02 17:54:17.487513 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:17.487467    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-1381a9/rate-test-model-1381a9-kserve-dbbb7875f-w8n78" podStartSLOduration=1.487452109 podStartE2EDuration="1.487452109s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:54:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:54:17.486130127 +0000 UTC m=+2612.675832789" watchObservedRunningTime="2026-07-02 17:54:17.487452109 +0000 UTC m=+2612.677154770"
Jul 02 17:54:17.955120 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:17.954823    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-1381a9/sub-test-model-1381a9-kserve-59449849bf-4gwhp" podUID="46580ed5-4a2f-4ca5-be71-19d2870e4dcf" containerName="main" containerID="cri-o://ecedd75bf991eb3ede9b2d46fd126a3bb16845cbf59bc6acb166a4124f79f61e" gracePeriod=45
Jul 02 17:54:18.204207 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:18.204182    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-1381a9/sub-test-model-1381a9-kserve-59449849bf-4gwhp"
Jul 02 17:54:18.282461 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:18.282434    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46580ed5-4a2f-4ca5-be71-19d2870e4dcf-tls-certs\") pod \"46580ed5-4a2f-4ca5-be71-19d2870e4dcf\" (UID: \"46580ed5-4a2f-4ca5-be71-19d2870e4dcf\") "
Jul 02 17:54:18.282631 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:18.282468    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9l54x\" (UniqueName: \"kubernetes.io/projected/46580ed5-4a2f-4ca5-be71-19d2870e4dcf-kube-api-access-9l54x\") pod \"46580ed5-4a2f-4ca5-be71-19d2870e4dcf\" (UID: \"46580ed5-4a2f-4ca5-be71-19d2870e4dcf\") "
Jul 02 17:54:18.282631 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:18.282536    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/46580ed5-4a2f-4ca5-be71-19d2870e4dcf-model-cache\") pod \"46580ed5-4a2f-4ca5-be71-19d2870e4dcf\" (UID: \"46580ed5-4a2f-4ca5-be71-19d2870e4dcf\") "
Jul 02 17:54:18.282631 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:18.282560    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/46580ed5-4a2f-4ca5-be71-19d2870e4dcf-dshm\") pod \"46580ed5-4a2f-4ca5-be71-19d2870e4dcf\" (UID: \"46580ed5-4a2f-4ca5-be71-19d2870e4dcf\") "
Jul 02 17:54:18.282631 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:18.282579    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/46580ed5-4a2f-4ca5-be71-19d2870e4dcf-home\") pod \"46580ed5-4a2f-4ca5-be71-19d2870e4dcf\" (UID: \"46580ed5-4a2f-4ca5-be71-19d2870e4dcf\") "
Jul 02 17:54:18.282631 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:18.282603    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46580ed5-4a2f-4ca5-be71-19d2870e4dcf-tmp-dir\") pod \"46580ed5-4a2f-4ca5-be71-19d2870e4dcf\" (UID: \"46580ed5-4a2f-4ca5-be71-19d2870e4dcf\") "
Jul 02 17:54:18.282902 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:18.282874    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46580ed5-4a2f-4ca5-be71-19d2870e4dcf-model-cache" (OuterVolumeSpecName: "model-cache") pod "46580ed5-4a2f-4ca5-be71-19d2870e4dcf" (UID: "46580ed5-4a2f-4ca5-be71-19d2870e4dcf"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:54:18.282902 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:18.282880    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46580ed5-4a2f-4ca5-be71-19d2870e4dcf-home" (OuterVolumeSpecName: "home") pod "46580ed5-4a2f-4ca5-be71-19d2870e4dcf" (UID: "46580ed5-4a2f-4ca5-be71-19d2870e4dcf"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:54:18.283032 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:18.282987    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/46580ed5-4a2f-4ca5-be71-19d2870e4dcf-model-cache\") on node \"ip-10-0-143-67.ec2.internal\" DevicePath \"\""
Jul 02 17:54:18.283032 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:18.283001    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/46580ed5-4a2f-4ca5-be71-19d2870e4dcf-home\") on node \"ip-10-0-143-67.ec2.internal\" DevicePath \"\""
Jul 02 17:54:18.283032 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:18.282993    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46580ed5-4a2f-4ca5-be71-19d2870e4dcf-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "46580ed5-4a2f-4ca5-be71-19d2870e4dcf" (UID: "46580ed5-4a2f-4ca5-be71-19d2870e4dcf"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:54:18.284659 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:18.284634    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46580ed5-4a2f-4ca5-be71-19d2870e4dcf-dshm" (OuterVolumeSpecName: "dshm") pod "46580ed5-4a2f-4ca5-be71-19d2870e4dcf" (UID: "46580ed5-4a2f-4ca5-be71-19d2870e4dcf"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:54:18.285116 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:18.285093    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46580ed5-4a2f-4ca5-be71-19d2870e4dcf-kube-api-access-9l54x" (OuterVolumeSpecName: "kube-api-access-9l54x") pod "46580ed5-4a2f-4ca5-be71-19d2870e4dcf" (UID: "46580ed5-4a2f-4ca5-be71-19d2870e4dcf"). InnerVolumeSpecName "kube-api-access-9l54x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 17:54:18.285116 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:18.285104    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46580ed5-4a2f-4ca5-be71-19d2870e4dcf-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "46580ed5-4a2f-4ca5-be71-19d2870e4dcf" (UID: "46580ed5-4a2f-4ca5-be71-19d2870e4dcf"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 17:54:18.383614 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:18.383595    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/46580ed5-4a2f-4ca5-be71-19d2870e4dcf-dshm\") on node \"ip-10-0-143-67.ec2.internal\" DevicePath \"\""
Jul 02 17:54:18.383614 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:18.383615    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46580ed5-4a2f-4ca5-be71-19d2870e4dcf-tmp-dir\") on node \"ip-10-0-143-67.ec2.internal\" DevicePath \"\""
Jul 02 17:54:18.383739 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:18.383624    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46580ed5-4a2f-4ca5-be71-19d2870e4dcf-tls-certs\") on node \"ip-10-0-143-67.ec2.internal\" DevicePath \"\""
Jul 02 17:54:18.383739 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:18.383634    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9l54x\" (UniqueName: \"kubernetes.io/projected/46580ed5-4a2f-4ca5-be71-19d2870e4dcf-kube-api-access-9l54x\") on node \"ip-10-0-143-67.ec2.internal\" DevicePath \"\""
Jul 02 17:54:18.476464 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:18.476433    2578 generic.go:356] "Generic (PLEG): container finished" podID="46580ed5-4a2f-4ca5-be71-19d2870e4dcf" containerID="ecedd75bf991eb3ede9b2d46fd126a3bb16845cbf59bc6acb166a4124f79f61e" exitCode=0
Jul 02 17:54:18.476867 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:18.476498    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-1381a9/sub-test-model-1381a9-kserve-59449849bf-4gwhp"
Jul 02 17:54:18.476867 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:18.476518    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-1381a9/sub-test-model-1381a9-kserve-59449849bf-4gwhp" event={"ID":"46580ed5-4a2f-4ca5-be71-19d2870e4dcf","Type":"ContainerDied","Data":"ecedd75bf991eb3ede9b2d46fd126a3bb16845cbf59bc6acb166a4124f79f61e"}
Jul 02 17:54:18.476867 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:18.476560    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-1381a9/sub-test-model-1381a9-kserve-59449849bf-4gwhp" event={"ID":"46580ed5-4a2f-4ca5-be71-19d2870e4dcf","Type":"ContainerDied","Data":"b198cad7964460b834d6caa8f3d13250ac7a96318e8f056ef5eb1481bb0f2aed"}
Jul 02 17:54:18.476867 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:18.476580    2578 scope.go:117] "RemoveContainer" containerID="ecedd75bf991eb3ede9b2d46fd126a3bb16845cbf59bc6acb166a4124f79f61e"
Jul 02 17:54:18.485497 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:18.485480    2578 scope.go:117] "RemoveContainer" containerID="ecedd75bf991eb3ede9b2d46fd126a3bb16845cbf59bc6acb166a4124f79f61e"
Jul 02 17:54:18.485737 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:54:18.485716    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ecedd75bf991eb3ede9b2d46fd126a3bb16845cbf59bc6acb166a4124f79f61e\": container with ID starting with ecedd75bf991eb3ede9b2d46fd126a3bb16845cbf59bc6acb166a4124f79f61e not found: ID does not exist" containerID="ecedd75bf991eb3ede9b2d46fd126a3bb16845cbf59bc6acb166a4124f79f61e"
Jul 02 17:54:18.485783 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:18.485744    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ecedd75bf991eb3ede9b2d46fd126a3bb16845cbf59bc6acb166a4124f79f61e"} err="failed to get container status \"ecedd75bf991eb3ede9b2d46fd126a3bb16845cbf59bc6acb166a4124f79f61e\": rpc error: code = NotFound desc = could not find container \"ecedd75bf991eb3ede9b2d46fd126a3bb16845cbf59bc6acb166a4124f79f61e\": container with ID starting with ecedd75bf991eb3ede9b2d46fd126a3bb16845cbf59bc6acb166a4124f79f61e not found: ID does not exist"
Jul 02 17:54:18.497576 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:18.497554    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-1381a9/sub-test-model-1381a9-kserve-59449849bf-4gwhp"]
Jul 02 17:54:18.501312 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:18.501291    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-1381a9/sub-test-model-1381a9-kserve-59449849bf-4gwhp"]
Jul 02 17:54:18.862565 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:18.862534    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-d1bf18/sub-test-model-d1bf18-kserve-5c99878979-7pm5k" podUID="67b0d698-5003-4770-9c28-384f01946da0" containerName="main" containerID="cri-o://9fc911b2a985da9313fab95a8f77ad5ee90641dede679802dd22b37f5333fe04" gracePeriod=45
Jul 02 17:54:19.120159 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:19.120102    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d1bf18/sub-test-model-d1bf18-kserve-5c99878979-7pm5k"
Jul 02 17:54:19.191139 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:19.191114    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/67b0d698-5003-4770-9c28-384f01946da0-home\") pod \"67b0d698-5003-4770-9c28-384f01946da0\" (UID: \"67b0d698-5003-4770-9c28-384f01946da0\") "
Jul 02 17:54:19.191249 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:19.191148    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ngksg\" (UniqueName: \"kubernetes.io/projected/67b0d698-5003-4770-9c28-384f01946da0-kube-api-access-ngksg\") pod \"67b0d698-5003-4770-9c28-384f01946da0\" (UID: \"67b0d698-5003-4770-9c28-384f01946da0\") "
Jul 02 17:54:19.191249 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:19.191203    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/67b0d698-5003-4770-9c28-384f01946da0-dshm\") pod \"67b0d698-5003-4770-9c28-384f01946da0\" (UID: \"67b0d698-5003-4770-9c28-384f01946da0\") "
Jul 02 17:54:19.191362 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:19.191255    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/67b0d698-5003-4770-9c28-384f01946da0-model-cache\") pod \"67b0d698-5003-4770-9c28-384f01946da0\" (UID: \"67b0d698-5003-4770-9c28-384f01946da0\") "
Jul 02 17:54:19.191420 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:19.191376    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67b0d698-5003-4770-9c28-384f01946da0-tmp-dir\") pod \"67b0d698-5003-4770-9c28-384f01946da0\" (UID: \"67b0d698-5003-4770-9c28-384f01946da0\") "
Jul 02 17:54:19.191420 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:19.191381    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67b0d698-5003-4770-9c28-384f01946da0-home" (OuterVolumeSpecName: "home") pod "67b0d698-5003-4770-9c28-384f01946da0" (UID: "67b0d698-5003-4770-9c28-384f01946da0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:54:19.191527 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:19.191420    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67b0d698-5003-4770-9c28-384f01946da0-tls-certs\") pod \"67b0d698-5003-4770-9c28-384f01946da0\" (UID: \"67b0d698-5003-4770-9c28-384f01946da0\") "
Jul 02 17:54:19.191527 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:19.191456    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67b0d698-5003-4770-9c28-384f01946da0-model-cache" (OuterVolumeSpecName: "model-cache") pod "67b0d698-5003-4770-9c28-384f01946da0" (UID: "67b0d698-5003-4770-9c28-384f01946da0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:54:19.191643 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:19.191597    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67b0d698-5003-4770-9c28-384f01946da0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "67b0d698-5003-4770-9c28-384f01946da0" (UID: "67b0d698-5003-4770-9c28-384f01946da0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:54:19.191736 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:19.191721    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/67b0d698-5003-4770-9c28-384f01946da0-model-cache\") on node \"ip-10-0-143-67.ec2.internal\" DevicePath \"\""
Jul 02 17:54:19.191803 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:19.191738    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67b0d698-5003-4770-9c28-384f01946da0-tmp-dir\") on node \"ip-10-0-143-67.ec2.internal\" DevicePath \"\""
Jul 02 17:54:19.191803 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:19.191746    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/67b0d698-5003-4770-9c28-384f01946da0-home\") on node \"ip-10-0-143-67.ec2.internal\" DevicePath \"\""
Jul 02 17:54:19.193264 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:19.193243    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67b0d698-5003-4770-9c28-384f01946da0-dshm" (OuterVolumeSpecName: "dshm") pod "67b0d698-5003-4770-9c28-384f01946da0" (UID: "67b0d698-5003-4770-9c28-384f01946da0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:54:19.193352 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:19.193298    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67b0d698-5003-4770-9c28-384f01946da0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "67b0d698-5003-4770-9c28-384f01946da0" (UID: "67b0d698-5003-4770-9c28-384f01946da0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 17:54:19.193392 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:19.193359    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67b0d698-5003-4770-9c28-384f01946da0-kube-api-access-ngksg" (OuterVolumeSpecName: "kube-api-access-ngksg") pod "67b0d698-5003-4770-9c28-384f01946da0" (UID: "67b0d698-5003-4770-9c28-384f01946da0"). InnerVolumeSpecName "kube-api-access-ngksg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 17:54:19.293062 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:19.293037    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67b0d698-5003-4770-9c28-384f01946da0-tls-certs\") on node \"ip-10-0-143-67.ec2.internal\" DevicePath \"\""
Jul 02 17:54:19.293062 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:19.293063    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ngksg\" (UniqueName: \"kubernetes.io/projected/67b0d698-5003-4770-9c28-384f01946da0-kube-api-access-ngksg\") on node \"ip-10-0-143-67.ec2.internal\" DevicePath \"\""
Jul 02 17:54:19.293234 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:19.293076    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/67b0d698-5003-4770-9c28-384f01946da0-dshm\") on node \"ip-10-0-143-67.ec2.internal\" DevicePath \"\""
Jul 02 17:54:19.483190 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:19.483159    2578 generic.go:356] "Generic (PLEG): container finished" podID="67b0d698-5003-4770-9c28-384f01946da0" containerID="9fc911b2a985da9313fab95a8f77ad5ee90641dede679802dd22b37f5333fe04" exitCode=0
Jul 02 17:54:19.483553 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:19.483206    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d1bf18/sub-test-model-d1bf18-kserve-5c99878979-7pm5k"
Jul 02 17:54:19.483553 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:19.483245    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d1bf18/sub-test-model-d1bf18-kserve-5c99878979-7pm5k" event={"ID":"67b0d698-5003-4770-9c28-384f01946da0","Type":"ContainerDied","Data":"9fc911b2a985da9313fab95a8f77ad5ee90641dede679802dd22b37f5333fe04"}
Jul 02 17:54:19.483553 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:19.483286    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d1bf18/sub-test-model-d1bf18-kserve-5c99878979-7pm5k" event={"ID":"67b0d698-5003-4770-9c28-384f01946da0","Type":"ContainerDied","Data":"1b587b31c76d32df7f730deff0048abec0de1d5b0b74ca456aaa6d9d431f0bb6"}
Jul 02 17:54:19.483553 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:19.483310    2578 scope.go:117] "RemoveContainer" containerID="9fc911b2a985da9313fab95a8f77ad5ee90641dede679802dd22b37f5333fe04"
Jul 02 17:54:19.491486 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:19.491464    2578 scope.go:117] "RemoveContainer" containerID="9fc911b2a985da9313fab95a8f77ad5ee90641dede679802dd22b37f5333fe04"
Jul 02 17:54:19.491743 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:54:19.491724    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9fc911b2a985da9313fab95a8f77ad5ee90641dede679802dd22b37f5333fe04\": container with ID starting with 9fc911b2a985da9313fab95a8f77ad5ee90641dede679802dd22b37f5333fe04 not found: ID does not exist" containerID="9fc911b2a985da9313fab95a8f77ad5ee90641dede679802dd22b37f5333fe04"
Jul 02 17:54:19.491796 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:19.491752    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9fc911b2a985da9313fab95a8f77ad5ee90641dede679802dd22b37f5333fe04"} err="failed to get container status \"9fc911b2a985da9313fab95a8f77ad5ee90641dede679802dd22b37f5333fe04\": rpc error: code = NotFound desc = could not find container \"9fc911b2a985da9313fab95a8f77ad5ee90641dede679802dd22b37f5333fe04\": container with ID starting with 9fc911b2a985da9313fab95a8f77ad5ee90641dede679802dd22b37f5333fe04 not found: ID does not exist"
Jul 02 17:54:19.497340 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:19.497320    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46580ed5-4a2f-4ca5-be71-19d2870e4dcf" path="/var/lib/kubelet/pods/46580ed5-4a2f-4ca5-be71-19d2870e4dcf/volumes"
Jul 02 17:54:19.504199 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:19.504177    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-d1bf18/sub-test-model-d1bf18-kserve-5c99878979-7pm5k"]
Jul 02 17:54:19.507476 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:19.507457    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-d1bf18/sub-test-model-d1bf18-kserve-5c99878979-7pm5k"]
Jul 02 17:54:21.496037 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:21.495990    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67b0d698-5003-4770-9c28-384f01946da0" path="/var/lib/kubelet/pods/67b0d698-5003-4770-9c28-384f01946da0/volumes"
Jul 02 17:54:22.343231 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:22.343192    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:54:26.665343 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:26.665303    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-1381a9/rate-test-model-1381a9-kserve-dbbb7875f-w8n78"
Jul 02 17:54:26.665736 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:26.665361    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-1381a9/rate-test-model-1381a9-kserve-dbbb7875f-w8n78"
Jul 02 17:54:26.677528 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:26.677505    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-1381a9/rate-test-model-1381a9-kserve-dbbb7875f-w8n78"
Jul 02 17:54:27.534928 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:27.534900    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-1381a9/rate-test-model-1381a9-kserve-dbbb7875f-w8n78"
Jul 02 17:54:48.752090 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:48.752054    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-d1bf18/rate-test-model-d1bf18-kserve-74bd44ccff-jt7c6"]
Jul 02 17:54:48.752532 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:48.752425    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67b0d698-5003-4770-9c28-384f01946da0" containerName="main"
Jul 02 17:54:48.752532 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:48.752437    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="67b0d698-5003-4770-9c28-384f01946da0" containerName="main"
Jul 02 17:54:48.752532 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:48.752450    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46580ed5-4a2f-4ca5-be71-19d2870e4dcf" containerName="main"
Jul 02 17:54:48.752532 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:48.752456    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="46580ed5-4a2f-4ca5-be71-19d2870e4dcf" containerName="main"
Jul 02 17:54:48.752532 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:48.752524    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="46580ed5-4a2f-4ca5-be71-19d2870e4dcf" containerName="main"
Jul 02 17:54:48.752532 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:48.752532    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="67b0d698-5003-4770-9c28-384f01946da0" containerName="main"
Jul 02 17:54:48.756860 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:48.756837    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d1bf18/rate-test-model-d1bf18-kserve-74bd44ccff-jt7c6"
Jul 02 17:54:48.761505 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:48.761481    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-d1bf18\"/\"rate-test-model-d1bf18-kserve-self-signed-certs\""
Jul 02 17:54:48.761647 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:48.761568    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-d1bf18\"/\"kube-root-ca.crt\""
Jul 02 17:54:48.761725 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:48.761696    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-d1bf18\"/\"default-dockercfg-nvs86\""
Jul 02 17:54:48.761823 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:48.761799    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-d1bf18\"/\"openshift-service-ca.crt\""
Jul 02 17:54:48.764295 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:48.764273    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-d1bf18/rate-test-model-d1bf18-kserve-74bd44ccff-jt7c6"]
Jul 02 17:54:48.775183 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:48.775159    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:54:48.939997 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:48.939974    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fd3070aa-d146-4807-a254-b4a813b5f326-model-cache\") pod \"rate-test-model-d1bf18-kserve-74bd44ccff-jt7c6\" (UID: \"fd3070aa-d146-4807-a254-b4a813b5f326\") " pod="ai-tenant-e2e-shared-b-d1bf18/rate-test-model-d1bf18-kserve-74bd44ccff-jt7c6"
Jul 02 17:54:48.940131 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:48.940043    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd3070aa-d146-4807-a254-b4a813b5f326-tls-certs\") pod \"rate-test-model-d1bf18-kserve-74bd44ccff-jt7c6\" (UID: \"fd3070aa-d146-4807-a254-b4a813b5f326\") " pod="ai-tenant-e2e-shared-b-d1bf18/rate-test-model-d1bf18-kserve-74bd44ccff-jt7c6"
Jul 02 17:54:48.940131 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:48.940089    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd3070aa-d146-4807-a254-b4a813b5f326-tmp-dir\") pod \"rate-test-model-d1bf18-kserve-74bd44ccff-jt7c6\" (UID: \"fd3070aa-d146-4807-a254-b4a813b5f326\") " pod="ai-tenant-e2e-shared-b-d1bf18/rate-test-model-d1bf18-kserve-74bd44ccff-jt7c6"
Jul 02 17:54:48.940131 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:48.940117    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trk4n\" (UniqueName: \"kubernetes.io/projected/fd3070aa-d146-4807-a254-b4a813b5f326-kube-api-access-trk4n\") pod \"rate-test-model-d1bf18-kserve-74bd44ccff-jt7c6\" (UID: \"fd3070aa-d146-4807-a254-b4a813b5f326\") " pod="ai-tenant-e2e-shared-b-d1bf18/rate-test-model-d1bf18-kserve-74bd44ccff-jt7c6"
Jul 02 17:54:48.940236 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:48.940135    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fd3070aa-d146-4807-a254-b4a813b5f326-dshm\") pod \"rate-test-model-d1bf18-kserve-74bd44ccff-jt7c6\" (UID: \"fd3070aa-d146-4807-a254-b4a813b5f326\") " pod="ai-tenant-e2e-shared-b-d1bf18/rate-test-model-d1bf18-kserve-74bd44ccff-jt7c6"
Jul 02 17:54:48.940236 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:48.940153    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fd3070aa-d146-4807-a254-b4a813b5f326-home\") pod \"rate-test-model-d1bf18-kserve-74bd44ccff-jt7c6\" (UID: \"fd3070aa-d146-4807-a254-b4a813b5f326\") " pod="ai-tenant-e2e-shared-b-d1bf18/rate-test-model-d1bf18-kserve-74bd44ccff-jt7c6"
Jul 02 17:54:49.040735 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:49.040675    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fd3070aa-d146-4807-a254-b4a813b5f326-model-cache\") pod \"rate-test-model-d1bf18-kserve-74bd44ccff-jt7c6\" (UID: \"fd3070aa-d146-4807-a254-b4a813b5f326\") " pod="ai-tenant-e2e-shared-b-d1bf18/rate-test-model-d1bf18-kserve-74bd44ccff-jt7c6"
Jul 02 17:54:49.040735 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:49.040714    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd3070aa-d146-4807-a254-b4a813b5f326-tls-certs\") pod \"rate-test-model-d1bf18-kserve-74bd44ccff-jt7c6\" (UID: \"fd3070aa-d146-4807-a254-b4a813b5f326\") " pod="ai-tenant-e2e-shared-b-d1bf18/rate-test-model-d1bf18-kserve-74bd44ccff-jt7c6"
Jul 02 17:54:49.040863 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:49.040743    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd3070aa-d146-4807-a254-b4a813b5f326-tmp-dir\") pod \"rate-test-model-d1bf18-kserve-74bd44ccff-jt7c6\" (UID: \"fd3070aa-d146-4807-a254-b4a813b5f326\") " pod="ai-tenant-e2e-shared-b-d1bf18/rate-test-model-d1bf18-kserve-74bd44ccff-jt7c6"
Jul 02 17:54:49.040863 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:49.040776    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trk4n\" (UniqueName: \"kubernetes.io/projected/fd3070aa-d146-4807-a254-b4a813b5f326-kube-api-access-trk4n\") pod \"rate-test-model-d1bf18-kserve-74bd44ccff-jt7c6\" (UID: \"fd3070aa-d146-4807-a254-b4a813b5f326\") " pod="ai-tenant-e2e-shared-b-d1bf18/rate-test-model-d1bf18-kserve-74bd44ccff-jt7c6"
Jul 02 17:54:49.040863 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:49.040795    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fd3070aa-d146-4807-a254-b4a813b5f326-dshm\") pod \"rate-test-model-d1bf18-kserve-74bd44ccff-jt7c6\" (UID: \"fd3070aa-d146-4807-a254-b4a813b5f326\") " pod="ai-tenant-e2e-shared-b-d1bf18/rate-test-model-d1bf18-kserve-74bd44ccff-jt7c6"
Jul 02 17:54:49.040863 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:49.040811    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fd3070aa-d146-4807-a254-b4a813b5f326-home\") pod \"rate-test-model-d1bf18-kserve-74bd44ccff-jt7c6\" (UID: \"fd3070aa-d146-4807-a254-b4a813b5f326\") " pod="ai-tenant-e2e-shared-b-d1bf18/rate-test-model-d1bf18-kserve-74bd44ccff-jt7c6"
Jul 02 17:54:49.041126 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:49.041104    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fd3070aa-d146-4807-a254-b4a813b5f326-model-cache\") pod \"rate-test-model-d1bf18-kserve-74bd44ccff-jt7c6\" (UID: \"fd3070aa-d146-4807-a254-b4a813b5f326\") " pod="ai-tenant-e2e-shared-b-d1bf18/rate-test-model-d1bf18-kserve-74bd44ccff-jt7c6"
Jul 02 17:54:49.041181 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:49.041145    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd3070aa-d146-4807-a254-b4a813b5f326-tmp-dir\") pod \"rate-test-model-d1bf18-kserve-74bd44ccff-jt7c6\" (UID: \"fd3070aa-d146-4807-a254-b4a813b5f326\") " pod="ai-tenant-e2e-shared-b-d1bf18/rate-test-model-d1bf18-kserve-74bd44ccff-jt7c6"
Jul 02 17:54:49.041231 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:49.041191    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fd3070aa-d146-4807-a254-b4a813b5f326-home\") pod \"rate-test-model-d1bf18-kserve-74bd44ccff-jt7c6\" (UID: \"fd3070aa-d146-4807-a254-b4a813b5f326\") " pod="ai-tenant-e2e-shared-b-d1bf18/rate-test-model-d1bf18-kserve-74bd44ccff-jt7c6"
Jul 02 17:54:49.043117 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:49.043097    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fd3070aa-d146-4807-a254-b4a813b5f326-dshm\") pod \"rate-test-model-d1bf18-kserve-74bd44ccff-jt7c6\" (UID: \"fd3070aa-d146-4807-a254-b4a813b5f326\") " pod="ai-tenant-e2e-shared-b-d1bf18/rate-test-model-d1bf18-kserve-74bd44ccff-jt7c6"
Jul 02 17:54:49.043277 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:49.043259    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd3070aa-d146-4807-a254-b4a813b5f326-tls-certs\") pod \"rate-test-model-d1bf18-kserve-74bd44ccff-jt7c6\" (UID: \"fd3070aa-d146-4807-a254-b4a813b5f326\") " pod="ai-tenant-e2e-shared-b-d1bf18/rate-test-model-d1bf18-kserve-74bd44ccff-jt7c6"
Jul 02 17:54:49.049643 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:49.049621    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-trk4n\" (UniqueName: \"kubernetes.io/projected/fd3070aa-d146-4807-a254-b4a813b5f326-kube-api-access-trk4n\") pod \"rate-test-model-d1bf18-kserve-74bd44ccff-jt7c6\" (UID: \"fd3070aa-d146-4807-a254-b4a813b5f326\") " pod="ai-tenant-e2e-shared-b-d1bf18/rate-test-model-d1bf18-kserve-74bd44ccff-jt7c6"
Jul 02 17:54:49.068146 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:49.068127    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d1bf18/rate-test-model-d1bf18-kserve-74bd44ccff-jt7c6"
Jul 02 17:54:49.195684 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:49.195656    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-d1bf18/rate-test-model-d1bf18-kserve-74bd44ccff-jt7c6"]
Jul 02 17:54:49.198372 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:54:49.198339    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfd3070aa_d146_4807_a254_b4a813b5f326.slice/crio-a07340ef303d364efe5302c76445302266fd997e7e6f8c71a6010f133e57dc40 WatchSource:0}: Error finding container a07340ef303d364efe5302c76445302266fd997e7e6f8c71a6010f133e57dc40: Status 404 returned error can't find the container with id a07340ef303d364efe5302c76445302266fd997e7e6f8c71a6010f133e57dc40
Jul 02 17:54:49.627793 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:49.627746    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d1bf18/rate-test-model-d1bf18-kserve-74bd44ccff-jt7c6" event={"ID":"fd3070aa-d146-4807-a254-b4a813b5f326","Type":"ContainerStarted","Data":"2f4398bd0ff38a90f4021a3ac29600a073b2d9da6d1b881ed18946714982a1a1"}
Jul 02 17:54:49.627955 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:49.627800    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d1bf18/rate-test-model-d1bf18-kserve-74bd44ccff-jt7c6" event={"ID":"fd3070aa-d146-4807-a254-b4a813b5f326","Type":"ContainerStarted","Data":"a07340ef303d364efe5302c76445302266fd997e7e6f8c71a6010f133e57dc40"}
Jul 02 17:54:49.644376 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:49.644321    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-d1bf18/rate-test-model-d1bf18-kserve-74bd44ccff-jt7c6" podStartSLOduration=1.644307479 podStartE2EDuration="1.644307479s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:54:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:54:49.643288153 +0000 UTC m=+2644.832990816" watchObservedRunningTime="2026-07-02 17:54:49.644307479 +0000 UTC m=+2644.834010140"
Jul 02 17:54:53.143545 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:53.143512    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:54:57.922410 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:57.922378    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:54:58.028855 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:58.028817    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:54:59.069188 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:59.069154    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-d1bf18/rate-test-model-d1bf18-kserve-74bd44ccff-jt7c6"
Jul 02 17:54:59.069607 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:59.069204    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-d1bf18/rate-test-model-d1bf18-kserve-74bd44ccff-jt7c6"
Jul 02 17:54:59.081807 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:59.081786    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-d1bf18/rate-test-model-d1bf18-kserve-74bd44ccff-jt7c6"
Jul 02 17:54:59.686354 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:54:59.686328    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-d1bf18/rate-test-model-d1bf18-kserve-74bd44ccff-jt7c6"
Jul 02 17:55:05.286697 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:55:05.286645    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:55:05.912185 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:55:05.912155    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:55:06.011848 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:55:06.011818    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:55:26.939313 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:55:26.939274    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:55:41.346120 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:55:41.346042    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:55:45.518658 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:55:45.518629    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-62g9m_d6628590-1cf7-4a61-9350-539f3ae7ed91/ovn-acl-logging/0.log"
Jul 02 17:55:45.525708 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:55:45.525682    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-62g9m_d6628590-1cf7-4a61-9350-539f3ae7ed91/ovn-acl-logging/0.log"
Jul 02 17:55:48.328340 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:55:48.328310    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-1381a9/rate-test-model-1381a9-kserve-dbbb7875f-w8n78"]
Jul 02 17:55:48.350514 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:55:48.350475    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:55:49.350230 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:55:49.350163    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-d1bf18/rate-test-model-d1bf18-kserve-74bd44ccff-jt7c6"]
Jul 02 17:55:49.367464 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:55:49.367428    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:55:52.749505 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:55:52.749471    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:56:03.348832 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:56:03.348792    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-1381a9/rate-test-model-1381a9-kserve-dbbb7875f-w8n78" podUID="cd28622b-6c88-49c6-b4d9-a8208ce3e081" containerName="main" containerID="cri-o://2e8b256b3054738773f139fde79c5ae9b84889c1a4fec895a4cca83c7157e191" gracePeriod=45
Jul 02 17:56:03.605237 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:56:03.605211    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-1381a9/rate-test-model-1381a9-kserve-dbbb7875f-w8n78"
Jul 02 17:56:03.657464 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:56:03.657437    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd28622b-6c88-49c6-b4d9-a8208ce3e081-tls-certs\") pod \"cd28622b-6c88-49c6-b4d9-a8208ce3e081\" (UID: \"cd28622b-6c88-49c6-b4d9-a8208ce3e081\") "
Jul 02 17:56:03.657629 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:56:03.657479    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd28622b-6c88-49c6-b4d9-a8208ce3e081-model-cache\") pod \"cd28622b-6c88-49c6-b4d9-a8208ce3e081\" (UID: \"cd28622b-6c88-49c6-b4d9-a8208ce3e081\") "
Jul 02 17:56:03.657629 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:56:03.657499    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd28622b-6c88-49c6-b4d9-a8208ce3e081-dshm\") pod \"cd28622b-6c88-49c6-b4d9-a8208ce3e081\" (UID: \"cd28622b-6c88-49c6-b4d9-a8208ce3e081\") "
Jul 02 17:56:03.657629 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:56:03.657574    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd28622b-6c88-49c6-b4d9-a8208ce3e081-tmp-dir\") pod \"cd28622b-6c88-49c6-b4d9-a8208ce3e081\" (UID: \"cd28622b-6c88-49c6-b4d9-a8208ce3e081\") "
Jul 02 17:56:03.657629 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:56:03.657598    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd28622b-6c88-49c6-b4d9-a8208ce3e081-home\") pod \"cd28622b-6c88-49c6-b4d9-a8208ce3e081\" (UID: \"cd28622b-6c88-49c6-b4d9-a8208ce3e081\") "
Jul 02 17:56:03.657629 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:56:03.657622    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8ngkp\" (UniqueName: \"kubernetes.io/projected/cd28622b-6c88-49c6-b4d9-a8208ce3e081-kube-api-access-8ngkp\") pod \"cd28622b-6c88-49c6-b4d9-a8208ce3e081\" (UID: \"cd28622b-6c88-49c6-b4d9-a8208ce3e081\") "
Jul 02 17:56:03.657918 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:56:03.657749    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd28622b-6c88-49c6-b4d9-a8208ce3e081-model-cache" (OuterVolumeSpecName: "model-cache") pod "cd28622b-6c88-49c6-b4d9-a8208ce3e081" (UID: "cd28622b-6c88-49c6-b4d9-a8208ce3e081"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:56:03.657918 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:56:03.657806    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd28622b-6c88-49c6-b4d9-a8208ce3e081-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "cd28622b-6c88-49c6-b4d9-a8208ce3e081" (UID: "cd28622b-6c88-49c6-b4d9-a8208ce3e081"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:56:03.658050 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:56:03.657912    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd28622b-6c88-49c6-b4d9-a8208ce3e081-home" (OuterVolumeSpecName: "home") pod "cd28622b-6c88-49c6-b4d9-a8208ce3e081" (UID: "cd28622b-6c88-49c6-b4d9-a8208ce3e081"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:56:03.658050 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:56:03.658038    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd28622b-6c88-49c6-b4d9-a8208ce3e081-tmp-dir\") on node \"ip-10-0-143-67.ec2.internal\" DevicePath \"\""
Jul 02 17:56:03.658128 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:56:03.658052    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd28622b-6c88-49c6-b4d9-a8208ce3e081-home\") on node \"ip-10-0-143-67.ec2.internal\" DevicePath \"\""
Jul 02 17:56:03.658128 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:56:03.658064    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd28622b-6c88-49c6-b4d9-a8208ce3e081-model-cache\") on node \"ip-10-0-143-67.ec2.internal\" DevicePath \"\""
Jul 02 17:56:03.659568 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:56:03.659542    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd28622b-6c88-49c6-b4d9-a8208ce3e081-dshm" (OuterVolumeSpecName: "dshm") pod "cd28622b-6c88-49c6-b4d9-a8208ce3e081" (UID: "cd28622b-6c88-49c6-b4d9-a8208ce3e081"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:56:03.659682 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:56:03.659629    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd28622b-6c88-49c6-b4d9-a8208ce3e081-kube-api-access-8ngkp" (OuterVolumeSpecName: "kube-api-access-8ngkp") pod "cd28622b-6c88-49c6-b4d9-a8208ce3e081" (UID: "cd28622b-6c88-49c6-b4d9-a8208ce3e081"). InnerVolumeSpecName "kube-api-access-8ngkp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 17:56:03.659682 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:56:03.659637    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd28622b-6c88-49c6-b4d9-a8208ce3e081-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "cd28622b-6c88-49c6-b4d9-a8208ce3e081" (UID: "cd28622b-6c88-49c6-b4d9-a8208ce3e081"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 17:56:03.758797 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:56:03.758769    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd28622b-6c88-49c6-b4d9-a8208ce3e081-tls-certs\") on node \"ip-10-0-143-67.ec2.internal\" DevicePath \"\""
Jul 02 17:56:03.758797 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:56:03.758791    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd28622b-6c88-49c6-b4d9-a8208ce3e081-dshm\") on node \"ip-10-0-143-67.ec2.internal\" DevicePath \"\""
Jul 02 17:56:03.758797 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:56:03.758801    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8ngkp\" (UniqueName: \"kubernetes.io/projected/cd28622b-6c88-49c6-b4d9-a8208ce3e081-kube-api-access-8ngkp\") on node \"ip-10-0-143-67.ec2.internal\" DevicePath \"\""
Jul 02 17:56:03.986138 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:56:03.986110    2578 generic.go:356] "Generic (PLEG): container finished" podID="cd28622b-6c88-49c6-b4d9-a8208ce3e081" containerID="2e8b256b3054738773f139fde79c5ae9b84889c1a4fec895a4cca83c7157e191" exitCode=0
Jul 02 17:56:03.986298 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:56:03.986155    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-1381a9/rate-test-model-1381a9-kserve-dbbb7875f-w8n78"
Jul 02 17:56:03.986298 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:56:03.986199    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-1381a9/rate-test-model-1381a9-kserve-dbbb7875f-w8n78" event={"ID":"cd28622b-6c88-49c6-b4d9-a8208ce3e081","Type":"ContainerDied","Data":"2e8b256b3054738773f139fde79c5ae9b84889c1a4fec895a4cca83c7157e191"}
Jul 02 17:56:03.986298 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:56:03.986239    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-1381a9/rate-test-model-1381a9-kserve-dbbb7875f-w8n78" event={"ID":"cd28622b-6c88-49c6-b4d9-a8208ce3e081","Type":"ContainerDied","Data":"126e630f20db3ca2ebf9880afc0697da65041b6e5fee62ba3bc786ea107f3983"}
Jul 02 17:56:03.986298 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:56:03.986260    2578 scope.go:117] "RemoveContainer" containerID="2e8b256b3054738773f139fde79c5ae9b84889c1a4fec895a4cca83c7157e191"
Jul 02 17:56:03.995263 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:56:03.995247    2578 scope.go:117] "RemoveContainer" containerID="2e8b256b3054738773f139fde79c5ae9b84889c1a4fec895a4cca83c7157e191"
Jul 02 17:56:03.995506 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:56:03.995486    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e8b256b3054738773f139fde79c5ae9b84889c1a4fec895a4cca83c7157e191\": container with ID starting with 2e8b256b3054738773f139fde79c5ae9b84889c1a4fec895a4cca83c7157e191 not found: ID does not exist" containerID="2e8b256b3054738773f139fde79c5ae9b84889c1a4fec895a4cca83c7157e191"
Jul 02 17:56:03.995547 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:56:03.995520    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e8b256b3054738773f139fde79c5ae9b84889c1a4fec895a4cca83c7157e191"} err="failed to get container status \"2e8b256b3054738773f139fde79c5ae9b84889c1a4fec895a4cca83c7157e191\": rpc error: code = NotFound desc = could not find container \"2e8b256b3054738773f139fde79c5ae9b84889c1a4fec895a4cca83c7157e191\": container with ID starting with 2e8b256b3054738773f139fde79c5ae9b84889c1a4fec895a4cca83c7157e191 not found: ID does not exist"
Jul 02 17:56:04.008393 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:56:04.008371    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-1381a9/rate-test-model-1381a9-kserve-dbbb7875f-w8n78"]
Jul 02 17:56:04.011737 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:56:04.011718    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-1381a9/rate-test-model-1381a9-kserve-dbbb7875f-w8n78"]
Jul 02 17:56:04.370990 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:56:04.370901    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-d1bf18/rate-test-model-d1bf18-kserve-74bd44ccff-jt7c6" podUID="fd3070aa-d146-4807-a254-b4a813b5f326" containerName="main" containerID="cri-o://2f4398bd0ff38a90f4021a3ac29600a073b2d9da6d1b881ed18946714982a1a1" gracePeriod=45
Jul 02 17:56:04.618565 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:56:04.618543    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d1bf18/rate-test-model-d1bf18-kserve-74bd44ccff-jt7c6"
Jul 02 17:56:04.667909 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:56:04.667850    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fd3070aa-d146-4807-a254-b4a813b5f326-model-cache\") pod \"fd3070aa-d146-4807-a254-b4a813b5f326\" (UID: \"fd3070aa-d146-4807-a254-b4a813b5f326\") "
Jul 02 17:56:04.667909 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:56:04.667878    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fd3070aa-d146-4807-a254-b4a813b5f326-home\") pod \"fd3070aa-d146-4807-a254-b4a813b5f326\" (UID: \"fd3070aa-d146-4807-a254-b4a813b5f326\") "
Jul 02 17:56:04.667909 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:56:04.667895    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fd3070aa-d146-4807-a254-b4a813b5f326-dshm\") pod \"fd3070aa-d146-4807-a254-b4a813b5f326\" (UID: \"fd3070aa-d146-4807-a254-b4a813b5f326\") "
Jul 02 17:56:04.668163 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:56:04.667944    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd3070aa-d146-4807-a254-b4a813b5f326-tls-certs\") pod \"fd3070aa-d146-4807-a254-b4a813b5f326\" (UID: \"fd3070aa-d146-4807-a254-b4a813b5f326\") "
Jul 02 17:56:04.668163 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:56:04.667982    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-trk4n\" (UniqueName: \"kubernetes.io/projected/fd3070aa-d146-4807-a254-b4a813b5f326-kube-api-access-trk4n\") pod \"fd3070aa-d146-4807-a254-b4a813b5f326\" (UID: \"fd3070aa-d146-4807-a254-b4a813b5f326\") "
Jul 02 17:56:04.668163 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:56:04.667998    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd3070aa-d146-4807-a254-b4a813b5f326-tmp-dir\") pod \"fd3070aa-d146-4807-a254-b4a813b5f326\" (UID: \"fd3070aa-d146-4807-a254-b4a813b5f326\") "
Jul 02 17:56:04.668316 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:56:04.668156    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd3070aa-d146-4807-a254-b4a813b5f326-model-cache" (OuterVolumeSpecName: "model-cache") pod "fd3070aa-d146-4807-a254-b4a813b5f326" (UID: "fd3070aa-d146-4807-a254-b4a813b5f326"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:56:04.668316 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:56:04.668173    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd3070aa-d146-4807-a254-b4a813b5f326-home" (OuterVolumeSpecName: "home") pod "fd3070aa-d146-4807-a254-b4a813b5f326" (UID: "fd3070aa-d146-4807-a254-b4a813b5f326"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:56:04.668419 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:56:04.668368    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fd3070aa-d146-4807-a254-b4a813b5f326-model-cache\") on node \"ip-10-0-143-67.ec2.internal\" DevicePath \"\""
Jul 02 17:56:04.668419 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:56:04.668386    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fd3070aa-d146-4807-a254-b4a813b5f326-home\") on node \"ip-10-0-143-67.ec2.internal\" DevicePath \"\""
Jul 02 17:56:04.668419 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:56:04.668366    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd3070aa-d146-4807-a254-b4a813b5f326-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "fd3070aa-d146-4807-a254-b4a813b5f326" (UID: "fd3070aa-d146-4807-a254-b4a813b5f326"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:56:04.670061 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:56:04.670031    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd3070aa-d146-4807-a254-b4a813b5f326-dshm" (OuterVolumeSpecName: "dshm") pod "fd3070aa-d146-4807-a254-b4a813b5f326" (UID: "fd3070aa-d146-4807-a254-b4a813b5f326"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:56:04.670485 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:56:04.670460    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd3070aa-d146-4807-a254-b4a813b5f326-kube-api-access-trk4n" (OuterVolumeSpecName: "kube-api-access-trk4n") pod "fd3070aa-d146-4807-a254-b4a813b5f326" (UID: "fd3070aa-d146-4807-a254-b4a813b5f326"). InnerVolumeSpecName "kube-api-access-trk4n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 17:56:04.670575 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:56:04.670465    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd3070aa-d146-4807-a254-b4a813b5f326-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "fd3070aa-d146-4807-a254-b4a813b5f326" (UID: "fd3070aa-d146-4807-a254-b4a813b5f326"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 17:56:04.769276 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:56:04.769252    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd3070aa-d146-4807-a254-b4a813b5f326-tls-certs\") on node \"ip-10-0-143-67.ec2.internal\" DevicePath \"\""
Jul 02 17:56:04.769276 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:56:04.769274    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-trk4n\" (UniqueName: \"kubernetes.io/projected/fd3070aa-d146-4807-a254-b4a813b5f326-kube-api-access-trk4n\") on node \"ip-10-0-143-67.ec2.internal\" DevicePath \"\""
Jul 02 17:56:04.769397 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:56:04.769283    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd3070aa-d146-4807-a254-b4a813b5f326-tmp-dir\") on node \"ip-10-0-143-67.ec2.internal\" DevicePath \"\""
Jul 02 17:56:04.769397 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:56:04.769292    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fd3070aa-d146-4807-a254-b4a813b5f326-dshm\") on node \"ip-10-0-143-67.ec2.internal\" DevicePath \"\""
Jul 02 17:56:04.993156 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:56:04.993124    2578 generic.go:356] "Generic (PLEG): container finished" podID="fd3070aa-d146-4807-a254-b4a813b5f326" containerID="2f4398bd0ff38a90f4021a3ac29600a073b2d9da6d1b881ed18946714982a1a1" exitCode=0
Jul 02 17:56:04.993258 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:56:04.993172    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d1bf18/rate-test-model-d1bf18-kserve-74bd44ccff-jt7c6"
Jul 02 17:56:04.993258 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:56:04.993203    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d1bf18/rate-test-model-d1bf18-kserve-74bd44ccff-jt7c6" event={"ID":"fd3070aa-d146-4807-a254-b4a813b5f326","Type":"ContainerDied","Data":"2f4398bd0ff38a90f4021a3ac29600a073b2d9da6d1b881ed18946714982a1a1"}
Jul 02 17:56:04.993258 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:56:04.993246    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d1bf18/rate-test-model-d1bf18-kserve-74bd44ccff-jt7c6" event={"ID":"fd3070aa-d146-4807-a254-b4a813b5f326","Type":"ContainerDied","Data":"a07340ef303d364efe5302c76445302266fd997e7e6f8c71a6010f133e57dc40"}
Jul 02 17:56:04.993366 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:56:04.993264    2578 scope.go:117] "RemoveContainer" containerID="2f4398bd0ff38a90f4021a3ac29600a073b2d9da6d1b881ed18946714982a1a1"
Jul 02 17:56:05.009677 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:56:05.009654    2578 scope.go:117] "RemoveContainer" containerID="2f4398bd0ff38a90f4021a3ac29600a073b2d9da6d1b881ed18946714982a1a1"
Jul 02 17:56:05.009935 ip-10-0-143-67 kubenswrapper[2578]: E0702 17:56:05.009917    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f4398bd0ff38a90f4021a3ac29600a073b2d9da6d1b881ed18946714982a1a1\": container with ID starting with 2f4398bd0ff38a90f4021a3ac29600a073b2d9da6d1b881ed18946714982a1a1 not found: ID does not exist" containerID="2f4398bd0ff38a90f4021a3ac29600a073b2d9da6d1b881ed18946714982a1a1"
Jul 02 17:56:05.010002 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:56:05.009942    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f4398bd0ff38a90f4021a3ac29600a073b2d9da6d1b881ed18946714982a1a1"} err="failed to get container status \"2f4398bd0ff38a90f4021a3ac29600a073b2d9da6d1b881ed18946714982a1a1\": rpc error: code = NotFound desc = could not find container \"2f4398bd0ff38a90f4021a3ac29600a073b2d9da6d1b881ed18946714982a1a1\": container with ID starting with 2f4398bd0ff38a90f4021a3ac29600a073b2d9da6d1b881ed18946714982a1a1 not found: ID does not exist"
Jul 02 17:56:05.022700 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:56:05.022676    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-d1bf18/rate-test-model-d1bf18-kserve-74bd44ccff-jt7c6"]
Jul 02 17:56:05.028854 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:56:05.028836    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-d1bf18/rate-test-model-d1bf18-kserve-74bd44ccff-jt7c6"]
Jul 02 17:56:05.495752 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:56:05.495720    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd28622b-6c88-49c6-b4d9-a8208ce3e081" path="/var/lib/kubelet/pods/cd28622b-6c88-49c6-b4d9-a8208ce3e081/volumes"
Jul 02 17:56:05.496157 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:56:05.496140    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd3070aa-d146-4807-a254-b4a813b5f326" path="/var/lib/kubelet/pods/fd3070aa-d146-4807-a254-b4a813b5f326/volumes"
Jul 02 17:56:59.380484 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:56:59.380437    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:56:59.815459 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:56:59.815420    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:56:59.917323 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:56:59.917288    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:57:00.016737 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:00.016708    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:57:00.122805 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:00.122732    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:57:03.359754 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:03.359723    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:57:06.299976 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:06.299936    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:57:06.396721 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:06.396683    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:57:06.559052 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:06.558924    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:57:06.809342 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:06.809230    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:57:07.017885 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:07.017844    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:57:07.397146 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:07.397111    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:57:07.561850 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:07.561809    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:57:07.662939 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:07.662863    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:57:07.820186 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:07.820145    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:57:13.627762 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:13.627712    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:57:13.697879 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:13.697836    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:57:13.901510 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:13.901396    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:57:14.133158 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:14.133124    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:57:14.530771 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:14.530734    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-85cb5d9467-289sf_63b0edae-dad2-4846-9292-e68ecef53056/authorino/0.log"
Jul 02 17:57:16.446400 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:16.446370    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-snffc"]
Jul 02 17:57:19.971826 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:19.971788    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-94s9k_7c8256b7-dd73-4aaf-b4a6-70ca72b4864b/manager/0.log"
Jul 02 17:57:20.210831 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:20.210808    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-546844fdf5-j5sp2_63713c60-9a6d-4d34-9410-a52fa9a31850/copy-manifests/0.log"
Jul 02 17:57:20.223766 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:20.223703    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-546844fdf5-j5sp2_63713c60-9a6d-4d34-9410-a52fa9a31850/manager/0.log"
Jul 02 17:57:21.707343 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:21.707312    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-85cb5d9467-289sf_63b0edae-dad2-4846-9292-e68ecef53056/authorino/0.log"
Jul 02 17:57:22.076455 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:22.076430    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-jxhnn_3287948f-6d6f-4b90-87e8-330a024eeae7/kuadrant-console-plugin/0.log"
Jul 02 17:57:22.427446 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:22.427364    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-snffc_4252bbf4-2b80-4f47-a51c-edda01e32a8f/limitador/0.log"
Jul 02 17:57:23.258748 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:23.258720    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-9bd877769-nlvhd_057410fa-77f8-4908-9eb6-148f8551c62a/kube-auth-proxy/0.log"
Jul 02 17:57:24.172037 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:24.171998    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-tts5q_559525f4-b918-470b-bcf2-c74ef8974d92/main/0.log"
Jul 02 17:57:24.526741 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:24.526706    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-gg9n4_aed43e87-7df2-4060-8f6a-cdac8066b200/main/0.log"
Jul 02 17:57:24.642801 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:24.642759    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-27446_8c229a72-60ac-4b4c-a503-8eb2dbd6a4ea/main/0.log"
Jul 02 17:57:28.231531 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:28.231493    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:57:28.622545 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:28.622467    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-cxcl8/must-gather-vzpq9"]
Jul 02 17:57:28.622857 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:28.622840    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd28622b-6c88-49c6-b4d9-a8208ce3e081" containerName="main"
Jul 02 17:57:28.622934 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:28.622860    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd28622b-6c88-49c6-b4d9-a8208ce3e081" containerName="main"
Jul 02 17:57:28.622934 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:28.622889    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd3070aa-d146-4807-a254-b4a813b5f326" containerName="main"
Jul 02 17:57:28.622934 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:28.622899    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd3070aa-d146-4807-a254-b4a813b5f326" containerName="main"
Jul 02 17:57:28.623151 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:28.623053    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd3070aa-d146-4807-a254-b4a813b5f326" containerName="main"
Jul 02 17:57:28.623151 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:28.623073    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd28622b-6c88-49c6-b4d9-a8208ce3e081" containerName="main"
Jul 02 17:57:28.625784 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:28.625768    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cxcl8/must-gather-vzpq9"
Jul 02 17:57:28.629451 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:28.629424    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-cxcl8\"/\"kube-root-ca.crt\""
Jul 02 17:57:28.629669 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:28.629651    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-cxcl8\"/\"default-dockercfg-sjc59\""
Jul 02 17:57:28.630753 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:28.630732    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-cxcl8\"/\"openshift-service-ca.crt\""
Jul 02 17:57:28.633970 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:28.633939    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:57:28.634896 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:28.634875    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cxcl8/must-gather-vzpq9"]
Jul 02 17:57:28.726153 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:28.726133    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:57:28.729273 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:28.729244    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dn7d7\" (UniqueName: \"kubernetes.io/projected/f402a69b-4c7f-4772-aed0-df2a4a36dd09-kube-api-access-dn7d7\") pod \"must-gather-vzpq9\" (UID: \"f402a69b-4c7f-4772-aed0-df2a4a36dd09\") " pod="openshift-must-gather-cxcl8/must-gather-vzpq9"
Jul 02 17:57:28.729336 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:28.729314    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f402a69b-4c7f-4772-aed0-df2a4a36dd09-must-gather-output\") pod \"must-gather-vzpq9\" (UID: \"f402a69b-4c7f-4772-aed0-df2a4a36dd09\") " pod="openshift-must-gather-cxcl8/must-gather-vzpq9"
Jul 02 17:57:28.830071 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:28.830046    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dn7d7\" (UniqueName: \"kubernetes.io/projected/f402a69b-4c7f-4772-aed0-df2a4a36dd09-kube-api-access-dn7d7\") pod \"must-gather-vzpq9\" (UID: \"f402a69b-4c7f-4772-aed0-df2a4a36dd09\") " pod="openshift-must-gather-cxcl8/must-gather-vzpq9"
Jul 02 17:57:28.830165 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:28.830114    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f402a69b-4c7f-4772-aed0-df2a4a36dd09-must-gather-output\") pod \"must-gather-vzpq9\" (UID: \"f402a69b-4c7f-4772-aed0-df2a4a36dd09\") " pod="openshift-must-gather-cxcl8/must-gather-vzpq9"
Jul 02 17:57:28.830458 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:28.830440    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f402a69b-4c7f-4772-aed0-df2a4a36dd09-must-gather-output\") pod \"must-gather-vzpq9\" (UID: \"f402a69b-4c7f-4772-aed0-df2a4a36dd09\") " pod="openshift-must-gather-cxcl8/must-gather-vzpq9"
Jul 02 17:57:28.841362 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:28.841339    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dn7d7\" (UniqueName: \"kubernetes.io/projected/f402a69b-4c7f-4772-aed0-df2a4a36dd09-kube-api-access-dn7d7\") pod \"must-gather-vzpq9\" (UID: \"f402a69b-4c7f-4772-aed0-df2a4a36dd09\") " pod="openshift-must-gather-cxcl8/must-gather-vzpq9"
Jul 02 17:57:28.935781 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:28.935728    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cxcl8/must-gather-vzpq9"
Jul 02 17:57:29.073425 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:29.073400    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cxcl8/must-gather-vzpq9"]
Jul 02 17:57:29.075585 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:57:29.075551    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf402a69b_4c7f_4772_aed0_df2a4a36dd09.slice/crio-e8f0ece637fe1ec37fd4b1866c72638f8d9a82f3e266b7e7365c44d7912479ab WatchSource:0}: Error finding container e8f0ece637fe1ec37fd4b1866c72638f8d9a82f3e266b7e7365c44d7912479ab: Status 404 returned error can't find the container with id e8f0ece637fe1ec37fd4b1866c72638f8d9a82f3e266b7e7365c44d7912479ab
Jul 02 17:57:29.077817 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:29.077798    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 17:57:29.401553 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:29.401524    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cxcl8/must-gather-vzpq9" event={"ID":"f402a69b-4c7f-4772-aed0-df2a4a36dd09","Type":"ContainerStarted","Data":"e8f0ece637fe1ec37fd4b1866c72638f8d9a82f3e266b7e7365c44d7912479ab"}
Jul 02 17:57:30.410936 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:30.410897    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cxcl8/must-gather-vzpq9" event={"ID":"f402a69b-4c7f-4772-aed0-df2a4a36dd09","Type":"ContainerStarted","Data":"4b51f98ba5ffd054785ca990becabc06aa18768dd090f7cbb6280bd9c9337318"}
Jul 02 17:57:30.411372 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:30.410947    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cxcl8/must-gather-vzpq9" event={"ID":"f402a69b-4c7f-4772-aed0-df2a4a36dd09","Type":"ContainerStarted","Data":"f4fd3dc5ef9dc0632c2bb0a6bce22f952c6707f68d4d3fd6056d39832ae536bc"}
Jul 02 17:57:30.428702 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:30.428656    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-cxcl8/must-gather-vzpq9" podStartSLOduration=1.560119422 podStartE2EDuration="2.428640557s" totalImagesPullingTime="868.521135ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:57:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:57:30.426644196 +0000 UTC m=+2805.616346859" watchObservedRunningTime="2026-07-02 17:57:30.428640557 +0000 UTC m=+2805.618343220"
Jul 02 17:57:31.480679 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:31.480631    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-cwjw5_5ac2c336-c8a9-484a-83df-60182dc9faf5/global-pull-secret-syncer/0.log"
Jul 02 17:57:31.614073 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:31.614038    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log"
Jul 02 17:57:31.741683 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:31.741603    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-67.ec2.internal_6a1d014754611bbab3feb2df8e5c006f/haproxy/0.log"
Jul 02 17:57:36.240741 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:36.240187    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-85cb5d9467-289sf_63b0edae-dad2-4846-9292-e68ecef53056/authorino/0.log"
Jul 02 17:57:36.338377 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:36.338346    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-jxhnn_3287948f-6d6f-4b90-87e8-330a024eeae7/kuadrant-console-plugin/0.log"
Jul 02 17:57:36.361515 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:36.361472    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:57:36.485117 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:36.485083    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-snffc_4252bbf4-2b80-4f47-a51c-edda01e32a8f/limitador/0.log"
Jul 02 17:57:38.222963 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:38.222926    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0f35dce1-602e-4bd1-9b81-2834013fc9f7/alertmanager/0.log"
Jul 02 17:57:38.245494 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:38.245458    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0f35dce1-602e-4bd1-9b81-2834013fc9f7/config-reloader/0.log"
Jul 02 17:57:38.266657 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:38.266622    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0f35dce1-602e-4bd1-9b81-2834013fc9f7/kube-rbac-proxy-web/0.log"
Jul 02 17:57:38.292165 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:38.292134    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0f35dce1-602e-4bd1-9b81-2834013fc9f7/kube-rbac-proxy/0.log"
Jul 02 17:57:38.314615 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:38.314583    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0f35dce1-602e-4bd1-9b81-2834013fc9f7/kube-rbac-proxy-metric/0.log"
Jul 02 17:57:38.334992 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:38.334960    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0f35dce1-602e-4bd1-9b81-2834013fc9f7/prom-label-proxy/0.log"
Jul 02 17:57:38.359843 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:38.359814    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0f35dce1-602e-4bd1-9b81-2834013fc9f7/init-config-reloader/0.log"
Jul 02 17:57:38.426380 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:38.426342    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-fdfvp_f7c9f1d9-8c54-4374-ab66-cdf83fe8aea3/kube-state-metrics/0.log"
Jul 02 17:57:38.444928 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:38.444897    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-fdfvp_f7c9f1d9-8c54-4374-ab66-cdf83fe8aea3/kube-rbac-proxy-main/0.log"
Jul 02 17:57:38.465615 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:38.465585    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-fdfvp_f7c9f1d9-8c54-4374-ab66-cdf83fe8aea3/kube-rbac-proxy-self/0.log"
Jul 02 17:57:38.496449 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:38.496366    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7d67d66d9-nbv5x_57de8b8a-3a07-4c88-ae81-f75bf58cc8ec/metrics-server/0.log"
Jul 02 17:57:38.703433 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:38.703399    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jvg8k_604eaa5c-b472-4d40-a129-779cbc619d09/node-exporter/0.log"
Jul 02 17:57:38.723073 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:38.723037    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jvg8k_604eaa5c-b472-4d40-a129-779cbc619d09/kube-rbac-proxy/0.log"
Jul 02 17:57:38.744817 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:38.744792    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jvg8k_604eaa5c-b472-4d40-a129-779cbc619d09/init-textfile/0.log"
Jul 02 17:57:38.771426 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:38.771333    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-kvz2k_2ad0a20a-c7a3-4fa9-865f-d70dbccc1c16/kube-rbac-proxy-main/0.log"
Jul 02 17:57:38.795852 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:38.795802    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-kvz2k_2ad0a20a-c7a3-4fa9-865f-d70dbccc1c16/kube-rbac-proxy-self/0.log"
Jul 02 17:57:38.816663 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:38.816633    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-kvz2k_2ad0a20a-c7a3-4fa9-865f-d70dbccc1c16/openshift-state-metrics/0.log"
Jul 02 17:57:39.180458 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:39.180427    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-57b8c984f-zk758_b9e18694-4428-4462-9bf5-b1e6b12f45b4/telemeter-client/0.log"
Jul 02 17:57:39.203250 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:39.203195    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-57b8c984f-zk758_b9e18694-4428-4462-9bf5-b1e6b12f45b4/reload/0.log"
Jul 02 17:57:39.223266 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:39.223233    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-57b8c984f-zk758_b9e18694-4428-4462-9bf5-b1e6b12f45b4/kube-rbac-proxy/0.log"
Jul 02 17:57:41.934048 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:41.933988    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5499b6fb8f-q7nf2_ab1e6175-b825-4fec-87cb-5eed477ccd71/download-server/0.log"
Jul 02 17:57:42.098451 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:42.098414    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-cxcl8/perf-node-gather-daemonset-j5vcz"]
Jul 02 17:57:42.106455 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:42.106427    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cxcl8/perf-node-gather-daemonset-j5vcz"
Jul 02 17:57:42.115854 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:42.115825    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cxcl8/perf-node-gather-daemonset-j5vcz"]
Jul 02 17:57:42.286424 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:42.286386    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e2b5b393-6548-444e-9417-971a364399a5-podres\") pod \"perf-node-gather-daemonset-j5vcz\" (UID: \"e2b5b393-6548-444e-9417-971a364399a5\") " pod="openshift-must-gather-cxcl8/perf-node-gather-daemonset-j5vcz"
Jul 02 17:57:42.286629 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:42.286461    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e2b5b393-6548-444e-9417-971a364399a5-lib-modules\") pod \"perf-node-gather-daemonset-j5vcz\" (UID: \"e2b5b393-6548-444e-9417-971a364399a5\") " pod="openshift-must-gather-cxcl8/perf-node-gather-daemonset-j5vcz"
Jul 02 17:57:42.286629 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:42.286498    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e2b5b393-6548-444e-9417-971a364399a5-sys\") pod \"perf-node-gather-daemonset-j5vcz\" (UID: \"e2b5b393-6548-444e-9417-971a364399a5\") " pod="openshift-must-gather-cxcl8/perf-node-gather-daemonset-j5vcz"
Jul 02 17:57:42.286629 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:42.286579    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e2b5b393-6548-444e-9417-971a364399a5-proc\") pod \"perf-node-gather-daemonset-j5vcz\" (UID: \"e2b5b393-6548-444e-9417-971a364399a5\") " pod="openshift-must-gather-cxcl8/perf-node-gather-daemonset-j5vcz"
Jul 02 17:57:42.286629 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:42.286623    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9pb6\" (UniqueName: \"kubernetes.io/projected/e2b5b393-6548-444e-9417-971a364399a5-kube-api-access-v9pb6\") pod \"perf-node-gather-daemonset-j5vcz\" (UID: \"e2b5b393-6548-444e-9417-971a364399a5\") " pod="openshift-must-gather-cxcl8/perf-node-gather-daemonset-j5vcz"
Jul 02 17:57:42.387955 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:42.387923    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e2b5b393-6548-444e-9417-971a364399a5-proc\") pod \"perf-node-gather-daemonset-j5vcz\" (UID: \"e2b5b393-6548-444e-9417-971a364399a5\") " pod="openshift-must-gather-cxcl8/perf-node-gather-daemonset-j5vcz"
Jul 02 17:57:42.388171 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:42.387985    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9pb6\" (UniqueName: \"kubernetes.io/projected/e2b5b393-6548-444e-9417-971a364399a5-kube-api-access-v9pb6\") pod \"perf-node-gather-daemonset-j5vcz\" (UID: \"e2b5b393-6548-444e-9417-971a364399a5\") " pod="openshift-must-gather-cxcl8/perf-node-gather-daemonset-j5vcz"
Jul 02 17:57:42.388171 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:42.388049    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e2b5b393-6548-444e-9417-971a364399a5-podres\") pod \"perf-node-gather-daemonset-j5vcz\" (UID: \"e2b5b393-6548-444e-9417-971a364399a5\") " pod="openshift-must-gather-cxcl8/perf-node-gather-daemonset-j5vcz"
Jul 02 17:57:42.388171 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:42.388103    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e2b5b393-6548-444e-9417-971a364399a5-lib-modules\") pod \"perf-node-gather-daemonset-j5vcz\" (UID: \"e2b5b393-6548-444e-9417-971a364399a5\") " pod="openshift-must-gather-cxcl8/perf-node-gather-daemonset-j5vcz"
Jul 02 17:57:42.388171 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:42.388133    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e2b5b393-6548-444e-9417-971a364399a5-sys\") pod \"perf-node-gather-daemonset-j5vcz\" (UID: \"e2b5b393-6548-444e-9417-971a364399a5\") " pod="openshift-must-gather-cxcl8/perf-node-gather-daemonset-j5vcz"
Jul 02 17:57:42.388400 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:42.388257    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e2b5b393-6548-444e-9417-971a364399a5-sys\") pod \"perf-node-gather-daemonset-j5vcz\" (UID: \"e2b5b393-6548-444e-9417-971a364399a5\") " pod="openshift-must-gather-cxcl8/perf-node-gather-daemonset-j5vcz"
Jul 02 17:57:42.388400 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:42.388319    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e2b5b393-6548-444e-9417-971a364399a5-proc\") pod \"perf-node-gather-daemonset-j5vcz\" (UID: \"e2b5b393-6548-444e-9417-971a364399a5\") " pod="openshift-must-gather-cxcl8/perf-node-gather-daemonset-j5vcz"
Jul 02 17:57:42.388664 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:42.388635    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e2b5b393-6548-444e-9417-971a364399a5-podres\") pod \"perf-node-gather-daemonset-j5vcz\" (UID: \"e2b5b393-6548-444e-9417-971a364399a5\") " pod="openshift-must-gather-cxcl8/perf-node-gather-daemonset-j5vcz"
Jul 02 17:57:42.388795 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:42.388694    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e2b5b393-6548-444e-9417-971a364399a5-lib-modules\") pod \"perf-node-gather-daemonset-j5vcz\" (UID: \"e2b5b393-6548-444e-9417-971a364399a5\") " pod="openshift-must-gather-cxcl8/perf-node-gather-daemonset-j5vcz"
Jul 02 17:57:42.396881 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:42.396848    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9pb6\" (UniqueName: \"kubernetes.io/projected/e2b5b393-6548-444e-9417-971a364399a5-kube-api-access-v9pb6\") pod \"perf-node-gather-daemonset-j5vcz\" (UID: \"e2b5b393-6548-444e-9417-971a364399a5\") " pod="openshift-must-gather-cxcl8/perf-node-gather-daemonset-j5vcz"
Jul 02 17:57:42.420290 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:42.420258    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cxcl8/perf-node-gather-daemonset-j5vcz"
Jul 02 17:57:42.599202 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:42.599169    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cxcl8/perf-node-gather-daemonset-j5vcz"]
Jul 02 17:57:42.605838 ip-10-0-143-67 kubenswrapper[2578]: W0702 17:57:42.604452    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode2b5b393_6548_444e_9417_971a364399a5.slice/crio-2282e0c7b04498ad2001d91329def528ca8879f4be0c0e06790af838ba39c307 WatchSource:0}: Error finding container 2282e0c7b04498ad2001d91329def528ca8879f4be0c0e06790af838ba39c307: Status 404 returned error can't find the container with id 2282e0c7b04498ad2001d91329def528ca8879f4be0c0e06790af838ba39c307
Jul 02 17:57:43.519433 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:43.519389    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cxcl8/perf-node-gather-daemonset-j5vcz" event={"ID":"e2b5b393-6548-444e-9417-971a364399a5","Type":"ContainerStarted","Data":"267bcce1fc6a327e90ecf110bf851a73a364b7c51e0a262c5ec24aa646039291"}
Jul 02 17:57:43.519901 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:43.519459    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cxcl8/perf-node-gather-daemonset-j5vcz" event={"ID":"e2b5b393-6548-444e-9417-971a364399a5","Type":"ContainerStarted","Data":"2282e0c7b04498ad2001d91329def528ca8879f4be0c0e06790af838ba39c307"}
Jul 02 17:57:43.520317 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:43.520291    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-cxcl8/perf-node-gather-daemonset-j5vcz"
Jul 02 17:57:43.540121 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:43.540060    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-cxcl8/perf-node-gather-daemonset-j5vcz" podStartSLOduration=1.5400406210000002 podStartE2EDuration="1.540040621s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 17:57:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:57:43.538077561 +0000 UTC m=+2818.727780418" watchObservedRunningTime="2026-07-02 17:57:43.540040621 +0000 UTC m=+2818.729743284"
Jul 02 17:57:43.576817 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:43.576781    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cfxt6_2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9/dns/0.log"
Jul 02 17:57:43.594825 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:43.594795    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cfxt6_2a55b3f2-cdc0-47e0-97fe-052fc86ba3f9/kube-rbac-proxy/0.log"
Jul 02 17:57:43.751871 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:43.751845    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vfd4d_fb0fdece-96ab-471d-87e5-89e41822fd53/dns-node-resolver/0.log"
Jul 02 17:57:44.265478 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:44.265448    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-86ddb7bc6-tk8sx_25f8baf0-6658-4bc0-bbb4-85d02f461241/registry/0.log"
Jul 02 17:57:44.328214 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:44.328180    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cr9bq_de6a6072-1ba3-44d4-8fbd-4e332b70d7a5/node-ca/0.log"
Jul 02 17:57:45.547313 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:45.547283    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-9bd877769-nlvhd_057410fa-77f8-4908-9eb6-148f8551c62a/kube-auth-proxy/0.log"
Jul 02 17:57:46.516122 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:46.516095    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-tg92m_e2ca5a7e-9ab8-4e9d-a2ca-e6df8c93a07c/serve-healthcheck-canary/0.log"
Jul 02 17:57:46.963336 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:46.963235    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5f67b55555-nz4p7_5180569c-246f-44b6-a676-52300031785d/insights-operator/0.log"
Jul 02 17:57:46.964199 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:46.964179    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5f67b55555-nz4p7_5180569c-246f-44b6-a676-52300031785d/insights-operator/1.log"
Jul 02 17:57:46.982941 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:46.982893    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-45vvn_9220e650-ec7a-485c-a786-ac5ddbfbfd22/kube-rbac-proxy/0.log"
Jul 02 17:57:47.002904 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:47.002884    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-45vvn_9220e650-ec7a-485c-a786-ac5ddbfbfd22/exporter/0.log"
Jul 02 17:57:47.022195 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:47.022168    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-45vvn_9220e650-ec7a-485c-a786-ac5ddbfbfd22/extractor/0.log"
Jul 02 17:57:49.728161 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:49.728106    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-94s9k_7c8256b7-dd73-4aaf-b4a6-70ca72b4864b/manager/0.log"
Jul 02 17:57:49.865130 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:49.865084    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-546844fdf5-j5sp2_63713c60-9a6d-4d34-9410-a52fa9a31850/manager/0.log"
Jul 02 17:57:49.879522 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:49.879488    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-546844fdf5-j5sp2_63713c60-9a6d-4d34-9410-a52fa9a31850/copy-manifests/0.log"
Jul 02 17:57:50.541156 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:50.541127    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-cxcl8/perf-node-gather-daemonset-j5vcz"
Jul 02 17:57:51.320064 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:51.320005    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7f779dbb76-jk4q7_7c8d5b08-8ed9-47c0-90fd-1038a2d26c62/manager/0.log"
Jul 02 17:57:51.786566 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:51.786504    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-9bd877769-nlvhd_057410fa-77f8-4908-9eb6-148f8551c62a/kube-auth-proxy/0.log"
Jul 02 17:57:53.422420 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:53.422322    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-9bd877769-nlvhd_057410fa-77f8-4908-9eb6-148f8551c62a/kube-auth-proxy/0.log"
Jul 02 17:57:54.478337 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:54.478297    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:57:55.729793 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:55.729722    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bvtjp_d20bc45e-c1ca-4088-ab8a-4266d1c66c8c/konnectivity-agent/0.log" limit=1024
Jul 02 17:57:56.565579 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:56.565547    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-786f9fbc5-k2sv7_a8f152d2-c52f-4a22-967a-06ab63e82320/migrator/0.log"
Jul 02 17:57:56.601435 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:56.601405    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-786f9fbc5-k2sv7_a8f152d2-c52f-4a22-967a-06ab63e82320/graceful-termination/0.log"
Jul 02 17:57:58.132572 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:58.132540    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-87dbx_2d56f816-270b-4962-b1f0-2e5b8acdb3ce/kube-multus-additional-cni-plugins/0.log"
Jul 02 17:57:58.152660 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:58.152634    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-87dbx_2d56f816-270b-4962-b1f0-2e5b8acdb3ce/egress-router-binary-copy/0.log"
Jul 02 17:57:58.172769 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:58.172747    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-87dbx_2d56f816-270b-4962-b1f0-2e5b8acdb3ce/cni-plugins/0.log"
Jul 02 17:57:58.193374 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:58.193348    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-87dbx_2d56f816-270b-4962-b1f0-2e5b8acdb3ce/bond-cni-plugin/0.log"
Jul 02 17:57:58.211564 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:58.211536    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-87dbx_2d56f816-270b-4962-b1f0-2e5b8acdb3ce/routeoverride-cni/0.log"
Jul 02 17:57:58.229988 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:58.229964    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-87dbx_2d56f816-270b-4962-b1f0-2e5b8acdb3ce/whereabouts-cni-bincopy/0.log"
Jul 02 17:57:58.250824 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:58.250804    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-87dbx_2d56f816-270b-4962-b1f0-2e5b8acdb3ce/whereabouts-cni/0.log"
Jul 02 17:57:58.480208 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:58.480185    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-kbqsq_8f4635ce-bab5-4ebd-8db9-2837729fd121/kube-multus/0.log"
Jul 02 17:57:58.620111 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:58.620084    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-g67j2_d1d3526d-01f3-4e77-a78e-ac8954a7a207/network-metrics-daemon/0.log"
Jul 02 17:57:58.636622 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:58.636598    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-g67j2_d1d3526d-01f3-4e77-a78e-ac8954a7a207/kube-rbac-proxy/0.log"
Jul 02 17:57:59.436352 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:59.436322    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-62g9m_d6628590-1cf7-4a61-9350-539f3ae7ed91/ovn-controller/0.log"
Jul 02 17:57:59.453399 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:59.453372    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-62g9m_d6628590-1cf7-4a61-9350-539f3ae7ed91/ovn-acl-logging/1.log"
Jul 02 17:57:59.453534 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:59.453460    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-62g9m_d6628590-1cf7-4a61-9350-539f3ae7ed91/ovn-acl-logging/0.log"
Jul 02 17:57:59.470846 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:59.470826    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-62g9m_d6628590-1cf7-4a61-9350-539f3ae7ed91/kube-rbac-proxy-node/0.log"
Jul 02 17:57:59.489799 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:59.489774    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-62g9m_d6628590-1cf7-4a61-9350-539f3ae7ed91/kube-rbac-proxy-ovn-metrics/0.log"
Jul 02 17:57:59.505684 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:59.505666    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-62g9m_d6628590-1cf7-4a61-9350-539f3ae7ed91/northd/0.log"
Jul 02 17:57:59.528281 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:59.528263    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-62g9m_d6628590-1cf7-4a61-9350-539f3ae7ed91/nbdb/0.log"
Jul 02 17:57:59.547247 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:59.547230    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-62g9m_d6628590-1cf7-4a61-9350-539f3ae7ed91/sbdb/0.log"
Jul 02 17:57:59.597576 ip-10-0-143-67 kubenswrapper[2578]: I0702 17:57:59.597553    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-62g9m_d6628590-1cf7-4a61-9350-539f3ae7ed91/ovnkube-controller/0.log"