Jul 13 02:54:39.481891 ip-10-0-142-39 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 13 02:54:39.481904 ip-10-0-142-39 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 13 02:54:39.481914 ip-10-0-142-39 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 13 02:54:39.482218 ip-10-0-142-39 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 13 02:54:49.730103 ip-10-0-142-39 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 13 02:54:49.730123 ip-10-0-142-39 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot ececbda0adf74c00b8a36d5c65c6cb6f --
Jul 13 02:56:23.890170 ip-10-0-142-39 systemd[1]: Starting Kubernetes Kubelet...
Jul 13 02:56:24.330040 ip-10-0-142-39 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 13 02:56:24.330040 ip-10-0-142-39 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 13 02:56:24.330040 ip-10-0-142-39 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 13 02:56:24.330040 ip-10-0-142-39 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 13 02:56:24.330040 ip-10-0-142-39 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 13 02:56:24.331220 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.331085    2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 13 02:56:24.337526 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337499    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 02:56:24.337526 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337524    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 02:56:24.337526 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337530    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 02:56:24.337673 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337537    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 02:56:24.337673 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337544    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 02:56:24.337673 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337549    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 02:56:24.337673 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337554    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 02:56:24.337673 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337560    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 02:56:24.337673 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337564    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 02:56:24.337673 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337568    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 02:56:24.337673 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337573    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 02:56:24.337673 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337577    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 02:56:24.337673 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337581    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 02:56:24.337673 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337585    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 02:56:24.337673 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337592    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 02:56:24.337673 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337596    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 02:56:24.337673 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337600    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 02:56:24.337673 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337604    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 02:56:24.337673 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337607    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 02:56:24.337673 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337611    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 02:56:24.337673 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337615    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 02:56:24.337673 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337621    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 02:56:24.337673 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337626    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 02:56:24.338188 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337630    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 02:56:24.338188 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337649    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 02:56:24.338188 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337653    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 02:56:24.338188 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337657    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 02:56:24.338188 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337660    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 02:56:24.338188 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337664    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 02:56:24.338188 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337668    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 02:56:24.338188 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337672    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 02:56:24.338188 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337677    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 02:56:24.338188 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337681    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 02:56:24.338188 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337685    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 02:56:24.338188 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337689    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 02:56:24.338188 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337693    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 02:56:24.338188 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337697    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 02:56:24.338188 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337701    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 02:56:24.338188 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337705    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 02:56:24.338188 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337709    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 02:56:24.338188 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337713    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 02:56:24.338188 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337718    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 02:56:24.338640 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337723    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 02:56:24.338640 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337727    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 02:56:24.338640 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337731    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 02:56:24.338640 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337735    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 02:56:24.338640 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337739    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 02:56:24.338640 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337742    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 02:56:24.338640 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337744    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 02:56:24.338640 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337747    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 02:56:24.338640 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337749    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 02:56:24.338640 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337752    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 02:56:24.338640 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337754    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 02:56:24.338640 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337757    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 02:56:24.338640 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337759    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 02:56:24.338640 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337762    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 02:56:24.338640 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337766    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 02:56:24.338640 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337769    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 02:56:24.338640 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337771    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 02:56:24.338640 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337774    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 02:56:24.338640 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337776    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 02:56:24.338640 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337779    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 02:56:24.339138 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337782    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 02:56:24.339138 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337784    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 02:56:24.339138 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337787    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 02:56:24.339138 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337789    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 02:56:24.339138 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337792    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 02:56:24.339138 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337794    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 02:56:24.339138 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337797    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 02:56:24.339138 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337799    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 02:56:24.339138 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337802    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 02:56:24.339138 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337804    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 02:56:24.339138 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337809    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 02:56:24.339138 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337812    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 02:56:24.339138 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337815    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 02:56:24.339138 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337818    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 02:56:24.339138 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337821    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 02:56:24.339138 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337823    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 02:56:24.339138 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337827    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 02:56:24.339138 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337832    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 02:56:24.339138 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337834    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 02:56:24.339584 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337837    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 02:56:24.339584 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337840    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 02:56:24.339584 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337843    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 02:56:24.339584 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337847    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 02:56:24.339584 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337850    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 02:56:24.339584 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337857    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 02:56:24.339584 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337860    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 02:56:24.339584 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337864    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 02:56:24.339584 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337867    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 02:56:24.339584 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337870    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 02:56:24.339584 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337873    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 02:56:24.339584 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337875    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 02:56:24.339584 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337878    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 02:56:24.339584 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337880    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 02:56:24.339584 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337883    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 02:56:24.339584 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337885    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 02:56:24.339584 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337888    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 02:56:24.339584 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.337890    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 02:56:24.339584 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338603    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 02:56:24.339584 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338610    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 02:56:24.340073 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338612    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 02:56:24.340073 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338615    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 02:56:24.340073 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338618    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 02:56:24.340073 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338621    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 02:56:24.340073 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338624    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 02:56:24.340073 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338627    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 02:56:24.340073 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338629    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 02:56:24.340073 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338632    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 02:56:24.340073 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338639    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 02:56:24.340073 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338642    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 02:56:24.340073 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338645    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 02:56:24.340073 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338648    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 02:56:24.340073 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338651    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 02:56:24.340073 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338654    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 02:56:24.340073 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338657    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 02:56:24.340073 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338660    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 02:56:24.340073 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338662    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 02:56:24.340073 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338665    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 02:56:24.340073 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338667    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 02:56:24.340584 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338672    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 02:56:24.340584 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338674    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 02:56:24.340584 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338677    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 02:56:24.340584 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338679    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 02:56:24.340584 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338682    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 02:56:24.340584 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338685    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 02:56:24.340584 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338687    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 02:56:24.340584 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338690    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 02:56:24.340584 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338692    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 02:56:24.340584 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338695    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 02:56:24.340584 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338698    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 02:56:24.340584 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338700    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 02:56:24.340584 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338703    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 02:56:24.340584 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338705    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 02:56:24.340584 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338708    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 02:56:24.340584 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338710    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 02:56:24.340584 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338712    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 02:56:24.340584 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338715    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 02:56:24.340584 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338717    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 02:56:24.340584 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338720    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 02:56:24.341083 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338725    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 02:56:24.341083 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338730    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 02:56:24.341083 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338733    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 02:56:24.341083 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338737    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 02:56:24.341083 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338740    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 02:56:24.341083 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338744    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 02:56:24.341083 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338747    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 02:56:24.341083 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338750    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 02:56:24.341083 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338753    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 02:56:24.341083 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338755    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 02:56:24.341083 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338758    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 02:56:24.341083 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338763    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 02:56:24.341083 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338766    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 02:56:24.341083 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338769    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 02:56:24.341083 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338772    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 02:56:24.341083 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338775    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 02:56:24.341083 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338778    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 02:56:24.341083 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338781    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 02:56:24.341083 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338783    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 02:56:24.341538 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338786    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 02:56:24.341538 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338789    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 02:56:24.341538 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338792    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 02:56:24.341538 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338795    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 02:56:24.341538 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338798    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 02:56:24.341538 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338800    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 02:56:24.341538 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338803    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 02:56:24.341538 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338806    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 02:56:24.341538 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338809    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 02:56:24.341538 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338811    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 02:56:24.341538 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338814    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 02:56:24.341538 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338817    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 02:56:24.341538 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338819    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 02:56:24.341538 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338822    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 02:56:24.341538 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338825    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 02:56:24.341538 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338828    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 02:56:24.341538 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338830    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 02:56:24.341538 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338833    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 02:56:24.341538 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338836    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 02:56:24.341538 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338840    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 02:56:24.342155 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338842    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 02:56:24.342155 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338845    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 02:56:24.342155 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338847    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 02:56:24.342155 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338850    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 02:56:24.342155 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338852    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 02:56:24.342155 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338854    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 02:56:24.342155 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338857    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 02:56:24.342155 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338860    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 02:56:24.342155 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338862    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 02:56:24.342155 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338865    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 02:56:24.342155 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338867    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 02:56:24.342155 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338870    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 02:56:24.342155 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338873    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 02:56:24.342155 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338875    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 02:56:24.342155 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338878    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 02:56:24.342155 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338880    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 02:56:24.342155 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338883    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 02:56:24.342155 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338885    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 02:56:24.342155 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.338888    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 02:56:24.342155 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339261    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 02:56:24.342641 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339267    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 02:56:24.342641 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339270    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 02:56:24.342641 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339273    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 02:56:24.342641 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339275    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 02:56:24.342641 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339278    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 02:56:24.342641 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339281    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 02:56:24.342641 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339283    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 02:56:24.342641 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339286    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 02:56:24.342641 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339289    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 02:56:24.342641 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339292    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 02:56:24.342641 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339294    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 02:56:24.342641 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339297    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 02:56:24.342641 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339301    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 02:56:24.342641 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339303    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 02:56:24.342641 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339306    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 02:56:24.342641 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339308    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 02:56:24.342641 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339311    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 02:56:24.342641 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339313    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 02:56:24.342641 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339317    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 02:56:24.342641 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339321    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 02:56:24.343143 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339323    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 02:56:24.343143 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339326    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 02:56:24.343143 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339329    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 02:56:24.343143 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339331    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 02:56:24.343143 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339333    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 02:56:24.343143 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339336    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 02:56:24.343143 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339338    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 02:56:24.343143 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339341    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 02:56:24.343143 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339344    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 02:56:24.343143 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339346    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 02:56:24.343143 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339348    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 02:56:24.343143 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339351    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 02:56:24.343143 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339355    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 02:56:24.343143 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339358    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 02:56:24.343143 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339362    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 02:56:24.343143 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339365    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 02:56:24.343143 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339369    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 02:56:24.343143 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339372    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 02:56:24.343143 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339375    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 02:56:24.343143 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339377    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 02:56:24.343614 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339380    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 02:56:24.343614 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339382    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 02:56:24.343614 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339385    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 02:56:24.343614 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339388    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 02:56:24.343614 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339391    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 02:56:24.343614 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339394    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 02:56:24.343614 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339397    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 02:56:24.343614 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339399    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 02:56:24.343614 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339402    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 02:56:24.343614 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339405    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 02:56:24.343614 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339407    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 02:56:24.343614 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339410    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 02:56:24.343614 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339412    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 02:56:24.343614 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339415    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 02:56:24.343614 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339417    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 02:56:24.343614 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339420    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 02:56:24.343614 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339422    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 02:56:24.343614 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339424    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 02:56:24.343614 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339427    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 02:56:24.343614 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339430    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 02:56:24.344104 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339432    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 02:56:24.344104 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339435    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 02:56:24.344104 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339437    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 02:56:24.344104 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339440    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 02:56:24.344104 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339444    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 02:56:24.344104 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339446    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 02:56:24.344104 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339448    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 02:56:24.344104 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339451    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 02:56:24.344104 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339454    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 02:56:24.344104 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339457    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 02:56:24.344104 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339459    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 02:56:24.344104 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339462    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 02:56:24.344104 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339464    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 02:56:24.344104 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339467    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 02:56:24.344104 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339469    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 02:56:24.344104 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339472    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 02:56:24.344104 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339474    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 02:56:24.344104 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339477    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 02:56:24.344104 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339480    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 02:56:24.344104 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339482    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 02:56:24.344585 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339486    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 02:56:24.344585 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339490    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 02:56:24.344585 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339493    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 02:56:24.344585 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339496    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 02:56:24.344585 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339498    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 02:56:24.344585 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339501    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 02:56:24.344585 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339504    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 02:56:24.344585 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339506    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 02:56:24.344585 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339508    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 02:56:24.344585 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339511    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 02:56:24.344585 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339513    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 02:56:24.344585 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339516    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 02:56:24.344585 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339518    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 02:56:24.344585 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339520    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 02:56:24.344585 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339523    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 02:56:24.344585 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339526    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 02:56:24.344585 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339530    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 02:56:24.344585 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.339532    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 02:56:24.344585 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339605    2563 flags.go:64] FLAG: --address="0.0.0.0"
Jul 13 02:56:24.344585 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339613    2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 13 02:56:24.345087 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339621    2563 flags.go:64] FLAG: --anonymous-auth="true"
Jul 13 02:56:24.345087 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339625    2563 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 13 02:56:24.345087 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339629    2563 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 13 02:56:24.345087 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339632    2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 13 02:56:24.345087 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339636    2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 13 02:56:24.345087 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339640    2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 13 02:56:24.345087 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339643    2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 13 02:56:24.345087 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339646    2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 13 02:56:24.345087 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339649    2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 13 02:56:24.345087 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339653    2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 13 02:56:24.345087 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339656    2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 13 02:56:24.345087 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339659    2563 flags.go:64] FLAG: --cgroup-root=""
Jul 13 02:56:24.345087 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339662    2563 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 13 02:56:24.345087 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339665    2563 flags.go:64] FLAG: --client-ca-file=""
Jul 13 02:56:24.345087 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339668    2563 flags.go:64] FLAG: --cloud-provider="external"
Jul 13 02:56:24.345087 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339671    2563 flags.go:64] FLAG: --cluster-dns="[]"
Jul 13 02:56:24.345087 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339675    2563 flags.go:64] FLAG: --cluster-domain=""
Jul 13 02:56:24.345087 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339677    2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 13 02:56:24.345087 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339680    2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 13 02:56:24.345087 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339683    2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 13 02:56:24.345087 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339686    2563 flags.go:64] FLAG: --container-log-max-files="5"
Jul 13 02:56:24.345087 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339690    2563 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 13 02:56:24.345087 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339693    2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 13 02:56:24.345660 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339696    2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 13 02:56:24.345660 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339699    2563 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 13 02:56:24.345660 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339702    2563 flags.go:64] FLAG: --contention-profiling="false"
Jul 13 02:56:24.345660 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339705    2563 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 13 02:56:24.345660 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339708    2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 13 02:56:24.345660 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339712    2563 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 13 02:56:24.345660 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339715    2563 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 13 02:56:24.345660 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339719    2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 13 02:56:24.345660 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339722    2563 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 13 02:56:24.345660 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339727    2563 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 13 02:56:24.345660 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339730    2563 flags.go:64] FLAG: --enable-load-reader="false"
Jul 13 02:56:24.345660 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339733    2563 flags.go:64] FLAG: --enable-server="true"
Jul 13 02:56:24.345660 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339735    2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 13 02:56:24.345660 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339740    2563 flags.go:64] FLAG: --event-burst="100"
Jul 13 02:56:24.345660 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339744    2563 flags.go:64] FLAG: --event-qps="50"
Jul 13 02:56:24.345660 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339747    2563 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 13 02:56:24.345660 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339750    2563 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 13 02:56:24.345660 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339752    2563 flags.go:64] FLAG: --eviction-hard=""
Jul 13 02:56:24.345660 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339756    2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 13 02:56:24.345660 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339759    2563 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 13 02:56:24.345660 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339765    2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 13 02:56:24.345660 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339768    2563 flags.go:64] FLAG: --eviction-soft=""
Jul 13 02:56:24.345660 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339771    2563 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 13 02:56:24.345660 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339774    2563 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 13 02:56:24.345660 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339777    2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 13 02:56:24.346337 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339780    2563 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 13 02:56:24.346337 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339783    2563 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 13 02:56:24.346337 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339785    2563 flags.go:64] FLAG: --fail-swap-on="true"
Jul 13 02:56:24.346337 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339788    2563 flags.go:64] FLAG: --feature-gates=""
Jul 13 02:56:24.346337 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339791    2563 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 13 02:56:24.346337 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339794    2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 13 02:56:24.346337 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339797    2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 13 02:56:24.346337 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339800    2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 13 02:56:24.346337 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339803    2563 flags.go:64] FLAG: --healthz-port="10248"
Jul 13 02:56:24.346337 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339806    2563 flags.go:64] FLAG: --help="false"
Jul 13 02:56:24.346337 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339809    2563 flags.go:64] FLAG: --hostname-override="ip-10-0-142-39.ec2.internal"
Jul 13 02:56:24.346337 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339812    2563 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 13 02:56:24.346337 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339815    2563 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 13 02:56:24.346337 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339817    2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 13 02:56:24.346337 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339821    2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 13 02:56:24.346337 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339824    2563 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 13 02:56:24.346337 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339828    2563 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 13 02:56:24.346337 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339831    2563 flags.go:64] FLAG: --image-service-endpoint=""
Jul 13 02:56:24.346337 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339834    2563 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 13 02:56:24.346337 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339837    2563 flags.go:64] FLAG: --kube-api-burst="100"
Jul 13 02:56:24.346337 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339839    2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 13 02:56:24.346337 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339842    2563 flags.go:64] FLAG: --kube-api-qps="50"
Jul 13 02:56:24.346337 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339845    2563 flags.go:64] FLAG: --kube-reserved=""
Jul 13 02:56:24.346337 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339848    2563 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 13 02:56:24.346949 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339850    2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 13 02:56:24.346949 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339853    2563 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 13 02:56:24.346949 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339856    2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 13 02:56:24.346949 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339859    2563 flags.go:64] FLAG: --lock-file=""
Jul 13 02:56:24.346949 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339863    2563 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 13 02:56:24.346949 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339865    2563 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 13 02:56:24.346949 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339868    2563 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 13 02:56:24.346949 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339878    2563 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 13 02:56:24.346949 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339880    2563 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 13 02:56:24.346949 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339883    2563 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 13 02:56:24.346949 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339885    2563 flags.go:64] FLAG: --logging-format="text"
Jul 13 02:56:24.346949 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339888    2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 13 02:56:24.346949 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339891    2563 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 13 02:56:24.346949 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339894    2563 flags.go:64] FLAG: --manifest-url=""
Jul 13 02:56:24.346949 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339897    2563 flags.go:64] FLAG: --manifest-url-header=""
Jul 13 02:56:24.346949 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339901    2563 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 13 02:56:24.346949 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339904    2563 flags.go:64] FLAG: --max-open-files="1000000"
Jul 13 02:56:24.346949 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339907    2563 flags.go:64] FLAG: --max-pods="110"
Jul 13 02:56:24.346949 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339910    2563 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 13 02:56:24.346949 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339913    2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 13 02:56:24.346949 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339916    2563 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 13 02:56:24.346949 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339919    2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 13 02:56:24.346949 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339922    2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 13 02:56:24.346949 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339924    2563 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 13 02:56:24.346949 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339947    2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 13 02:56:24.347545 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339956    2563 flags.go:64] FLAG: --node-status-max-images="50"
Jul 13 02:56:24.347545 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339959    2563 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 13 02:56:24.347545 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339962    2563 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 13 02:56:24.347545 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339965    2563 flags.go:64] FLAG: --pod-cidr=""
Jul 13 02:56:24.347545 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339967    2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 13 02:56:24.347545 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339972    2563 flags.go:64] FLAG: --pod-manifest-path=""
Jul 13 02:56:24.347545 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339975    2563 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 13 02:56:24.347545 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339978    2563 flags.go:64] FLAG: --pods-per-core="0"
Jul 13 02:56:24.347545 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339981    2563 flags.go:64] FLAG: --port="10250"
Jul 13 02:56:24.347545 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339984    2563 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 13 02:56:24.347545 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339986    2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ab9e254a86e30393"
Jul 13 02:56:24.347545 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339989    2563 flags.go:64] FLAG: --qos-reserved=""
Jul 13 02:56:24.347545 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339993    2563 flags.go:64] FLAG: --read-only-port="10255"
Jul 13 02:56:24.347545 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339996    2563 flags.go:64] FLAG: --register-node="true"
Jul 13 02:56:24.347545 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.339999    2563 flags.go:64] FLAG: --register-with-taints=""
Jul 13 02:56:24.347545 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.340002    2563 flags.go:64] FLAG: --registry-burst="10"
Jul 13 02:56:24.347545 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.340005    2563 flags.go:64] FLAG: --registry-qps="5"
Jul 13 02:56:24.347545 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.340008    2563 flags.go:64] FLAG: --reserved-cpus=""
Jul 13 02:56:24.347545 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.340010    2563 flags.go:64] FLAG: --reserved-memory=""
Jul 13 02:56:24.347545 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.340014    2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 13 02:56:24.347545 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.340017    2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 13 02:56:24.347545 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.340020    2563 flags.go:64] FLAG: --rotate-certificates="false"
Jul 13 02:56:24.347545 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.340022    2563 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 13 02:56:24.347545 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.340025    2563 flags.go:64] FLAG: --runonce="false"
Jul 13 02:56:24.347545 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.340028    2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 13 02:56:24.348166 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.340031    2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 13 02:56:24.348166 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.340034    2563 flags.go:64] FLAG: --seccomp-default="false"
Jul 13 02:56:24.348166 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.340036    2563 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 13 02:56:24.348166 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.340039    2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 13 02:56:24.348166 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.340042    2563 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 13 02:56:24.348166 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.340045    2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 13 02:56:24.348166 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.340048    2563 flags.go:64] FLAG: --storage-driver-password="root"
Jul 13 02:56:24.348166 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.340053    2563 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 13 02:56:24.348166 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.340055    2563 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 13 02:56:24.348166 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.340058    2563 flags.go:64] FLAG: --storage-driver-user="root"
Jul 13 02:56:24.348166 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.340061    2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 13 02:56:24.348166 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.340064    2563 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 13 02:56:24.348166 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.340067    2563 flags.go:64] FLAG: --system-cgroups=""
Jul 13 02:56:24.348166 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.340070    2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 13 02:56:24.348166 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.340075    2563 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 13 02:56:24.348166 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.340078    2563 flags.go:64] FLAG: --tls-cert-file=""
Jul 13 02:56:24.348166 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.340080    2563 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 13 02:56:24.348166 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.340084    2563 flags.go:64] FLAG: --tls-min-version=""
Jul 13 02:56:24.348166 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.340087    2563 flags.go:64] FLAG: --tls-private-key-file=""
Jul 13 02:56:24.348166 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.340090    2563 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 13 02:56:24.348166 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.340093    2563 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 13 02:56:24.348166 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.340096    2563 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 13 02:56:24.348166 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.340099    2563 flags.go:64] FLAG: --v="2"
Jul 13 02:56:24.348166 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.340102    2563 flags.go:64] FLAG: --version="false"
Jul 13 02:56:24.348166 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.340106    2563 flags.go:64] FLAG: --vmodule=""
Jul 13 02:56:24.348806 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.340111    2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 13 02:56:24.348806 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.340114    2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 13 02:56:24.348806 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340224    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 02:56:24.348806 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340228    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 02:56:24.348806 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340231    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 02:56:24.348806 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340234    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 02:56:24.348806 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340236    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 02:56:24.348806 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340239    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 02:56:24.348806 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340241    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 02:56:24.348806 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340244    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 02:56:24.348806 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340246    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 02:56:24.348806 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340249    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 02:56:24.348806 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340252    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 02:56:24.348806 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340254    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 02:56:24.348806 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340257    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 02:56:24.348806 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340260    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 02:56:24.348806 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340262    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 02:56:24.348806 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340265    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 02:56:24.348806 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340267    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 02:56:24.348806 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340270    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 02:56:24.349306 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340273    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 02:56:24.349306 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340275    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 02:56:24.349306 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340277    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 02:56:24.349306 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340280    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 02:56:24.349306 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340282    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 02:56:24.349306 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340285    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 02:56:24.349306 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340287    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 02:56:24.349306 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340290    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 02:56:24.349306 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340292    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 02:56:24.349306 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340295    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 02:56:24.349306 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340297    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 02:56:24.349306 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340300    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 02:56:24.349306 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340303    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 02:56:24.349306 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340306    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 02:56:24.349306 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340308    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 02:56:24.349306 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340311    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 02:56:24.349306 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340313    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 02:56:24.349306 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340316    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 02:56:24.349306 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340319    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 02:56:24.349306 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340321    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 02:56:24.349780 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340325    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 02:56:24.349780 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340329    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 02:56:24.349780 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340333    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 02:56:24.349780 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340337    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 02:56:24.349780 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340339    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 02:56:24.349780 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340342    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 02:56:24.349780 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340345    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 02:56:24.349780 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340348    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 02:56:24.349780 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340350    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 02:56:24.349780 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340353    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 02:56:24.349780 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340356    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 02:56:24.349780 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340359    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 02:56:24.349780 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340363    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 02:56:24.349780 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340366    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 02:56:24.349780 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340369    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 02:56:24.349780 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340371    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 02:56:24.349780 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340374    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 02:56:24.349780 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340377    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 02:56:24.349780 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340380    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 02:56:24.350337 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340382    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 02:56:24.350337 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340384    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 02:56:24.350337 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340387    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 02:56:24.350337 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340390    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 02:56:24.350337 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340392    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 02:56:24.350337 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340396    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 02:56:24.350337 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340399    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 02:56:24.350337 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340401    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 02:56:24.350337 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340404    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 02:56:24.350337 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340406    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 02:56:24.350337 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340409    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 02:56:24.350337 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340411    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 02:56:24.350337 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340413    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 02:56:24.350337 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340416    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 02:56:24.350337 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340418    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 02:56:24.350337 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340420    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 02:56:24.350337 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340423    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 02:56:24.350337 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340425    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 02:56:24.350337 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340428    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 02:56:24.350337 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340430    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 02:56:24.350808 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340433    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 02:56:24.350808 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340435    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 02:56:24.350808 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340437    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 02:56:24.350808 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340440    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 02:56:24.350808 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340442    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 02:56:24.350808 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340444    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 02:56:24.350808 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340447    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 02:56:24.350808 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340449    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 02:56:24.350808 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340452    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 02:56:24.350808 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340454    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 02:56:24.350808 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340464    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 02:56:24.350808 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340467    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 02:56:24.350808 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340470    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 02:56:24.350808 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340472    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 02:56:24.350808 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340475    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 02:56:24.350808 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340478    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 02:56:24.350808 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340481    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 02:56:24.350808 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340484    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 02:56:24.350808 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340486    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 02:56:24.350808 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340489    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 02:56:24.351285 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340492    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 02:56:24.351285 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.340494    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 02:56:24.351285 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.340503    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 13 02:56:24.351285 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.347633    2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 13 02:56:24.351285 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.347647    2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 13 02:56:24.351285 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.348630    2563 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 13 02:56:24.351285 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.348640    2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 13 02:56:24.351285 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348698    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 02:56:24.351285 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348704    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 02:56:24.351285 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348707    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 02:56:24.351285 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348710    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 02:56:24.351285 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348713    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 02:56:24.351285 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348716    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 02:56:24.351285 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348719    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 02:56:24.351285 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348721    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 02:56:24.351644 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348724    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 02:56:24.351644 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348726    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 02:56:24.351644 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348729    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 02:56:24.351644 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348732    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 02:56:24.351644 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348735    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 02:56:24.351644 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348737    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 02:56:24.351644 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348740    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 02:56:24.351644 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348742    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 02:56:24.351644 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348745    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 02:56:24.351644 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348747    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 02:56:24.351644 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348750    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 02:56:24.351644 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348752    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 02:56:24.351644 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348755    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 02:56:24.351644 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348757    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 02:56:24.351644 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348760    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 02:56:24.351644 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348763    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 02:56:24.351644 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348767    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 02:56:24.351644 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348770    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 02:56:24.351644 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348773    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 02:56:24.351644 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348775    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 02:56:24.352191 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348778    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 02:56:24.352191 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348782    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 02:56:24.352191 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348785    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 02:56:24.352191 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348788    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 02:56:24.352191 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348791    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 02:56:24.352191 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348793    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 02:56:24.352191 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348796    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 02:56:24.352191 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348799    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 02:56:24.352191 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348801    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 02:56:24.352191 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348804    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 02:56:24.352191 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348806    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 02:56:24.352191 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348809    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 02:56:24.352191 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348812    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 02:56:24.352191 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348814    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 02:56:24.352191 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348817    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 02:56:24.352191 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348819    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 02:56:24.352191 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348822    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 02:56:24.352191 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348826    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 02:56:24.352191 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348830    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 02:56:24.352659 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348833    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 02:56:24.352659 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348836    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 02:56:24.352659 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348838    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 02:56:24.352659 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348842    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 02:56:24.352659 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348844    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 02:56:24.352659 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348847    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 02:56:24.352659 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348849    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 02:56:24.352659 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348852    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 02:56:24.352659 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348854    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 02:56:24.352659 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348857    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 02:56:24.352659 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348859    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 02:56:24.352659 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348861    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 02:56:24.352659 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348864    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 02:56:24.352659 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348866    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 02:56:24.352659 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348870    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 02:56:24.352659 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348873    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 02:56:24.352659 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348876    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 02:56:24.352659 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348878    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 02:56:24.352659 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348881    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 02:56:24.352659 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348883    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 02:56:24.353148 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348886    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 02:56:24.353148 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348888    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 02:56:24.353148 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348891    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 02:56:24.353148 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348894    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 02:56:24.353148 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348896    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 02:56:24.353148 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348899    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 02:56:24.353148 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348901    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 02:56:24.353148 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348903    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 02:56:24.353148 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348906    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 02:56:24.353148 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348908    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 02:56:24.353148 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348911    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 02:56:24.353148 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348914    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 02:56:24.353148 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348916    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 02:56:24.353148 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348919    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 02:56:24.353148 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348921    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 02:56:24.353148 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348925    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 02:56:24.353148 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348943    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 02:56:24.353148 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348947    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 02:56:24.353148 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348950    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 02:56:24.353696 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348953    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 02:56:24.353696 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348955    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 02:56:24.353696 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348958    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 02:56:24.353696 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348961    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 02:56:24.353696 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348963    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 02:56:24.353696 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348966    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 02:56:24.353696 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348969    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 02:56:24.353696 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348972    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 02:56:24.353696 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348974    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 02:56:24.353696 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348978    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 02:56:24.353696 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348980    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 02:56:24.353696 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348983    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 02:56:24.353696 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.348986    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 02:56:24.353696 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.348991    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 13 02:56:24.353696 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349097    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 02:56:24.354078 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349102    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 02:56:24.354078 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349105    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 02:56:24.354078 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349108    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 02:56:24.354078 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349110    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 02:56:24.354078 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349113    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 02:56:24.354078 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349115    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 02:56:24.354078 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349118    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 02:56:24.354078 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349121    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 02:56:24.354078 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349123    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 02:56:24.354078 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349125    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 02:56:24.354078 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349128    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 02:56:24.354078 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349131    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 02:56:24.354078 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349133    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 02:56:24.354078 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349136    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 02:56:24.354078 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349138    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 02:56:24.354078 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349141    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 02:56:24.354078 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349143    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 02:56:24.354078 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349146    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 02:56:24.354078 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349148    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 02:56:24.354602 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349152    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 02:56:24.354602 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349156    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 02:56:24.354602 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349158    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 02:56:24.354602 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349161    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 02:56:24.354602 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349164    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 02:56:24.354602 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349167    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 02:56:24.354602 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349169    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 02:56:24.354602 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349172    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 02:56:24.354602 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349175    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 02:56:24.354602 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349177    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 02:56:24.354602 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349180    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 02:56:24.354602 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349183    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 02:56:24.354602 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349185    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 02:56:24.354602 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349187    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 02:56:24.354602 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349190    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 02:56:24.354602 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349193    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 02:56:24.354602 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349195    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 02:56:24.354602 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349198    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 02:56:24.354602 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349200    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 02:56:24.354602 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349202    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 02:56:24.355132 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349205    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 02:56:24.355132 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349207    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 02:56:24.355132 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349210    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 02:56:24.355132 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349212    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 02:56:24.355132 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349214    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 02:56:24.355132 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349217    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 02:56:24.355132 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349220    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 02:56:24.355132 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349222    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 02:56:24.355132 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349225    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 02:56:24.355132 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349228    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 02:56:24.355132 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349231    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 02:56:24.355132 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349234    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 02:56:24.355132 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349237    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 02:56:24.355132 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349240    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 02:56:24.355132 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349242    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 02:56:24.355132 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349244    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 02:56:24.355132 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349247    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 02:56:24.355132 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349249    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 02:56:24.355132 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349252    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 02:56:24.355668 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349254    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 02:56:24.355668 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349257    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 02:56:24.355668 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349260    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 02:56:24.355668 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349262    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 02:56:24.355668 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349265    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 02:56:24.355668 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349267    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 02:56:24.355668 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349270    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 02:56:24.355668 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349273    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 02:56:24.355668 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349275    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 02:56:24.355668 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349277    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 02:56:24.355668 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349280    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 02:56:24.355668 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349282    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 02:56:24.355668 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349285    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 02:56:24.355668 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349287    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 02:56:24.355668 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349290    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 02:56:24.355668 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349292    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 02:56:24.355668 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349294    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 02:56:24.355668 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349297    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 02:56:24.355668 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349299    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 02:56:24.355668 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349302    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 02:56:24.356280 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349305    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 02:56:24.356280 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349307    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 02:56:24.356280 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349310    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 02:56:24.356280 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349312    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 02:56:24.356280 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349315    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 02:56:24.356280 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349318    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 02:56:24.356280 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349320    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 02:56:24.356280 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349323    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 02:56:24.356280 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349325    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 02:56:24.356280 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349327    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 02:56:24.356280 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349330    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 02:56:24.356280 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349334    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 02:56:24.356280 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349337    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 02:56:24.356280 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349340    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 02:56:24.356280 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349342    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 02:56:24.356280 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349345    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 02:56:24.356280 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349348    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 02:56:24.356280 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349350    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 02:56:24.356280 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349353    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 02:56:24.356280 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:24.349355    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 02:56:24.356777 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.349360    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 13 02:56:24.356777 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.349457    2563 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 13 02:56:24.356777 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.351732    2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 13 02:56:24.356777 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.353287    2563 server.go:1019] "Starting client certificate rotation"
Jul 13 02:56:24.356777 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.353402    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 13 02:56:24.356777 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.353441    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 13 02:56:24.356777 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.356240    2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 13 02:56:24.357431 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.357405    2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 13 02:56:24.369443 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.369426    2563 log.go:25] "Validated CRI v1 runtime API"
Jul 13 02:56:24.371738 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.371725    2563 log.go:25] "Validated CRI v1 image API"
Jul 13 02:56:24.372580 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.372558    2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 13 02:56:24.377082 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.377065    2563 fs.go:135] Filesystem UUIDs: map[1fb41249-31b4-4fea-a7b8-02fa4d018d72:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 cf35784d-5970-4c1c-b1ed-879601748ad0:/dev/nvme0n1p4]
Jul 13 02:56:24.377147 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.377082    2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 13 02:56:24.383028 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.382911    2563 manager.go:216] Machine: {Timestamp:2026-07-13 02:56:24.380664135 +0000 UTC m=+0.363454235 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097726 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec23ab11da4ddff48eb732ce9e0e40b6 SystemUUID:ec23ab11-da4d-dff4-8eb7-32ce9e0e40b6 BootID:ececbda0-adf7-4c00-b8a3-6d5c65c6cb6f Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b7:8b:43:91:67 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b7:8b:43:91:67 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:4a:f4:11:52:ab:98 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 13 02:56:24.383028 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.383025    2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 13 02:56:24.383135 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.383096    2563 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 13 02:56:24.386859 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.386836    2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 13 02:56:24.387014 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.386861    2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-39.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 13 02:56:24.387382 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.387366    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 13 02:56:24.387685 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.387674    2563 topology_manager.go:138] "Creating topology manager with none policy"
Jul 13 02:56:24.387719 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.387687    2563 container_manager_linux.go:309] "Creating device plugin manager"
Jul 13 02:56:24.387719 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.387695    2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 13 02:56:24.388541 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.388531    2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 13 02:56:24.390293 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.390284    2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 13 02:56:24.394758 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.394747    2563 state_mem.go:36] "Initialized new in-memory state store"
Jul 13 02:56:24.394860 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.394851    2563 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 13 02:56:24.394894 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.394879    2563 kubelet.go:486] "Attempting to sync node with API server"
Jul 13 02:56:24.394894 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.394889    2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 13 02:56:24.394961 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.394905    2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 13 02:56:24.394961 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.394914    2563 kubelet.go:398] "Adding apiserver pod source"
Jul 13 02:56:24.394961 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.394922    2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 13 02:56:24.395250 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.395237    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 13 02:56:24.395309 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.395257    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 13 02:56:24.397704 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.397690    2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 13 02:56:24.399786 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.399774    2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 13 02:56:24.399827 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.399804    2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 13 02:56:24.399993 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.399982    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 13 02:56:24.400041 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.400001    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 13 02:56:24.400041 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.400007    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 13 02:56:24.400041 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.400013    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 13 02:56:24.400041 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.400021    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 13 02:56:24.400041 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.400027    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 13 02:56:24.400587 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.400575    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 13 02:56:24.400665 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.400591    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 13 02:56:24.400665 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.400601    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 13 02:56:24.400665 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.400609    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 13 02:56:24.400665 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.400631    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 13 02:56:24.400665 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.400645    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 13 02:56:24.402488 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.402476    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 13 02:56:24.402488 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.402488    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 13 02:56:24.405764 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.405750    2563 server.go:1268] "Started kubelet"
Jul 13 02:56:24.405851 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.405832    2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 13 02:56:24.405970 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.405892    2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 13 02:56:24.406022 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.405988    2563 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 13 02:56:24.406600 ip-10-0-142-39 systemd[1]: Started Kubernetes Kubelet.
Jul 13 02:56:24.407156 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.407065    2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-39.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 13 02:56:24.411912 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:24.411873    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-39.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 13 02:56:24.412014 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:24.411915    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 13 02:56:24.412160 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.412141    2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 13 02:56:24.413076 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.413056    2563 server.go:310] "Adding debug handlers to kubelet server"
Jul 13 02:56:24.413235 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:24.413210    2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 13 02:56:24.417277 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:24.416276    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-39.ec2.internal.18c1b9f3da473b69  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-39.ec2.internal,UID:ip-10-0-142-39.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-39.ec2.internal,},FirstTimestamp:2026-07-13 02:56:24.405719913 +0000 UTC m=+0.388510027,LastTimestamp:2026-07-13 02:56:24.405719913 +0000 UTC m=+0.388510027,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-39.ec2.internal,}"
Jul 13 02:56:24.419447 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.419430    2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 13 02:56:24.419535 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.419478    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 13 02:56:24.419535 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:24.419512    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-39.ec2.internal\" not found"
Jul 13 02:56:24.420179 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.420164    2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 13 02:56:24.420271 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.420228    2563 factory.go:55] Registering systemd factory
Jul 13 02:56:24.420271 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.420244    2563 factory.go:223] Registration of the systemd container factory successfully
Jul 13 02:56:24.420271 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.420166    2563 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 13 02:56:24.420394 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.420285    2563 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 13 02:56:24.420394 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.420367    2563 reconstruct.go:97] "Volume reconstruction finished"
Jul 13 02:56:24.420394 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.420376    2563 reconciler.go:29] "Reconciler: start to sync state"
Jul 13 02:56:24.420515 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.420434    2563 factory.go:153] Registering CRI-O factory
Jul 13 02:56:24.420515 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.420445    2563 factory.go:223] Registration of the crio container factory successfully
Jul 13 02:56:24.420515 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.420499    2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 13 02:56:24.420627 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.420522    2563 factory.go:103] Registering Raw factory
Jul 13 02:56:24.420627 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.420539    2563 manager.go:1196] Started watching for new ooms in manager
Jul 13 02:56:24.421198 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.421182    2563 manager.go:349] Starting recovery of all containers
Jul 13 02:56:24.430471 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:24.430305    2563 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-39.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 13 02:56:24.430471 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:24.430354    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 13 02:56:24.430879 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.430860    2563 manager.go:354] Recovery completed
Jul 13 02:56:24.435655 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.435641    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 02:56:24.437391 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.437367    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-39.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 02:56:24.437452 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.437405    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-39.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 02:56:24.437452 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.437419    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-39.ec2.internal" event="NodeHasSufficientPID"
Jul 13 02:56:24.437973 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.437949    2563 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 13 02:56:24.437973 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.437971    2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 13 02:56:24.438081 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.437984    2563 state_mem.go:36] "Initialized new in-memory state store"
Jul 13 02:56:24.438081 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.437963    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 02:56:24.438714 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.438700    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-39.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 02:56:24.438778 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.438724    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-39.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 02:56:24.438778 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.438734    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-39.ec2.internal" event="NodeHasSufficientPID"
Jul 13 02:56:24.438778 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.438770    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gtszx"
Jul 13 02:56:24.440126 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.440097    2563 policy_none.go:49] "None policy: Start"
Jul 13 02:56:24.440126 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.440121    2563 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 13 02:56:24.440226 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.440136    2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 13 02:56:24.440226 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:24.440107    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-39.ec2.internal.18c1b9f3dc2a7ba7  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-39.ec2.internal,UID:ip-10-0-142-39.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-39.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-39.ec2.internal,},FirstTimestamp:2026-07-13 02:56:24.437390247 +0000 UTC m=+0.420180347,LastTimestamp:2026-07-13 02:56:24.437390247 +0000 UTC m=+0.420180347,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-39.ec2.internal,}"
Jul 13 02:56:24.442290 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.442277    2563 policy_none.go:47] "Start"
Jul 13 02:56:24.444562 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.444541    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gtszx"
Jul 13 02:56:24.449389 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:24.449282    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-39.ec2.internal.18c1b9f3dc2ad242  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-39.ec2.internal,UID:ip-10-0-142-39.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-142-39.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-142-39.ec2.internal,},FirstTimestamp:2026-07-13 02:56:24.437412418 +0000 UTC m=+0.420202523,LastTimestamp:2026-07-13 02:56:24.437412418 +0000 UTC m=+0.420202523,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-39.ec2.internal,}"
Jul 13 02:56:24.490537 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.490520    2563 manager.go:337] "Starting Device Plugin manager"
Jul 13 02:56:24.507101 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:24.490560    2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 13 02:56:24.507101 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.490573    2563 server.go:87] "Starting device plugin registration server"
Jul 13 02:56:24.507101 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.490810    2563 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 13 02:56:24.507101 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.490821    2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 13 02:56:24.507101 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.490922    2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 13 02:56:24.507101 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.491046    2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 13 02:56:24.507101 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.491056    2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 13 02:56:24.507101 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:24.491987    2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 13 02:56:24.507101 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:24.492021    2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-39.ec2.internal\" not found"
Jul 13 02:56:24.523551 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.523527    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 13 02:56:24.524843 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.524829    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 13 02:56:24.524893 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.524862    2563 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 13 02:56:24.524893 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.524878    2563 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 13 02:56:24.525003 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:24.524911    2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 13 02:56:24.528023 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.528009    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 02:56:24.591533 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.591493    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 02:56:24.592591 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.592568    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-39.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 02:56:24.592678 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.592597    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-39.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 02:56:24.592678 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.592607    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-39.ec2.internal" event="NodeHasSufficientPID"
Jul 13 02:56:24.592678 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.592627    2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-39.ec2.internal"
Jul 13 02:56:24.600385 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.600370    2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-39.ec2.internal"
Jul 13 02:56:24.600451 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:24.600391    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-39.ec2.internal\": node \"ip-10-0-142-39.ec2.internal\" not found"
Jul 13 02:56:24.625358 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.625339    2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-39.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-39.ec2.internal"]
Jul 13 02:56:24.625451 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.625425    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 02:56:24.626118 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.626103    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-39.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 02:56:24.626188 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.626127    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-39.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 02:56:24.626188 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.626138    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-39.ec2.internal" event="NodeHasSufficientPID"
Jul 13 02:56:24.628288 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.628276    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 02:56:24.628415 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.628401    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-39.ec2.internal"
Jul 13 02:56:24.628486 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.628435    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 02:56:24.628965 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.628949    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-39.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 02:56:24.629034 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.628976    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-39.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 02:56:24.629034 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.628992    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-39.ec2.internal" event="NodeHasSufficientPID"
Jul 13 02:56:24.629034 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.628953    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-39.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 02:56:24.629144 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.629035    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-39.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 02:56:24.629144 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.629047    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-39.ec2.internal" event="NodeHasSufficientPID"
Jul 13 02:56:24.629827 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:24.629808    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-39.ec2.internal\" not found"
Jul 13 02:56:24.631113 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.631098    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-39.ec2.internal"
Jul 13 02:56:24.631162 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.631131    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 02:56:24.632046 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.632032    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-39.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 02:56:24.632121 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.632059    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-39.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 02:56:24.632121 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.632071    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-39.ec2.internal" event="NodeHasSufficientPID"
Jul 13 02:56:24.653548 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:24.653533    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-39.ec2.internal\" not found" node="ip-10-0-142-39.ec2.internal"
Jul 13 02:56:24.658003 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:24.657989    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-39.ec2.internal\" not found" node="ip-10-0-142-39.ec2.internal"
Jul 13 02:56:24.721503 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.721482    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4ecd9394d8fd6d5c9fb991ff91ceb8aa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-39.ec2.internal\" (UID: \"4ecd9394d8fd6d5c9fb991ff91ceb8aa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-39.ec2.internal"
Jul 13 02:56:24.721624 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.721506    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4ecd9394d8fd6d5c9fb991ff91ceb8aa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-39.ec2.internal\" (UID: \"4ecd9394d8fd6d5c9fb991ff91ceb8aa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-39.ec2.internal"
Jul 13 02:56:24.721624 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.721522    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/22757a058972fd2ede1c4ccbaa378251-config\") pod \"kube-apiserver-proxy-ip-10-0-142-39.ec2.internal\" (UID: \"22757a058972fd2ede1c4ccbaa378251\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-39.ec2.internal"
Jul 13 02:56:24.730312 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:24.730292    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-39.ec2.internal\" not found"
Jul 13 02:56:24.822483 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.822448    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4ecd9394d8fd6d5c9fb991ff91ceb8aa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-39.ec2.internal\" (UID: \"4ecd9394d8fd6d5c9fb991ff91ceb8aa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-39.ec2.internal"
Jul 13 02:56:24.822483 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.822488    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4ecd9394d8fd6d5c9fb991ff91ceb8aa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-39.ec2.internal\" (UID: \"4ecd9394d8fd6d5c9fb991ff91ceb8aa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-39.ec2.internal"
Jul 13 02:56:24.822625 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.822508    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/22757a058972fd2ede1c4ccbaa378251-config\") pod \"kube-apiserver-proxy-ip-10-0-142-39.ec2.internal\" (UID: \"22757a058972fd2ede1c4ccbaa378251\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-39.ec2.internal"
Jul 13 02:56:24.822625 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.822549    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4ecd9394d8fd6d5c9fb991ff91ceb8aa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-39.ec2.internal\" (UID: \"4ecd9394d8fd6d5c9fb991ff91ceb8aa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-39.ec2.internal"
Jul 13 02:56:24.822625 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.822558    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4ecd9394d8fd6d5c9fb991ff91ceb8aa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-39.ec2.internal\" (UID: \"4ecd9394d8fd6d5c9fb991ff91ceb8aa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-39.ec2.internal"
Jul 13 02:56:24.822625 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.822554    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/22757a058972fd2ede1c4ccbaa378251-config\") pod \"kube-apiserver-proxy-ip-10-0-142-39.ec2.internal\" (UID: \"22757a058972fd2ede1c4ccbaa378251\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-39.ec2.internal"
Jul 13 02:56:24.830563 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:24.830545    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-39.ec2.internal\" not found"
Jul 13 02:56:24.931459 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:24.931383    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-39.ec2.internal\" not found"
Jul 13 02:56:24.955564 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.955543    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-39.ec2.internal"
Jul 13 02:56:24.960844 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:24.960652    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-39.ec2.internal"
Jul 13 02:56:25.032279 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:25.032249    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-39.ec2.internal\" not found"
Jul 13 02:56:25.132734 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:25.132701    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-39.ec2.internal\" not found"
Jul 13 02:56:25.233307 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:25.233246    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-39.ec2.internal\" not found"
Jul 13 02:56:25.333853 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:25.333819    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-39.ec2.internal\" not found"
Jul 13 02:56:25.350172 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:25.350146    2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 02:56:25.352315 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:25.352300    2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 13 02:56:25.352419 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:25.352400    2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 13 02:56:25.352467 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:25.352426    2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 13 02:56:25.434886 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:25.434860    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-39.ec2.internal\" not found"
Jul 13 02:56:25.449014 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:25.448976    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-12 02:51:25 +0000 UTC" deadline="2028-01-30 21:57:40.860224691 +0000 UTC"
Jul 13 02:56:25.449014 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:25.449014    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13603h1m15.411215353s"
Jul 13 02:56:25.502301 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:25.502235    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 02:56:25.503448 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:25.503430    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-39.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 02:56:25.503537 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:25.503467    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-39.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 02:56:25.503537 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:25.503487    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-39.ec2.internal" event="NodeHasSufficientPID"
Jul 13 02:56:25.535579 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:25.535554    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-39.ec2.internal\" not found"
Jul 13 02:56:25.551926 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:25.551893    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22757a058972fd2ede1c4ccbaa378251.slice/crio-8c3be6724902f838912c65cc8855149ab0e26950fdce236ed616aecf757a707f WatchSource:0}: Error finding container 8c3be6724902f838912c65cc8855149ab0e26950fdce236ed616aecf757a707f: Status 404 returned error can't find the container with id 8c3be6724902f838912c65cc8855149ab0e26950fdce236ed616aecf757a707f
Jul 13 02:56:25.552161 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:25.552137    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ecd9394d8fd6d5c9fb991ff91ceb8aa.slice/crio-d6ed89fe33c59922899401f2ec17bdd61fd7b911598bbd6954fcc747b9ee3938 WatchSource:0}: Error finding container d6ed89fe33c59922899401f2ec17bdd61fd7b911598bbd6954fcc747b9ee3938: Status 404 returned error can't find the container with id d6ed89fe33c59922899401f2ec17bdd61fd7b911598bbd6954fcc747b9ee3938
Jul 13 02:56:25.556572 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:25.556546    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 02:56:25.636653 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:25.636613    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-39.ec2.internal\" not found"
Jul 13 02:56:25.737190 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:25.737157    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-39.ec2.internal\" not found"
Jul 13 02:56:25.837708 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:25.837642    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-39.ec2.internal\" not found"
Jul 13 02:56:25.855132 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:25.855109    2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 02:56:25.938568 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:25.938547    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-39.ec2.internal\" not found"
Jul 13 02:56:25.978464 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:25.978274    2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 02:56:26.020156 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.020124    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-39.ec2.internal"
Jul 13 02:56:26.031997 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.031977    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 13 02:56:26.033133 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.033111    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-39.ec2.internal"
Jul 13 02:56:26.045496 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.045475    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 13 02:56:26.348070 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.348044    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 02:56:26.396269 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.396191    2563 apiserver.go:52] "Watching apiserver"
Jul 13 02:56:26.403874 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.403848    2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 13 02:56:26.404469 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.404438    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-dfsgr","openshift-dns/node-resolver-xnfwg","openshift-multus/multus-additional-cni-plugins-f94rg","openshift-multus/multus-v5jkl","openshift-network-operator/iptables-alerter-p85gh","openshift-ovn-kubernetes/ovnkube-node-v2725","kube-system/global-pull-secret-syncer-j7pcm","kube-system/kube-apiserver-proxy-ip-10-0-142-39.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thdfw","openshift-cluster-node-tuning-operator/tuned-tjb9n","openshift-image-registry/node-ca-jvpfc","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-39.ec2.internal","openshift-multus/network-metrics-daemon-p44kl","openshift-network-diagnostics/network-check-target-24d7h"]
Jul 13 02:56:26.407848 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.407815    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j7pcm"
Jul 13 02:56:26.407991 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:26.407945    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j7pcm" podUID="6dc5ae9e-d973-46ae-9924-43fc3e1e80f7"
Jul 13 02:56:26.411191 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.411166    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p44kl"
Jul 13 02:56:26.411294 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:26.411249    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p44kl" podUID="cd0ac0dd-db5b-41c3-b69d-bcf3af528e20"
Jul 13 02:56:26.413828 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.413797    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-f94rg"
Jul 13 02:56:26.416593 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.416569    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-4zdpb\""
Jul 13 02:56:26.416967 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.416929    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 13 02:56:26.417483 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.417144    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 13 02:56:26.417483 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.417244    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-v5jkl"
Jul 13 02:56:26.417483 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.417333    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 13 02:56:26.417483 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.417340    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 13 02:56:26.417483 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.417357    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 13 02:56:26.418485 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.418463    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-p85gh"
Jul 13 02:56:26.419587 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.419568    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-qkqbj\""
Jul 13 02:56:26.419690 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.419595    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 13 02:56:26.420550 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.420524    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 13 02:56:26.420667 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.420647    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 13 02:56:26.421539 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.421006    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 13 02:56:26.421539 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.421029    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xn85p\""
Jul 13 02:56:26.421539 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.421291    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-v2725"
Jul 13 02:56:26.421539 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.421402    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 13 02:56:26.423848 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.423827    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thdfw"
Jul 13 02:56:26.424331 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.424297    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 13 02:56:26.424426 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.424301    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 13 02:56:26.424629 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.424608    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 13 02:56:26.424845 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.424831    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-fgtkk\""
Jul 13 02:56:26.425568 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.425234    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 13 02:56:26.425568 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.425427    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 13 02:56:26.425568 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.425451    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 13 02:56:26.426134 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.426118    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 13 02:56:26.426395 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.426258    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-llz4s\""
Jul 13 02:56:26.426480 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.426420    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 13 02:56:26.426480 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.426424    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dfsgr"
Jul 13 02:56:26.426988 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.426970    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 13 02:56:26.428809 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.428786    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-fx2tx\""
Jul 13 02:56:26.429098 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.429076    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 13 02:56:26.429407 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.429387    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 13 02:56:26.430011 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.429988    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xnfwg"
Jul 13 02:56:26.432729 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.432709    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 13 02:56:26.432983 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.432961    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a8933b47-8580-45ab-9f75-57c9a3f26842-systemd-units\") pod \"ovnkube-node-v2725\" (UID: \"a8933b47-8580-45ab-9f75-57c9a3f26842\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2725"
Jul 13 02:56:26.433093 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.433017    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a8933b47-8580-45ab-9f75-57c9a3f26842-host-slash\") pod \"ovnkube-node-v2725\" (UID: \"a8933b47-8580-45ab-9f75-57c9a3f26842\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2725"
Jul 13 02:56:26.433093 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.433046    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a8933b47-8580-45ab-9f75-57c9a3f26842-run-systemd\") pod \"ovnkube-node-v2725\" (UID: \"a8933b47-8580-45ab-9f75-57c9a3f26842\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2725"
Jul 13 02:56:26.433093 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.433069    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-kjln6\""
Jul 13 02:56:26.433250 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.433211    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 13 02:56:26.433250 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.433072    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a8933b47-8580-45ab-9f75-57c9a3f26842-run-openvswitch\") pod \"ovnkube-node-v2725\" (UID: \"a8933b47-8580-45ab-9f75-57c9a3f26842\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2725"
Jul 13 02:56:26.433370 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.433281    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a8933b47-8580-45ab-9f75-57c9a3f26842-node-log\") pod \"ovnkube-node-v2725\" (UID: \"a8933b47-8580-45ab-9f75-57c9a3f26842\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2725"
Jul 13 02:56:26.433370 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.433355    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/98357ee0-0a92-426c-8da6-516bf9162a68-host-var-lib-cni-multus\") pod \"multus-v5jkl\" (UID: \"98357ee0-0a92-426c-8da6-516bf9162a68\") " pod="openshift-multus/multus-v5jkl"
Jul 13 02:56:26.433477 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.433389    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/89566977-a84a-41c6-815a-dbb71c0752c6-os-release\") pod \"multus-additional-cni-plugins-f94rg\" (UID: \"89566977-a84a-41c6-815a-dbb71c0752c6\") " pod="openshift-multus/multus-additional-cni-plugins-f94rg"
Jul 13 02:56:26.433477 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.433417    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/89566977-a84a-41c6-815a-dbb71c0752c6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-f94rg\" (UID: \"89566977-a84a-41c6-815a-dbb71c0752c6\") " pod="openshift-multus/multus-additional-cni-plugins-f94rg"
Jul 13 02:56:26.433477 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.433446    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdwtz\" (UniqueName: \"kubernetes.io/projected/89566977-a84a-41c6-815a-dbb71c0752c6-kube-api-access-kdwtz\") pod \"multus-additional-cni-plugins-f94rg\" (UID: \"89566977-a84a-41c6-815a-dbb71c0752c6\") " pod="openshift-multus/multus-additional-cni-plugins-f94rg"
Jul 13 02:56:26.433634 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.433578    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/98357ee0-0a92-426c-8da6-516bf9162a68-host-run-multus-certs\") pod \"multus-v5jkl\" (UID: \"98357ee0-0a92-426c-8da6-516bf9162a68\") " pod="openshift-multus/multus-v5jkl"
Jul 13 02:56:26.433634 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.433607    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a8933b47-8580-45ab-9f75-57c9a3f26842-host-run-ovn-kubernetes\") pod \"ovnkube-node-v2725\" (UID: \"a8933b47-8580-45ab-9f75-57c9a3f26842\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2725"
Jul 13 02:56:26.433739 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.433654    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/89566977-a84a-41c6-815a-dbb71c0752c6-system-cni-dir\") pod \"multus-additional-cni-plugins-f94rg\" (UID: \"89566977-a84a-41c6-815a-dbb71c0752c6\") " pod="openshift-multus/multus-additional-cni-plugins-f94rg"
Jul 13 02:56:26.433739 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.433688    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/89566977-a84a-41c6-815a-dbb71c0752c6-cnibin\") pod \"multus-additional-cni-plugins-f94rg\" (UID: \"89566977-a84a-41c6-815a-dbb71c0752c6\") " pod="openshift-multus/multus-additional-cni-plugins-f94rg"
Jul 13 02:56:26.433739 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.433712    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/98357ee0-0a92-426c-8da6-516bf9162a68-cni-binary-copy\") pod \"multus-v5jkl\" (UID: \"98357ee0-0a92-426c-8da6-516bf9162a68\") " pod="openshift-multus/multus-v5jkl"
Jul 13 02:56:26.433877 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.433744    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/98357ee0-0a92-426c-8da6-516bf9162a68-hostroot\") pod \"multus-v5jkl\" (UID: \"98357ee0-0a92-426c-8da6-516bf9162a68\") " pod="openshift-multus/multus-v5jkl"
Jul 13 02:56:26.433877 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.433786    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/98357ee0-0a92-426c-8da6-516bf9162a68-etc-kubernetes\") pod \"multus-v5jkl\" (UID: \"98357ee0-0a92-426c-8da6-516bf9162a68\") " pod="openshift-multus/multus-v5jkl"
Jul 13 02:56:26.433991 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.433883    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a8933b47-8580-45ab-9f75-57c9a3f26842-run-ovn\") pod \"ovnkube-node-v2725\" (UID: \"a8933b47-8580-45ab-9f75-57c9a3f26842\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2725"
Jul 13 02:56:26.433991 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.433903    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a8933b47-8580-45ab-9f75-57c9a3f26842-host-cni-bin\") pod \"ovnkube-node-v2725\" (UID: \"a8933b47-8580-45ab-9f75-57c9a3f26842\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2725"
Jul 13 02:56:26.433991 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.433961    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a8933b47-8580-45ab-9f75-57c9a3f26842-host-cni-netd\") pod \"ovnkube-node-v2725\" (UID: \"a8933b47-8580-45ab-9f75-57c9a3f26842\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2725"
Jul 13 02:56:26.433991 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.433984    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6dc5ae9e-d973-46ae-9924-43fc3e1e80f7-kubelet-config\") pod \"global-pull-secret-syncer-j7pcm\" (UID: \"6dc5ae9e-d973-46ae-9924-43fc3e1e80f7\") " pod="kube-system/global-pull-secret-syncer-j7pcm"
Jul 13 02:56:26.434201 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.434037    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/98357ee0-0a92-426c-8da6-516bf9162a68-cnibin\") pod \"multus-v5jkl\" (UID: \"98357ee0-0a92-426c-8da6-516bf9162a68\") " pod="openshift-multus/multus-v5jkl"
Jul 13 02:56:26.434201 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.434058    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/98357ee0-0a92-426c-8da6-516bf9162a68-host-run-k8s-cni-cncf-io\") pod \"multus-v5jkl\" (UID: \"98357ee0-0a92-426c-8da6-516bf9162a68\") " pod="openshift-multus/multus-v5jkl"
Jul 13 02:56:26.434201 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.434073    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnjr5\" (UniqueName: \"kubernetes.io/projected/98357ee0-0a92-426c-8da6-516bf9162a68-kube-api-access-tnjr5\") pod \"multus-v5jkl\" (UID: \"98357ee0-0a92-426c-8da6-516bf9162a68\") " pod="openshift-multus/multus-v5jkl"
Jul 13 02:56:26.434201 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.434093    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a8933b47-8580-45ab-9f75-57c9a3f26842-host-run-netns\") pod \"ovnkube-node-v2725\" (UID: \"a8933b47-8580-45ab-9f75-57c9a3f26842\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2725"
Jul 13 02:56:26.434201 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.434136    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a8933b47-8580-45ab-9f75-57c9a3f26842-env-overrides\") pod \"ovnkube-node-v2725\" (UID: \"a8933b47-8580-45ab-9f75-57c9a3f26842\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2725"
Jul 13 02:56:26.434201 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.434192    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xs4j\" (UniqueName: \"kubernetes.io/projected/a8933b47-8580-45ab-9f75-57c9a3f26842-kube-api-access-5xs4j\") pod \"ovnkube-node-v2725\" (UID: \"a8933b47-8580-45ab-9f75-57c9a3f26842\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2725"
Jul 13 02:56:26.434443 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.434246    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a8933b47-8580-45ab-9f75-57c9a3f26842-var-lib-openvswitch\") pod \"ovnkube-node-v2725\" (UID: \"a8933b47-8580-45ab-9f75-57c9a3f26842\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2725"
Jul 13 02:56:26.434443 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.434312    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tjb9n"
Jul 13 02:56:26.434443 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.434324    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a8933b47-8580-45ab-9f75-57c9a3f26842-ovn-node-metrics-cert\") pod \"ovnkube-node-v2725\" (UID: \"a8933b47-8580-45ab-9f75-57c9a3f26842\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2725"
Jul 13 02:56:26.434443 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.434398    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a8933b47-8580-45ab-9f75-57c9a3f26842-ovnkube-script-lib\") pod \"ovnkube-node-v2725\" (UID: \"a8933b47-8580-45ab-9f75-57c9a3f26842\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2725"
Jul 13 02:56:26.434597 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.434444    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/89566977-a84a-41c6-815a-dbb71c0752c6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-f94rg\" (UID: \"89566977-a84a-41c6-815a-dbb71c0752c6\") " pod="openshift-multus/multus-additional-cni-plugins-f94rg"
Jul 13 02:56:26.434597 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.434480    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6dc5ae9e-d973-46ae-9924-43fc3e1e80f7-dbus\") pod \"global-pull-secret-syncer-j7pcm\" (UID: \"6dc5ae9e-d973-46ae-9924-43fc3e1e80f7\") " pod="kube-system/global-pull-secret-syncer-j7pcm"
Jul 13 02:56:26.434597 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.434524    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/98357ee0-0a92-426c-8da6-516bf9162a68-host-var-lib-cni-bin\") pod \"multus-v5jkl\" (UID: \"98357ee0-0a92-426c-8da6-516bf9162a68\") " pod="openshift-multus/multus-v5jkl"
Jul 13 02:56:26.434597 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.434574    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a8933b47-8580-45ab-9f75-57c9a3f26842-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v2725\" (UID: \"a8933b47-8580-45ab-9f75-57c9a3f26842\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2725"
Jul 13 02:56:26.434780 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.434629    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a8933b47-8580-45ab-9f75-57c9a3f26842-ovnkube-config\") pod \"ovnkube-node-v2725\" (UID: \"a8933b47-8580-45ab-9f75-57c9a3f26842\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2725"
Jul 13 02:56:26.434780 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.434656    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75ms9\" (UniqueName: \"kubernetes.io/projected/cd0ac0dd-db5b-41c3-b69d-bcf3af528e20-kube-api-access-75ms9\") pod \"network-metrics-daemon-p44kl\" (UID: \"cd0ac0dd-db5b-41c3-b69d-bcf3af528e20\") " pod="openshift-multus/network-metrics-daemon-p44kl"
Jul 13 02:56:26.434780 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.434689    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/89566977-a84a-41c6-815a-dbb71c0752c6-cni-binary-copy\") pod \"multus-additional-cni-plugins-f94rg\" (UID: \"89566977-a84a-41c6-815a-dbb71c0752c6\") " pod="openshift-multus/multus-additional-cni-plugins-f94rg"
Jul 13 02:56:26.434780 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.434736    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/98357ee0-0a92-426c-8da6-516bf9162a68-multus-cni-dir\") pod \"multus-v5jkl\" (UID: \"98357ee0-0a92-426c-8da6-516bf9162a68\") " pod="openshift-multus/multus-v5jkl"
Jul 13 02:56:26.434780 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.434760    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/98357ee0-0a92-426c-8da6-516bf9162a68-multus-socket-dir-parent\") pod \"multus-v5jkl\" (UID: \"98357ee0-0a92-426c-8da6-516bf9162a68\") " pod="openshift-multus/multus-v5jkl"
Jul 13 02:56:26.434987 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.434789    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/adf25180-4382-4582-b363-81a08923156a-iptables-alerter-script\") pod \"iptables-alerter-p85gh\" (UID: \"adf25180-4382-4582-b363-81a08923156a\") " pod="openshift-network-operator/iptables-alerter-p85gh"
Jul 13 02:56:26.434987 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.434811    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a8933b47-8580-45ab-9f75-57c9a3f26842-host-kubelet\") pod \"ovnkube-node-v2725\" (UID: \"a8933b47-8580-45ab-9f75-57c9a3f26842\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2725"
Jul 13 02:56:26.434987 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.434849    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a8933b47-8580-45ab-9f75-57c9a3f26842-etc-openvswitch\") pod \"ovnkube-node-v2725\" (UID: \"a8933b47-8580-45ab-9f75-57c9a3f26842\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2725"
Jul 13 02:56:26.434987 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.434872    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a8933b47-8580-45ab-9f75-57c9a3f26842-log-socket\") pod \"ovnkube-node-v2725\" (UID: \"a8933b47-8580-45ab-9f75-57c9a3f26842\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2725"
Jul 13 02:56:26.434987 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.434898    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd0ac0dd-db5b-41c3-b69d-bcf3af528e20-metrics-certs\") pod \"network-metrics-daemon-p44kl\" (UID: \"cd0ac0dd-db5b-41c3-b69d-bcf3af528e20\") " pod="openshift-multus/network-metrics-daemon-p44kl"
Jul 13 02:56:26.434987 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.434916    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/89566977-a84a-41c6-815a-dbb71c0752c6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-f94rg\" (UID: \"89566977-a84a-41c6-815a-dbb71c0752c6\") " pod="openshift-multus/multus-additional-cni-plugins-f94rg"
Jul 13 02:56:26.434987 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.434931    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/98357ee0-0a92-426c-8da6-516bf9162a68-system-cni-dir\") pod \"multus-v5jkl\" (UID: \"98357ee0-0a92-426c-8da6-516bf9162a68\") " pod="openshift-multus/multus-v5jkl"
Jul 13 02:56:26.434987 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.434946    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/98357ee0-0a92-426c-8da6-516bf9162a68-os-release\") pod \"multus-v5jkl\" (UID: \"98357ee0-0a92-426c-8da6-516bf9162a68\") " pod="openshift-multus/multus-v5jkl"
Jul 13 02:56:26.435329 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.434991    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/98357ee0-0a92-426c-8da6-516bf9162a68-host-run-netns\") pod \"multus-v5jkl\" (UID: \"98357ee0-0a92-426c-8da6-516bf9162a68\") " pod="openshift-multus/multus-v5jkl"
Jul 13 02:56:26.435329 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.435015    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/98357ee0-0a92-426c-8da6-516bf9162a68-host-var-lib-kubelet\") pod \"multus-v5jkl\" (UID: \"98357ee0-0a92-426c-8da6-516bf9162a68\") " pod="openshift-multus/multus-v5jkl"
Jul 13 02:56:26.435329 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.435041    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/98357ee0-0a92-426c-8da6-516bf9162a68-multus-conf-dir\") pod \"multus-v5jkl\" (UID: \"98357ee0-0a92-426c-8da6-516bf9162a68\") " pod="openshift-multus/multus-v5jkl"
Jul 13 02:56:26.435329 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.435063    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/98357ee0-0a92-426c-8da6-516bf9162a68-multus-daemon-config\") pod \"multus-v5jkl\" (UID: \"98357ee0-0a92-426c-8da6-516bf9162a68\") " pod="openshift-multus/multus-v5jkl"
Jul 13 02:56:26.435329 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.435102    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6dc5ae9e-d973-46ae-9924-43fc3e1e80f7-original-pull-secret\") pod \"global-pull-secret-syncer-j7pcm\" (UID: \"6dc5ae9e-d973-46ae-9924-43fc3e1e80f7\") " pod="kube-system/global-pull-secret-syncer-j7pcm"
Jul 13 02:56:26.435329 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.435171    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/adf25180-4382-4582-b363-81a08923156a-host-slash\") pod \"iptables-alerter-p85gh\" (UID: \"adf25180-4382-4582-b363-81a08923156a\") " pod="openshift-network-operator/iptables-alerter-p85gh"
Jul 13 02:56:26.435329 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.435207    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7p6bj\" (UniqueName: \"kubernetes.io/projected/adf25180-4382-4582-b363-81a08923156a-kube-api-access-7p6bj\") pod \"iptables-alerter-p85gh\" (UID: \"adf25180-4382-4582-b363-81a08923156a\") " pod="openshift-network-operator/iptables-alerter-p85gh"
Jul 13 02:56:26.435548 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.435373    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 13 02:56:26.436848 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.436824    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-v2j4p\""
Jul 13 02:56:26.437006 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.436988    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 13 02:56:26.437486 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.437168    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 13 02:56:26.437486 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.437432    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jvpfc"
Jul 13 02:56:26.439848 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.439808    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 13 02:56:26.440020 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.439911    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 13 02:56:26.440020 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.440003    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-24d7h"
Jul 13 02:56:26.440140 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:26.440063    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-24d7h" podUID="71eff5ef-6532-42ba-b932-2911cfaedcac"
Jul 13 02:56:26.440140 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.440119    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 13 02:56:26.440923 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.440766    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-bqzp9\""
Jul 13 02:56:26.461777 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.461751    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-2v6kc"
Jul 13 02:56:26.469864 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.469829    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-2v6kc"
Jul 13 02:56:26.521157 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.521134    2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 13 02:56:26.529295 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.529240    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-39.ec2.internal" event={"ID":"4ecd9394d8fd6d5c9fb991ff91ceb8aa","Type":"ContainerStarted","Data":"d6ed89fe33c59922899401f2ec17bdd61fd7b911598bbd6954fcc747b9ee3938"}
Jul 13 02:56:26.530466 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.530441    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-39.ec2.internal" event={"ID":"22757a058972fd2ede1c4ccbaa378251","Type":"ContainerStarted","Data":"8c3be6724902f838912c65cc8855149ab0e26950fdce236ed616aecf757a707f"}
Jul 13 02:56:26.535469 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.535398    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/98357ee0-0a92-426c-8da6-516bf9162a68-host-var-lib-cni-multus\") pod \"multus-v5jkl\" (UID: \"98357ee0-0a92-426c-8da6-516bf9162a68\") " pod="openshift-multus/multus-v5jkl"
Jul 13 02:56:26.535572 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.535466    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/89566977-a84a-41c6-815a-dbb71c0752c6-os-release\") pod \"multus-additional-cni-plugins-f94rg\" (UID: \"89566977-a84a-41c6-815a-dbb71c0752c6\") " pod="openshift-multus/multus-additional-cni-plugins-f94rg"
Jul 13 02:56:26.535572 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.535525    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/98357ee0-0a92-426c-8da6-516bf9162a68-host-var-lib-cni-multus\") pod \"multus-v5jkl\" (UID: \"98357ee0-0a92-426c-8da6-516bf9162a68\") " pod="openshift-multus/multus-v5jkl"
Jul 13 02:56:26.535572 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.535538    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/89566977-a84a-41c6-815a-dbb71c0752c6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-f94rg\" (UID: \"89566977-a84a-41c6-815a-dbb71c0752c6\") " pod="openshift-multus/multus-additional-cni-plugins-f94rg"
Jul 13 02:56:26.535737 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.535584    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdwtz\" (UniqueName: \"kubernetes.io/projected/89566977-a84a-41c6-815a-dbb71c0752c6-kube-api-access-kdwtz\") pod \"multus-additional-cni-plugins-f94rg\" (UID: \"89566977-a84a-41c6-815a-dbb71c0752c6\") " pod="openshift-multus/multus-additional-cni-plugins-f94rg"
Jul 13 02:56:26.535737 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.535614    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a8933b47-8580-45ab-9f75-57c9a3f26842-host-cni-netd\") pod \"ovnkube-node-v2725\" (UID: \"a8933b47-8580-45ab-9f75-57c9a3f26842\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2725"
Jul 13 02:56:26.535737 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.535634    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/89566977-a84a-41c6-815a-dbb71c0752c6-os-release\") pod \"multus-additional-cni-plugins-f94rg\" (UID: \"89566977-a84a-41c6-815a-dbb71c0752c6\") " pod="openshift-multus/multus-additional-cni-plugins-f94rg"
Jul 13 02:56:26.535737 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.535643    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a8933b47-8580-45ab-9f75-57c9a3f26842-ovn-node-metrics-cert\") pod \"ovnkube-node-v2725\" (UID: \"a8933b47-8580-45ab-9f75-57c9a3f26842\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2725"
Jul 13 02:56:26.535737 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.535673    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bbf72fd6-813d-4e7e-8168-7b41c4605230-host\") pod \"node-ca-jvpfc\" (UID: \"bbf72fd6-813d-4e7e-8168-7b41c4605230\") " pod="openshift-image-registry/node-ca-jvpfc"
Jul 13 02:56:26.535737 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.535699    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x56x9\" (UniqueName: \"kubernetes.io/projected/b3b58c31-485d-4010-b36b-049e6006b525-kube-api-access-x56x9\") pod \"node-resolver-xnfwg\" (UID: \"b3b58c31-485d-4010-b36b-049e6006b525\") " pod="openshift-dns/node-resolver-xnfwg"
Jul 13 02:56:26.535737 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.535711    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a8933b47-8580-45ab-9f75-57c9a3f26842-host-cni-netd\") pod \"ovnkube-node-v2725\" (UID: \"a8933b47-8580-45ab-9f75-57c9a3f26842\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2725"
Jul 13 02:56:26.535737 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.535729    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/98357ee0-0a92-426c-8da6-516bf9162a68-hostroot\") pod \"multus-v5jkl\" (UID: \"98357ee0-0a92-426c-8da6-516bf9162a68\") " pod="openshift-multus/multus-v5jkl"
Jul 13 02:56:26.536152 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.535772    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/98357ee0-0a92-426c-8da6-516bf9162a68-hostroot\") pod \"multus-v5jkl\" (UID: \"98357ee0-0a92-426c-8da6-516bf9162a68\") " pod="openshift-multus/multus-v5jkl"
Jul 13 02:56:26.536152 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.535770    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a8933b47-8580-45ab-9f75-57c9a3f26842-env-overrides\") pod \"ovnkube-node-v2725\" (UID: \"a8933b47-8580-45ab-9f75-57c9a3f26842\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2725"
Jul 13 02:56:26.536152 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.536041    2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 13 02:56:26.536152 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.536086    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3a6d5aea-0e22-4c6b-9ef3-802b77524517-etc-sysconfig\") pod \"tuned-tjb9n\" (UID: \"3a6d5aea-0e22-4c6b-9ef3-802b77524517\") " pod="openshift-cluster-node-tuning-operator/tuned-tjb9n"
Jul 13 02:56:26.536152 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.536117    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3a6d5aea-0e22-4c6b-9ef3-802b77524517-lib-modules\") pod \"tuned-tjb9n\" (UID: \"3a6d5aea-0e22-4c6b-9ef3-802b77524517\") " pod="openshift-cluster-node-tuning-operator/tuned-tjb9n"
Jul 13 02:56:26.536152 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.536149    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58sns\" (UniqueName: \"kubernetes.io/projected/71eff5ef-6532-42ba-b932-2911cfaedcac-kube-api-access-58sns\") pod \"network-check-target-24d7h\" (UID: \"71eff5ef-6532-42ba-b932-2911cfaedcac\") " pod="openshift-network-diagnostics/network-check-target-24d7h"
Jul 13 02:56:26.536419 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.536178    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/98357ee0-0a92-426c-8da6-516bf9162a68-cnibin\") pod \"multus-v5jkl\" (UID: \"98357ee0-0a92-426c-8da6-516bf9162a68\") " pod="openshift-multus/multus-v5jkl"
Jul 13 02:56:26.536419 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.536197    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/98357ee0-0a92-426c-8da6-516bf9162a68-host-run-k8s-cni-cncf-io\") pod \"multus-v5jkl\" (UID: \"98357ee0-0a92-426c-8da6-516bf9162a68\") " pod="openshift-multus/multus-v5jkl"
Jul 13 02:56:26.536419 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.536215    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a8933b47-8580-45ab-9f75-57c9a3f26842-var-lib-openvswitch\") pod \"ovnkube-node-v2725\" (UID: \"a8933b47-8580-45ab-9f75-57c9a3f26842\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2725"
Jul 13 02:56:26.536419 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.536237    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/89566977-a84a-41c6-815a-dbb71c0752c6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-f94rg\" (UID: \"89566977-a84a-41c6-815a-dbb71c0752c6\") " pod="openshift-multus/multus-additional-cni-plugins-f94rg"
Jul 13 02:56:26.536419 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.536243    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s89g4\" (UniqueName: \"kubernetes.io/projected/d365a05b-69cd-4a21-b6cf-d16d5560c7f3-kube-api-access-s89g4\") pod \"aws-ebs-csi-driver-node-thdfw\" (UID: \"d365a05b-69cd-4a21-b6cf-d16d5560c7f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thdfw"
Jul 13 02:56:26.536419 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.536318    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3a6d5aea-0e22-4c6b-9ef3-802b77524517-etc-systemd\") pod \"tuned-tjb9n\" (UID: \"3a6d5aea-0e22-4c6b-9ef3-802b77524517\") " pod="openshift-cluster-node-tuning-operator/tuned-tjb9n"
Jul 13 02:56:26.536419 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.536345    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a6d5aea-0e22-4c6b-9ef3-802b77524517-tmp\") pod \"tuned-tjb9n\" (UID: \"3a6d5aea-0e22-4c6b-9ef3-802b77524517\") " pod="openshift-cluster-node-tuning-operator/tuned-tjb9n"
Jul 13 02:56:26.536419 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.536320    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a8933b47-8580-45ab-9f75-57c9a3f26842-var-lib-openvswitch\") pod \"ovnkube-node-v2725\" (UID: \"a8933b47-8580-45ab-9f75-57c9a3f26842\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2725"
Jul 13 02:56:26.536419 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.536352    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/98357ee0-0a92-426c-8da6-516bf9162a68-host-run-k8s-cni-cncf-io\") pod \"multus-v5jkl\" (UID: \"98357ee0-0a92-426c-8da6-516bf9162a68\") " pod="openshift-multus/multus-v5jkl"
Jul 13 02:56:26.536419 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.536374    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6dc5ae9e-d973-46ae-9924-43fc3e1e80f7-dbus\") pod \"global-pull-secret-syncer-j7pcm\" (UID: \"6dc5ae9e-d973-46ae-9924-43fc3e1e80f7\") " pod="kube-system/global-pull-secret-syncer-j7pcm"
Jul 13 02:56:26.536419 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.536382    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/98357ee0-0a92-426c-8da6-516bf9162a68-cnibin\") pod \"multus-v5jkl\" (UID: \"98357ee0-0a92-426c-8da6-516bf9162a68\") " pod="openshift-multus/multus-v5jkl"
Jul 13 02:56:26.536419 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.536399    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/98357ee0-0a92-426c-8da6-516bf9162a68-host-var-lib-cni-bin\") pod \"multus-v5jkl\" (UID: \"98357ee0-0a92-426c-8da6-516bf9162a68\") " pod="openshift-multus/multus-v5jkl"
Jul 13 02:56:26.536897 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.536445    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d365a05b-69cd-4a21-b6cf-d16d5560c7f3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-thdfw\" (UID: \"d365a05b-69cd-4a21-b6cf-d16d5560c7f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thdfw"
Jul 13 02:56:26.536897 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.536447    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/98357ee0-0a92-426c-8da6-516bf9162a68-host-var-lib-cni-bin\") pod \"multus-v5jkl\" (UID: \"98357ee0-0a92-426c-8da6-516bf9162a68\") " pod="openshift-multus/multus-v5jkl"
Jul 13 02:56:26.536897 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.536469    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d365a05b-69cd-4a21-b6cf-d16d5560c7f3-device-dir\") pod \"aws-ebs-csi-driver-node-thdfw\" (UID: \"d365a05b-69cd-4a21-b6cf-d16d5560c7f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thdfw"
Jul 13 02:56:26.536897 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.536491    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d365a05b-69cd-4a21-b6cf-d16d5560c7f3-etc-selinux\") pod \"aws-ebs-csi-driver-node-thdfw\" (UID: \"d365a05b-69cd-4a21-b6cf-d16d5560c7f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thdfw"
Jul 13 02:56:26.536897 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.536527    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3a6d5aea-0e22-4c6b-9ef3-802b77524517-etc-kubernetes\") pod \"tuned-tjb9n\" (UID: \"3a6d5aea-0e22-4c6b-9ef3-802b77524517\") " pod="openshift-cluster-node-tuning-operator/tuned-tjb9n"
Jul 13 02:56:26.536897 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.536573    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75ms9\" (UniqueName: \"kubernetes.io/projected/cd0ac0dd-db5b-41c3-b69d-bcf3af528e20-kube-api-access-75ms9\") pod \"network-metrics-daemon-p44kl\" (UID: \"cd0ac0dd-db5b-41c3-b69d-bcf3af528e20\") " pod="openshift-multus/network-metrics-daemon-p44kl"
Jul 13 02:56:26.536897 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.536528    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6dc5ae9e-d973-46ae-9924-43fc3e1e80f7-dbus\") pod \"global-pull-secret-syncer-j7pcm\" (UID: \"6dc5ae9e-d973-46ae-9924-43fc3e1e80f7\") " pod="kube-system/global-pull-secret-syncer-j7pcm"
Jul 13 02:56:26.536897 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.536601    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/98357ee0-0a92-426c-8da6-516bf9162a68-multus-cni-dir\") pod \"multus-v5jkl\" (UID: \"98357ee0-0a92-426c-8da6-516bf9162a68\") " pod="openshift-multus/multus-v5jkl"
Jul 13 02:56:26.536897 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.536628    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/98357ee0-0a92-426c-8da6-516bf9162a68-multus-socket-dir-parent\") pod \"multus-v5jkl\" (UID: \"98357ee0-0a92-426c-8da6-516bf9162a68\") " pod="openshift-multus/multus-v5jkl"
Jul 13 02:56:26.536897 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.536757    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/98357ee0-0a92-426c-8da6-516bf9162a68-multus-socket-dir-parent\") pod \"multus-v5jkl\" (UID: \"98357ee0-0a92-426c-8da6-516bf9162a68\") " pod="openshift-multus/multus-v5jkl"
Jul 13 02:56:26.536897 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.536727    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/98357ee0-0a92-426c-8da6-516bf9162a68-multus-cni-dir\") pod \"multus-v5jkl\" (UID: \"98357ee0-0a92-426c-8da6-516bf9162a68\") " pod="openshift-multus/multus-v5jkl"
Jul 13 02:56:26.536897 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.536764    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/adf25180-4382-4582-b363-81a08923156a-iptables-alerter-script\") pod \"iptables-alerter-p85gh\" (UID: \"adf25180-4382-4582-b363-81a08923156a\") " pod="openshift-network-operator/iptables-alerter-p85gh"
Jul 13 02:56:26.536897 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.536809    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a8933b47-8580-45ab-9f75-57c9a3f26842-host-kubelet\") pod \"ovnkube-node-v2725\" (UID: \"a8933b47-8580-45ab-9f75-57c9a3f26842\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2725"
Jul 13 02:56:26.536897 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.536833    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a8933b47-8580-45ab-9f75-57c9a3f26842-etc-openvswitch\") pod \"ovnkube-node-v2725\" (UID: \"a8933b47-8580-45ab-9f75-57c9a3f26842\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2725"
Jul 13 02:56:26.536897 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.536858    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a8933b47-8580-45ab-9f75-57c9a3f26842-ovnkube-script-lib\") pod \"ovnkube-node-v2725\" (UID: \"a8933b47-8580-45ab-9f75-57c9a3f26842\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2725"
Jul 13 02:56:26.536897 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.536887    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a8933b47-8580-45ab-9f75-57c9a3f26842-etc-openvswitch\") pod \"ovnkube-node-v2725\" (UID: \"a8933b47-8580-45ab-9f75-57c9a3f26842\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2725"
Jul 13 02:56:26.536897 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.536894    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3a6d5aea-0e22-4c6b-9ef3-802b77524517-etc-sysctl-d\") pod \"tuned-tjb9n\" (UID: \"3a6d5aea-0e22-4c6b-9ef3-802b77524517\") " pod="openshift-cluster-node-tuning-operator/tuned-tjb9n"
Jul 13 02:56:26.537908 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.536886    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a8933b47-8580-45ab-9f75-57c9a3f26842-host-kubelet\") pod \"ovnkube-node-v2725\" (UID: \"a8933b47-8580-45ab-9f75-57c9a3f26842\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2725"
Jul 13 02:56:26.537908 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.536926    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd0ac0dd-db5b-41c3-b69d-bcf3af528e20-metrics-certs\") pod \"network-metrics-daemon-p44kl\" (UID: \"cd0ac0dd-db5b-41c3-b69d-bcf3af528e20\") " pod="openshift-multus/network-metrics-daemon-p44kl"
Jul 13 02:56:26.537908 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.536951    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/98357ee0-0a92-426c-8da6-516bf9162a68-system-cni-dir\") pod \"multus-v5jkl\" (UID: \"98357ee0-0a92-426c-8da6-516bf9162a68\") " pod="openshift-multus/multus-v5jkl"
Jul 13 02:56:26.537908 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.536992    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/98357ee0-0a92-426c-8da6-516bf9162a68-os-release\") pod \"multus-v5jkl\" (UID: \"98357ee0-0a92-426c-8da6-516bf9162a68\") " pod="openshift-multus/multus-v5jkl"
Jul 13 02:56:26.537908 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.537017    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/98357ee0-0a92-426c-8da6-516bf9162a68-host-run-netns\") pod \"multus-v5jkl\" (UID: \"98357ee0-0a92-426c-8da6-516bf9162a68\") " pod="openshift-multus/multus-v5jkl"
Jul 13 02:56:26.537908 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.537060    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/98357ee0-0a92-426c-8da6-516bf9162a68-host-var-lib-kubelet\") pod \"multus-v5jkl\" (UID: \"98357ee0-0a92-426c-8da6-516bf9162a68\") " pod="openshift-multus/multus-v5jkl"
Jul 13 02:56:26.537908 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.537092    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/98357ee0-0a92-426c-8da6-516bf9162a68-multus-conf-dir\") pod \"multus-v5jkl\" (UID: \"98357ee0-0a92-426c-8da6-516bf9162a68\") " pod="openshift-multus/multus-v5jkl"
Jul 13 02:56:26.537908 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.537123    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/98357ee0-0a92-426c-8da6-516bf9162a68-multus-daemon-config\") pod \"multus-v5jkl\" (UID: \"98357ee0-0a92-426c-8da6-516bf9162a68\") " pod="openshift-multus/multus-v5jkl"
Jul 13 02:56:26.537908 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.537154    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a8933b47-8580-45ab-9f75-57c9a3f26842-host-run-ovn-kubernetes\") pod \"ovnkube-node-v2725\" (UID: \"a8933b47-8580-45ab-9f75-57c9a3f26842\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2725"
Jul 13 02:56:26.537908 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.537181    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7vb8\" (UniqueName: \"kubernetes.io/projected/bbf72fd6-813d-4e7e-8168-7b41c4605230-kube-api-access-b7vb8\") pod \"node-ca-jvpfc\" (UID: \"bbf72fd6-813d-4e7e-8168-7b41c4605230\") " pod="openshift-image-registry/node-ca-jvpfc"
Jul 13 02:56:26.537908 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.537206    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3a6d5aea-0e22-4c6b-9ef3-802b77524517-etc-modprobe-d\") pod \"tuned-tjb9n\" (UID: \"3a6d5aea-0e22-4c6b-9ef3-802b77524517\") " pod="openshift-cluster-node-tuning-operator/tuned-tjb9n"
Jul 13 02:56:26.537908 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.537232    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3a6d5aea-0e22-4c6b-9ef3-802b77524517-var-lib-kubelet\") pod \"tuned-tjb9n\" (UID: \"3a6d5aea-0e22-4c6b-9ef3-802b77524517\") " pod="openshift-cluster-node-tuning-operator/tuned-tjb9n"
Jul 13 02:56:26.537908 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.537279    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/98357ee0-0a92-426c-8da6-516bf9162a68-host-run-multus-certs\") pod \"multus-v5jkl\" (UID: \"98357ee0-0a92-426c-8da6-516bf9162a68\") " pod="openshift-multus/multus-v5jkl"
Jul 13 02:56:26.537908 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.537305    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3a6d5aea-0e22-4c6b-9ef3-802b77524517-sys\") pod \"tuned-tjb9n\" (UID: \"3a6d5aea-0e22-4c6b-9ef3-802b77524517\") " pod="openshift-cluster-node-tuning-operator/tuned-tjb9n"
Jul 13 02:56:26.537908 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.537332    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/89566977-a84a-41c6-815a-dbb71c0752c6-system-cni-dir\") pod \"multus-additional-cni-plugins-f94rg\" (UID: \"89566977-a84a-41c6-815a-dbb71c0752c6\") " pod="openshift-multus/multus-additional-cni-plugins-f94rg"
Jul 13 02:56:26.537908 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.537359    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/89566977-a84a-41c6-815a-dbb71c0752c6-cnibin\") pod \"multus-additional-cni-plugins-f94rg\" (UID: \"89566977-a84a-41c6-815a-dbb71c0752c6\") " pod="openshift-multus/multus-additional-cni-plugins-f94rg"
Jul 13 02:56:26.537908 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.537396    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/98357ee0-0a92-426c-8da6-516bf9162a68-cni-binary-copy\") pod \"multus-v5jkl\" (UID: \"98357ee0-0a92-426c-8da6-516bf9162a68\") " pod="openshift-multus/multus-v5jkl"
Jul 13 02:56:26.538726 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.537421    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/98357ee0-0a92-426c-8da6-516bf9162a68-etc-kubernetes\") pod \"multus-v5jkl\" (UID: \"98357ee0-0a92-426c-8da6-516bf9162a68\") " pod="openshift-multus/multus-v5jkl"
Jul 13 02:56:26.538726 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.537436    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/adf25180-4382-4582-b363-81a08923156a-iptables-alerter-script\") pod \"iptables-alerter-p85gh\" (UID: \"adf25180-4382-4582-b363-81a08923156a\") " pod="openshift-network-operator/iptables-alerter-p85gh"
Jul 13 02:56:26.538726 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.537446    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a8933b47-8580-45ab-9f75-57c9a3f26842-run-ovn\") pod \"ovnkube-node-v2725\" (UID: \"a8933b47-8580-45ab-9f75-57c9a3f26842\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2725"
Jul 13 02:56:26.538726 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.537493    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a8933b47-8580-45ab-9f75-57c9a3f26842-host-cni-bin\") pod \"ovnkube-node-v2725\" (UID: \"a8933b47-8580-45ab-9f75-57c9a3f26842\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2725"
Jul 13 02:56:26.538726 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.537506    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a8933b47-8580-45ab-9f75-57c9a3f26842-run-ovn\") pod \"ovnkube-node-v2725\" (UID: \"a8933b47-8580-45ab-9f75-57c9a3f26842\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2725"
Jul 13 02:56:26.538726 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.537513    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xs4j\" (UniqueName: \"kubernetes.io/projected/a8933b47-8580-45ab-9f75-57c9a3f26842-kube-api-access-5xs4j\") pod \"ovnkube-node-v2725\" (UID: \"a8933b47-8580-45ab-9f75-57c9a3f26842\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2725"
Jul 13 02:56:26.538726 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.537533    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f526e46c-7702-4938-986f-45c9199f8e78-konnectivity-ca\") pod \"konnectivity-agent-dfsgr\" (UID: \"f526e46c-7702-4938-986f-45c9199f8e78\") " pod="kube-system/konnectivity-agent-dfsgr"
Jul 13 02:56:26.538726 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.537553    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6dc5ae9e-d973-46ae-9924-43fc3e1e80f7-kubelet-config\") pod \"global-pull-secret-syncer-j7pcm\" (UID: \"6dc5ae9e-d973-46ae-9924-43fc3e1e80f7\") " pod="kube-system/global-pull-secret-syncer-j7pcm"
Jul 13 02:56:26.538726 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.537573    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnjr5\" (UniqueName: \"kubernetes.io/projected/98357ee0-0a92-426c-8da6-516bf9162a68-kube-api-access-tnjr5\") pod \"multus-v5jkl\" (UID: \"98357ee0-0a92-426c-8da6-516bf9162a68\") " pod="openshift-multus/multus-v5jkl"
Jul 13 02:56:26.538726 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.537598    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a8933b47-8580-45ab-9f75-57c9a3f26842-host-run-netns\") pod \"ovnkube-node-v2725\" (UID: \"a8933b47-8580-45ab-9f75-57c9a3f26842\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2725"
Jul 13 02:56:26.538726 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:26.537600    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 02:56:26.538726 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.537675    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/98357ee0-0a92-426c-8da6-516bf9162a68-system-cni-dir\") pod \"multus-v5jkl\" (UID: \"98357ee0-0a92-426c-8da6-516bf9162a68\") " pod="openshift-multus/multus-v5jkl"
Jul 13 02:56:26.538726 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:26.537685    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd0ac0dd-db5b-41c3-b69d-bcf3af528e20-metrics-certs podName:cd0ac0dd-db5b-41c3-b69d-bcf3af528e20 nodeName:}" failed. No retries permitted until 2026-07-13 02:56:27.037657627 +0000 UTC m=+3.020447716 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd0ac0dd-db5b-41c3-b69d-bcf3af528e20-metrics-certs") pod "network-metrics-daemon-p44kl" (UID: "cd0ac0dd-db5b-41c3-b69d-bcf3af528e20") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 02:56:26.538726 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.537706    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bbf72fd6-813d-4e7e-8168-7b41c4605230-serviceca\") pod \"node-ca-jvpfc\" (UID: \"bbf72fd6-813d-4e7e-8168-7b41c4605230\") " pod="openshift-image-registry/node-ca-jvpfc"
Jul 13 02:56:26.538726 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.537734    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3a6d5aea-0e22-4c6b-9ef3-802b77524517-run\") pod \"tuned-tjb9n\" (UID: \"3a6d5aea-0e22-4c6b-9ef3-802b77524517\") " pod="openshift-cluster-node-tuning-operator/tuned-tjb9n"
Jul 13 02:56:26.538726 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.537759    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3a6d5aea-0e22-4c6b-9ef3-802b77524517-host\") pod \"tuned-tjb9n\" (UID: \"3a6d5aea-0e22-4c6b-9ef3-802b77524517\") " pod="openshift-cluster-node-tuning-operator/tuned-tjb9n"
Jul 13 02:56:26.538726 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.537792    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fgp8\" (UniqueName: \"kubernetes.io/projected/3a6d5aea-0e22-4c6b-9ef3-802b77524517-kube-api-access-2fgp8\") pod \"tuned-tjb9n\" (UID: \"3a6d5aea-0e22-4c6b-9ef3-802b77524517\") " pod="openshift-cluster-node-tuning-operator/tuned-tjb9n"
Jul 13 02:56:26.539565 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.537831    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d365a05b-69cd-4a21-b6cf-d16d5560c7f3-registration-dir\") pod \"aws-ebs-csi-driver-node-thdfw\" (UID: \"d365a05b-69cd-4a21-b6cf-d16d5560c7f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thdfw"
Jul 13 02:56:26.539565 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.537864    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a8933b47-8580-45ab-9f75-57c9a3f26842-host-cni-bin\") pod \"ovnkube-node-v2725\" (UID: \"a8933b47-8580-45ab-9f75-57c9a3f26842\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2725"
Jul 13 02:56:26.539565 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.537880    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d365a05b-69cd-4a21-b6cf-d16d5560c7f3-sys-fs\") pod \"aws-ebs-csi-driver-node-thdfw\" (UID: \"d365a05b-69cd-4a21-b6cf-d16d5560c7f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thdfw"
Jul 13 02:56:26.539565 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.537906    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3b58c31-485d-4010-b36b-049e6006b525-tmp-dir\") pod \"node-resolver-xnfwg\" (UID: \"b3b58c31-485d-4010-b36b-049e6006b525\") " pod="openshift-dns/node-resolver-xnfwg"
Jul 13 02:56:26.539565 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.537933    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3a6d5aea-0e22-4c6b-9ef3-802b77524517-etc-sysctl-conf\") pod \"tuned-tjb9n\" (UID: \"3a6d5aea-0e22-4c6b-9ef3-802b77524517\") " pod="openshift-cluster-node-tuning-operator/tuned-tjb9n"
Jul 13 02:56:26.539565 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.537971    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3a6d5aea-0e22-4c6b-9ef3-802b77524517-etc-tuned\") pod \"tuned-tjb9n\" (UID: \"3a6d5aea-0e22-4c6b-9ef3-802b77524517\") " pod="openshift-cluster-node-tuning-operator/tuned-tjb9n"
Jul 13 02:56:26.539565 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.538001    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/89566977-a84a-41c6-815a-dbb71c0752c6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-f94rg\" (UID: \"89566977-a84a-41c6-815a-dbb71c0752c6\") " pod="openshift-multus/multus-additional-cni-plugins-f94rg"
Jul 13 02:56:26.539565 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.538044    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f526e46c-7702-4938-986f-45c9199f8e78-agent-certs\") pod \"konnectivity-agent-dfsgr\" (UID: \"f526e46c-7702-4938-986f-45c9199f8e78\") " pod="kube-system/konnectivity-agent-dfsgr"
Jul 13 02:56:26.539565 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.538078    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/89566977-a84a-41c6-815a-dbb71c0752c6-cni-binary-copy\") pod \"multus-additional-cni-plugins-f94rg\" (UID: \"89566977-a84a-41c6-815a-dbb71c0752c6\") " pod="openshift-multus/multus-additional-cni-plugins-f94rg"
Jul 13 02:56:26.539565 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.538121    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a8933b47-8580-45ab-9f75-57c9a3f26842-log-socket\") pod \"ovnkube-node-v2725\" (UID: \"a8933b47-8580-45ab-9f75-57c9a3f26842\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2725"
Jul 13 02:56:26.539565 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.538145    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d365a05b-69cd-4a21-b6cf-d16d5560c7f3-socket-dir\") pod \"aws-ebs-csi-driver-node-thdfw\" (UID: \"d365a05b-69cd-4a21-b6cf-d16d5560c7f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thdfw"
Jul 13 02:56:26.539565 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.538173    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/89566977-a84a-41c6-815a-dbb71c0752c6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-f94rg\" (UID: \"89566977-a84a-41c6-815a-dbb71c0752c6\") " pod="openshift-multus/multus-additional-cni-plugins-f94rg"
Jul 13 02:56:26.539565 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.538202    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7p6bj\" (UniqueName: \"kubernetes.io/projected/adf25180-4382-4582-b363-81a08923156a-kube-api-access-7p6bj\") pod \"iptables-alerter-p85gh\" (UID: \"adf25180-4382-4582-b363-81a08923156a\") " pod="openshift-network-operator/iptables-alerter-p85gh"
Jul 13 02:56:26.539565 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.538231    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a8933b47-8580-45ab-9f75-57c9a3f26842-systemd-units\") pod \"ovnkube-node-v2725\" (UID: \"a8933b47-8580-45ab-9f75-57c9a3f26842\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2725"
Jul 13 02:56:26.539565 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.538254    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a8933b47-8580-45ab-9f75-57c9a3f26842-run-systemd\") pod \"ovnkube-node-v2725\" (UID: \"a8933b47-8580-45ab-9f75-57c9a3f26842\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2725"
Jul 13 02:56:26.539565 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.538271    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a8933b47-8580-45ab-9f75-57c9a3f26842-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v2725\" (UID: \"a8933b47-8580-45ab-9f75-57c9a3f26842\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2725"
Jul 13 02:56:26.543446 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.538300    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a8933b47-8580-45ab-9f75-57c9a3f26842-ovnkube-config\") pod \"ovnkube-node-v2725\" (UID: \"a8933b47-8580-45ab-9f75-57c9a3f26842\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2725"
Jul 13 02:56:26.543446 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.538348    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6dc5ae9e-d973-46ae-9924-43fc3e1e80f7-original-pull-secret\") pod \"global-pull-secret-syncer-j7pcm\" (UID: \"6dc5ae9e-d973-46ae-9924-43fc3e1e80f7\") " pod="kube-system/global-pull-secret-syncer-j7pcm"
Jul 13 02:56:26.543446 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.538377    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/adf25180-4382-4582-b363-81a08923156a-host-slash\") pod \"iptables-alerter-p85gh\" (UID: \"adf25180-4382-4582-b363-81a08923156a\") " pod="openshift-network-operator/iptables-alerter-p85gh"
Jul 13 02:56:26.543446 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.538403    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a8933b47-8580-45ab-9f75-57c9a3f26842-host-slash\") pod \"ovnkube-node-v2725\" (UID: \"a8933b47-8580-45ab-9f75-57c9a3f26842\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2725"
Jul 13 02:56:26.543446 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.538441    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a8933b47-8580-45ab-9f75-57c9a3f26842-run-openvswitch\") pod \"ovnkube-node-v2725\" (UID: \"a8933b47-8580-45ab-9f75-57c9a3f26842\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2725"
Jul 13 02:56:26.543446 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.538461    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a8933b47-8580-45ab-9f75-57c9a3f26842-node-log\") pod \"ovnkube-node-v2725\" (UID: \"a8933b47-8580-45ab-9f75-57c9a3f26842\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2725"
Jul 13 02:56:26.543446 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.538478    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b3b58c31-485d-4010-b36b-049e6006b525-hosts-file\") pod \"node-resolver-xnfwg\" (UID: \"b3b58c31-485d-4010-b36b-049e6006b525\") " pod="openshift-dns/node-resolver-xnfwg"
Jul 13 02:56:26.543446 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.538570    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6dc5ae9e-d973-46ae-9924-43fc3e1e80f7-kubelet-config\") pod \"global-pull-secret-syncer-j7pcm\" (UID: \"6dc5ae9e-d973-46ae-9924-43fc3e1e80f7\") " pod="kube-system/global-pull-secret-syncer-j7pcm"
Jul 13 02:56:26.543446 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.538643    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/89566977-a84a-41c6-815a-dbb71c0752c6-cni-binary-copy\") pod \"multus-additional-cni-plugins-f94rg\" (UID: \"89566977-a84a-41c6-815a-dbb71c0752c6\") " pod="openshift-multus/multus-additional-cni-plugins-f94rg"
Jul 13 02:56:26.543446 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.538733    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/98357ee0-0a92-426c-8da6-516bf9162a68-os-release\") pod \"multus-v5jkl\" (UID: \"98357ee0-0a92-426c-8da6-516bf9162a68\") " pod="openshift-multus/multus-v5jkl"
Jul 13 02:56:26.543446 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.538784    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/98357ee0-0a92-426c-8da6-516bf9162a68-host-run-netns\") pod \"multus-v5jkl\" (UID: \"98357ee0-0a92-426c-8da6-516bf9162a68\") " pod="openshift-multus/multus-v5jkl"
Jul 13 02:56:26.543446 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.538795    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a8933b47-8580-45ab-9f75-57c9a3f26842-log-socket\") pod \"ovnkube-node-v2725\" (UID: \"a8933b47-8580-45ab-9f75-57c9a3f26842\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2725"
Jul 13 02:56:26.543446 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.538854    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a8933b47-8580-45ab-9f75-57c9a3f26842-host-run-netns\") pod \"ovnkube-node-v2725\" (UID: \"a8933b47-8580-45ab-9f75-57c9a3f26842\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2725"
Jul 13 02:56:26.543446 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.538904    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/98357ee0-0a92-426c-8da6-516bf9162a68-host-var-lib-kubelet\") pod \"multus-v5jkl\" (UID: \"98357ee0-0a92-426c-8da6-516bf9162a68\") " pod="openshift-multus/multus-v5jkl"
Jul 13 02:56:26.543446 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.538948    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/98357ee0-0a92-426c-8da6-516bf9162a68-multus-conf-dir\") pod \"multus-v5jkl\" (UID: \"98357ee0-0a92-426c-8da6-516bf9162a68\") " pod="openshift-multus/multus-v5jkl"
Jul 13 02:56:26.543446 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.538961    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/89566977-a84a-41c6-815a-dbb71c0752c6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-f94rg\" (UID: \"89566977-a84a-41c6-815a-dbb71c0752c6\") " pod="openshift-multus/multus-additional-cni-plugins-f94rg"
Jul 13 02:56:26.543446 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.539206    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a8933b47-8580-45ab-9f75-57c9a3f26842-systemd-units\") pod \"ovnkube-node-v2725\" (UID: \"a8933b47-8580-45ab-9f75-57c9a3f26842\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2725"
Jul 13 02:56:26.543446 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.539255    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a8933b47-8580-45ab-9f75-57c9a3f26842-run-systemd\") pod \"ovnkube-node-v2725\" (UID: \"a8933b47-8580-45ab-9f75-57c9a3f26842\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2725"
Jul 13 02:56:26.544079 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.539298    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a8933b47-8580-45ab-9f75-57c9a3f26842-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v2725\" (UID: \"a8933b47-8580-45ab-9f75-57c9a3f26842\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2725"
Jul 13 02:56:26.544079 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.539443    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/89566977-a84a-41c6-815a-dbb71c0752c6-cnibin\") pod \"multus-additional-cni-plugins-f94rg\" (UID: \"89566977-a84a-41c6-815a-dbb71c0752c6\") " pod="openshift-multus/multus-additional-cni-plugins-f94rg"
Jul 13 02:56:26.544079 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.539455    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a8933b47-8580-45ab-9f75-57c9a3f26842-host-run-ovn-kubernetes\") pod \"ovnkube-node-v2725\" (UID: \"a8933b47-8580-45ab-9f75-57c9a3f26842\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2725"
Jul 13 02:56:26.544079 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.539487    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/98357ee0-0a92-426c-8da6-516bf9162a68-multus-daemon-config\") pod \"multus-v5jkl\" (UID: \"98357ee0-0a92-426c-8da6-516bf9162a68\") " pod="openshift-multus/multus-v5jkl"
Jul 13 02:56:26.544079 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.539526    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/89566977-a84a-41c6-815a-dbb71c0752c6-system-cni-dir\") pod \"multus-additional-cni-plugins-f94rg\" (UID: \"89566977-a84a-41c6-815a-dbb71c0752c6\") " pod="openshift-multus/multus-additional-cni-plugins-f94rg"
Jul 13 02:56:26.544079 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.539530    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/98357ee0-0a92-426c-8da6-516bf9162a68-host-run-multus-certs\") pod \"multus-v5jkl\" (UID: \"98357ee0-0a92-426c-8da6-516bf9162a68\") " pod="openshift-multus/multus-v5jkl"
Jul 13 02:56:26.544079 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.539593    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/adf25180-4382-4582-b363-81a08923156a-host-slash\") pod \"iptables-alerter-p85gh\" (UID: \"adf25180-4382-4582-b363-81a08923156a\") " pod="openshift-network-operator/iptables-alerter-p85gh"
Jul 13 02:56:26.544079 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:26.539604    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 02:56:26.544079 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.539631    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/98357ee0-0a92-426c-8da6-516bf9162a68-etc-kubernetes\") pod \"multus-v5jkl\" (UID: \"98357ee0-0a92-426c-8da6-516bf9162a68\") " pod="openshift-multus/multus-v5jkl"
Jul 13 02:56:26.544079 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.539682    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a8933b47-8580-45ab-9f75-57c9a3f26842-run-openvswitch\") pod \"ovnkube-node-v2725\" (UID: \"a8933b47-8580-45ab-9f75-57c9a3f26842\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2725"
Jul 13 02:56:26.544079 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:26.539691    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dc5ae9e-d973-46ae-9924-43fc3e1e80f7-original-pull-secret podName:6dc5ae9e-d973-46ae-9924-43fc3e1e80f7 nodeName:}" failed. No retries permitted until 2026-07-13 02:56:27.039676743 +0000 UTC m=+3.022466832 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6dc5ae9e-d973-46ae-9924-43fc3e1e80f7-original-pull-secret") pod "global-pull-secret-syncer-j7pcm" (UID: "6dc5ae9e-d973-46ae-9924-43fc3e1e80f7") : object "kube-system"/"original-pull-secret" not registered
Jul 13 02:56:26.544079 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.539793    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a8933b47-8580-45ab-9f75-57c9a3f26842-node-log\") pod \"ovnkube-node-v2725\" (UID: \"a8933b47-8580-45ab-9f75-57c9a3f26842\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2725"
Jul 13 02:56:26.544079 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.539831    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a8933b47-8580-45ab-9f75-57c9a3f26842-host-slash\") pod \"ovnkube-node-v2725\" (UID: \"a8933b47-8580-45ab-9f75-57c9a3f26842\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2725"
Jul 13 02:56:26.544079 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.540043    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/89566977-a84a-41c6-815a-dbb71c0752c6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-f94rg\" (UID: \"89566977-a84a-41c6-815a-dbb71c0752c6\") " pod="openshift-multus/multus-additional-cni-plugins-f94rg"
Jul 13 02:56:26.544079 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.540163    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/98357ee0-0a92-426c-8da6-516bf9162a68-cni-binary-copy\") pod \"multus-v5jkl\" (UID: \"98357ee0-0a92-426c-8da6-516bf9162a68\") " pod="openshift-multus/multus-v5jkl"
Jul 13 02:56:26.544079 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.540513    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a8933b47-8580-45ab-9f75-57c9a3f26842-ovn-node-metrics-cert\") pod \"ovnkube-node-v2725\" (UID: \"a8933b47-8580-45ab-9f75-57c9a3f26842\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2725"
Jul 13 02:56:26.544079 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.541804    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a8933b47-8580-45ab-9f75-57c9a3f26842-ovnkube-config\") pod \"ovnkube-node-v2725\" (UID: \"a8933b47-8580-45ab-9f75-57c9a3f26842\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2725"
Jul 13 02:56:26.544742 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.541815    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a8933b47-8580-45ab-9f75-57c9a3f26842-env-overrides\") pod \"ovnkube-node-v2725\" (UID: \"a8933b47-8580-45ab-9f75-57c9a3f26842\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2725"
Jul 13 02:56:26.544742 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.542143    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a8933b47-8580-45ab-9f75-57c9a3f26842-ovnkube-script-lib\") pod \"ovnkube-node-v2725\" (UID: \"a8933b47-8580-45ab-9f75-57c9a3f26842\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2725"
Jul 13 02:56:26.548112 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.548057    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdwtz\" (UniqueName: \"kubernetes.io/projected/89566977-a84a-41c6-815a-dbb71c0752c6-kube-api-access-kdwtz\") pod \"multus-additional-cni-plugins-f94rg\" (UID: \"89566977-a84a-41c6-815a-dbb71c0752c6\") " pod="openshift-multus/multus-additional-cni-plugins-f94rg"
Jul 13 02:56:26.549212 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.549180    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-75ms9\" (UniqueName: \"kubernetes.io/projected/cd0ac0dd-db5b-41c3-b69d-bcf3af528e20-kube-api-access-75ms9\") pod \"network-metrics-daemon-p44kl\" (UID: \"cd0ac0dd-db5b-41c3-b69d-bcf3af528e20\") " pod="openshift-multus/network-metrics-daemon-p44kl"
Jul 13 02:56:26.550522 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.550494    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7p6bj\" (UniqueName: \"kubernetes.io/projected/adf25180-4382-4582-b363-81a08923156a-kube-api-access-7p6bj\") pod \"iptables-alerter-p85gh\" (UID: \"adf25180-4382-4582-b363-81a08923156a\") " pod="openshift-network-operator/iptables-alerter-p85gh"
Jul 13 02:56:26.550827 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.550799    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xs4j\" (UniqueName: \"kubernetes.io/projected/a8933b47-8580-45ab-9f75-57c9a3f26842-kube-api-access-5xs4j\") pod \"ovnkube-node-v2725\" (UID: \"a8933b47-8580-45ab-9f75-57c9a3f26842\") " pod="openshift-ovn-kubernetes/ovnkube-node-v2725"
Jul 13 02:56:26.551303 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.551285    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnjr5\" (UniqueName: \"kubernetes.io/projected/98357ee0-0a92-426c-8da6-516bf9162a68-kube-api-access-tnjr5\") pod \"multus-v5jkl\" (UID: \"98357ee0-0a92-426c-8da6-516bf9162a68\") " pod="openshift-multus/multus-v5jkl"
Jul 13 02:56:26.638895 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.638859    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f526e46c-7702-4938-986f-45c9199f8e78-konnectivity-ca\") pod \"konnectivity-agent-dfsgr\" (UID: \"f526e46c-7702-4938-986f-45c9199f8e78\") " pod="kube-system/konnectivity-agent-dfsgr"
Jul 13 02:56:26.639109 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.638899    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bbf72fd6-813d-4e7e-8168-7b41c4605230-serviceca\") pod \"node-ca-jvpfc\" (UID: \"bbf72fd6-813d-4e7e-8168-7b41c4605230\") " pod="openshift-image-registry/node-ca-jvpfc"
Jul 13 02:56:26.639109 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.638926    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3a6d5aea-0e22-4c6b-9ef3-802b77524517-run\") pod \"tuned-tjb9n\" (UID: \"3a6d5aea-0e22-4c6b-9ef3-802b77524517\") " pod="openshift-cluster-node-tuning-operator/tuned-tjb9n"
Jul 13 02:56:26.639109 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.638941    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3a6d5aea-0e22-4c6b-9ef3-802b77524517-host\") pod \"tuned-tjb9n\" (UID: \"3a6d5aea-0e22-4c6b-9ef3-802b77524517\") " pod="openshift-cluster-node-tuning-operator/tuned-tjb9n"
Jul 13 02:56:26.639109 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.638980    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fgp8\" (UniqueName: \"kubernetes.io/projected/3a6d5aea-0e22-4c6b-9ef3-802b77524517-kube-api-access-2fgp8\") pod \"tuned-tjb9n\" (UID: \"3a6d5aea-0e22-4c6b-9ef3-802b77524517\") " pod="openshift-cluster-node-tuning-operator/tuned-tjb9n"
Jul 13 02:56:26.639109 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.639048    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3a6d5aea-0e22-4c6b-9ef3-802b77524517-host\") pod \"tuned-tjb9n\" (UID: \"3a6d5aea-0e22-4c6b-9ef3-802b77524517\") " pod="openshift-cluster-node-tuning-operator/tuned-tjb9n"
Jul 13 02:56:26.639109 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.639048    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3a6d5aea-0e22-4c6b-9ef3-802b77524517-run\") pod \"tuned-tjb9n\" (UID: \"3a6d5aea-0e22-4c6b-9ef3-802b77524517\") " pod="openshift-cluster-node-tuning-operator/tuned-tjb9n"
Jul 13 02:56:26.639443 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.639107    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d365a05b-69cd-4a21-b6cf-d16d5560c7f3-registration-dir\") pod \"aws-ebs-csi-driver-node-thdfw\" (UID: \"d365a05b-69cd-4a21-b6cf-d16d5560c7f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thdfw"
Jul 13 02:56:26.639443 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.639149    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d365a05b-69cd-4a21-b6cf-d16d5560c7f3-sys-fs\") pod \"aws-ebs-csi-driver-node-thdfw\" (UID: \"d365a05b-69cd-4a21-b6cf-d16d5560c7f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thdfw"
Jul 13 02:56:26.639443 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.639175    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3b58c31-485d-4010-b36b-049e6006b525-tmp-dir\") pod \"node-resolver-xnfwg\" (UID: \"b3b58c31-485d-4010-b36b-049e6006b525\") " pod="openshift-dns/node-resolver-xnfwg"
Jul 13 02:56:26.639443 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.639194    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d365a05b-69cd-4a21-b6cf-d16d5560c7f3-registration-dir\") pod \"aws-ebs-csi-driver-node-thdfw\" (UID: \"d365a05b-69cd-4a21-b6cf-d16d5560c7f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thdfw"
Jul 13 02:56:26.639443 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.639202    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3a6d5aea-0e22-4c6b-9ef3-802b77524517-etc-sysctl-conf\") pod \"tuned-tjb9n\" (UID: \"3a6d5aea-0e22-4c6b-9ef3-802b77524517\") " pod="openshift-cluster-node-tuning-operator/tuned-tjb9n"
Jul 13 02:56:26.639443 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.639228    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3a6d5aea-0e22-4c6b-9ef3-802b77524517-etc-tuned\") pod \"tuned-tjb9n\" (UID: \"3a6d5aea-0e22-4c6b-9ef3-802b77524517\") " pod="openshift-cluster-node-tuning-operator/tuned-tjb9n"
Jul 13 02:56:26.639443 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.639253    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f526e46c-7702-4938-986f-45c9199f8e78-agent-certs\") pod \"konnectivity-agent-dfsgr\" (UID: \"f526e46c-7702-4938-986f-45c9199f8e78\") " pod="kube-system/konnectivity-agent-dfsgr"
Jul 13 02:56:26.639443 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.639271    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d365a05b-69cd-4a21-b6cf-d16d5560c7f3-sys-fs\") pod \"aws-ebs-csi-driver-node-thdfw\" (UID: \"d365a05b-69cd-4a21-b6cf-d16d5560c7f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thdfw"
Jul 13 02:56:26.639443 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.639279    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d365a05b-69cd-4a21-b6cf-d16d5560c7f3-socket-dir\") pod \"aws-ebs-csi-driver-node-thdfw\" (UID: \"d365a05b-69cd-4a21-b6cf-d16d5560c7f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thdfw"
Jul 13 02:56:26.639443 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.639327    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b3b58c31-485d-4010-b36b-049e6006b525-hosts-file\") pod \"node-resolver-xnfwg\" (UID: \"b3b58c31-485d-4010-b36b-049e6006b525\") " pod="openshift-dns/node-resolver-xnfwg"
Jul 13 02:56:26.639443 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.639357    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bbf72fd6-813d-4e7e-8168-7b41c4605230-host\") pod \"node-ca-jvpfc\" (UID: \"bbf72fd6-813d-4e7e-8168-7b41c4605230\") " pod="openshift-image-registry/node-ca-jvpfc"
Jul 13 02:56:26.639443 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.639381    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x56x9\" (UniqueName: \"kubernetes.io/projected/b3b58c31-485d-4010-b36b-049e6006b525-kube-api-access-x56x9\") pod \"node-resolver-xnfwg\" (UID: \"b3b58c31-485d-4010-b36b-049e6006b525\") " pod="openshift-dns/node-resolver-xnfwg"
Jul 13 02:56:26.639443 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.639407    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3a6d5aea-0e22-4c6b-9ef3-802b77524517-etc-sysconfig\") pod \"tuned-tjb9n\" (UID: \"3a6d5aea-0e22-4c6b-9ef3-802b77524517\") " pod="openshift-cluster-node-tuning-operator/tuned-tjb9n"
Jul 13 02:56:26.639443 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.639416    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3a6d5aea-0e22-4c6b-9ef3-802b77524517-etc-sysctl-conf\") pod \"tuned-tjb9n\" (UID: \"3a6d5aea-0e22-4c6b-9ef3-802b77524517\") " pod="openshift-cluster-node-tuning-operator/tuned-tjb9n"
Jul 13 02:56:26.639443 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.639423    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bbf72fd6-813d-4e7e-8168-7b41c4605230-serviceca\") pod \"node-ca-jvpfc\" (UID: \"bbf72fd6-813d-4e7e-8168-7b41c4605230\") " pod="openshift-image-registry/node-ca-jvpfc"
Jul 13 02:56:26.639443 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.639432    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3a6d5aea-0e22-4c6b-9ef3-802b77524517-lib-modules\") pod \"tuned-tjb9n\" (UID: \"3a6d5aea-0e22-4c6b-9ef3-802b77524517\") " pod="openshift-cluster-node-tuning-operator/tuned-tjb9n"
Jul 13 02:56:26.640270 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.639457    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58sns\" (UniqueName: \"kubernetes.io/projected/71eff5ef-6532-42ba-b932-2911cfaedcac-kube-api-access-58sns\") pod \"network-check-target-24d7h\" (UID: \"71eff5ef-6532-42ba-b932-2911cfaedcac\") " pod="openshift-network-diagnostics/network-check-target-24d7h"
Jul 13 02:56:26.640270 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.639483    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b3b58c31-485d-4010-b36b-049e6006b525-hosts-file\") pod \"node-resolver-xnfwg\" (UID: \"b3b58c31-485d-4010-b36b-049e6006b525\") " pod="openshift-dns/node-resolver-xnfwg"
Jul 13 02:56:26.640270 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.639487    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s89g4\" (UniqueName: \"kubernetes.io/projected/d365a05b-69cd-4a21-b6cf-d16d5560c7f3-kube-api-access-s89g4\") pod \"aws-ebs-csi-driver-node-thdfw\" (UID: \"d365a05b-69cd-4a21-b6cf-d16d5560c7f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thdfw"
Jul 13 02:56:26.640270 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.639513    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3a6d5aea-0e22-4c6b-9ef3-802b77524517-etc-systemd\") pod \"tuned-tjb9n\" (UID: \"3a6d5aea-0e22-4c6b-9ef3-802b77524517\") " pod="openshift-cluster-node-tuning-operator/tuned-tjb9n"
Jul 13 02:56:26.640270 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.639536    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a6d5aea-0e22-4c6b-9ef3-802b77524517-tmp\") pod \"tuned-tjb9n\" (UID: \"3a6d5aea-0e22-4c6b-9ef3-802b77524517\") " pod="openshift-cluster-node-tuning-operator/tuned-tjb9n"
Jul 13 02:56:26.640270 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.639586    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3b58c31-485d-4010-b36b-049e6006b525-tmp-dir\") pod \"node-resolver-xnfwg\" (UID: \"b3b58c31-485d-4010-b36b-049e6006b525\") " pod="openshift-dns/node-resolver-xnfwg"
Jul 13 02:56:26.640270 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.639588    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d365a05b-69cd-4a21-b6cf-d16d5560c7f3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-thdfw\" (UID: \"d365a05b-69cd-4a21-b6cf-d16d5560c7f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thdfw"
Jul 13 02:56:26.640270 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.639596    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f526e46c-7702-4938-986f-45c9199f8e78-konnectivity-ca\") pod \"konnectivity-agent-dfsgr\" (UID: \"f526e46c-7702-4938-986f-45c9199f8e78\") " pod="kube-system/konnectivity-agent-dfsgr"
Jul 13 02:56:26.640270 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.639632    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d365a05b-69cd-4a21-b6cf-d16d5560c7f3-device-dir\") pod \"aws-ebs-csi-driver-node-thdfw\" (UID: \"d365a05b-69cd-4a21-b6cf-d16d5560c7f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thdfw"
Jul 13 02:56:26.640270 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.639638    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d365a05b-69cd-4a21-b6cf-d16d5560c7f3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-thdfw\" (UID: \"d365a05b-69cd-4a21-b6cf-d16d5560c7f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thdfw"
Jul 13 02:56:26.640270 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.639653    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d365a05b-69cd-4a21-b6cf-d16d5560c7f3-socket-dir\") pod \"aws-ebs-csi-driver-node-thdfw\" (UID: \"d365a05b-69cd-4a21-b6cf-d16d5560c7f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thdfw"
Jul 13 02:56:26.640270 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.639659    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d365a05b-69cd-4a21-b6cf-d16d5560c7f3-etc-selinux\") pod \"aws-ebs-csi-driver-node-thdfw\" (UID: \"d365a05b-69cd-4a21-b6cf-d16d5560c7f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thdfw"
Jul 13 02:56:26.640270 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.639704    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3a6d5aea-0e22-4c6b-9ef3-802b77524517-etc-kubernetes\") pod \"tuned-tjb9n\" (UID: \"3a6d5aea-0e22-4c6b-9ef3-802b77524517\") " pod="openshift-cluster-node-tuning-operator/tuned-tjb9n"
Jul 13 02:56:26.640270 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.639741    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3a6d5aea-0e22-4c6b-9ef3-802b77524517-etc-sysctl-d\") pod \"tuned-tjb9n\" (UID: \"3a6d5aea-0e22-4c6b-9ef3-802b77524517\") " pod="openshift-cluster-node-tuning-operator/tuned-tjb9n"
Jul 13 02:56:26.640270 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.639750    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d365a05b-69cd-4a21-b6cf-d16d5560c7f3-etc-selinux\") pod \"aws-ebs-csi-driver-node-thdfw\" (UID: \"d365a05b-69cd-4a21-b6cf-d16d5560c7f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thdfw"
Jul 13 02:56:26.640270 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.639750    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3a6d5aea-0e22-4c6b-9ef3-802b77524517-lib-modules\") pod \"tuned-tjb9n\" (UID: \"3a6d5aea-0e22-4c6b-9ef3-802b77524517\") " pod="openshift-cluster-node-tuning-operator/tuned-tjb9n"
Jul 13 02:56:26.640270 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.639784    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bbf72fd6-813d-4e7e-8168-7b41c4605230-host\") pod \"node-ca-jvpfc\" (UID: \"bbf72fd6-813d-4e7e-8168-7b41c4605230\") " pod="openshift-image-registry/node-ca-jvpfc"
Jul 13 02:56:26.641190 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.639809    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7vb8\" (UniqueName: \"kubernetes.io/projected/bbf72fd6-813d-4e7e-8168-7b41c4605230-kube-api-access-b7vb8\") pod \"node-ca-jvpfc\" (UID: \"bbf72fd6-813d-4e7e-8168-7b41c4605230\") " pod="openshift-image-registry/node-ca-jvpfc"
Jul 13 02:56:26.641190 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.639839    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3a6d5aea-0e22-4c6b-9ef3-802b77524517-etc-modprobe-d\") pod \"tuned-tjb9n\" (UID: \"3a6d5aea-0e22-4c6b-9ef3-802b77524517\") " pod="openshift-cluster-node-tuning-operator/tuned-tjb9n"
Jul 13 02:56:26.641190 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.639844    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3a6d5aea-0e22-4c6b-9ef3-802b77524517-etc-sysconfig\") pod \"tuned-tjb9n\" (UID: \"3a6d5aea-0e22-4c6b-9ef3-802b77524517\") " pod="openshift-cluster-node-tuning-operator/tuned-tjb9n"
Jul 13 02:56:26.641190 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.639866    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3a6d5aea-0e22-4c6b-9ef3-802b77524517-var-lib-kubelet\") pod \"tuned-tjb9n\" (UID: \"3a6d5aea-0e22-4c6b-9ef3-802b77524517\") " pod="openshift-cluster-node-tuning-operator/tuned-tjb9n"
Jul 13 02:56:26.641190 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.639890    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3a6d5aea-0e22-4c6b-9ef3-802b77524517-etc-systemd\") pod \"tuned-tjb9n\" (UID: \"3a6d5aea-0e22-4c6b-9ef3-802b77524517\") " pod="openshift-cluster-node-tuning-operator/tuned-tjb9n"
Jul 13 02:56:26.641190 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.639906    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3a6d5aea-0e22-4c6b-9ef3-802b77524517-sys\") pod \"tuned-tjb9n\" (UID: \"3a6d5aea-0e22-4c6b-9ef3-802b77524517\") " pod="openshift-cluster-node-tuning-operator/tuned-tjb9n"
Jul 13 02:56:26.641190 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.639911    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3a6d5aea-0e22-4c6b-9ef3-802b77524517-etc-sysctl-d\") pod \"tuned-tjb9n\" (UID: \"3a6d5aea-0e22-4c6b-9ef3-802b77524517\") " pod="openshift-cluster-node-tuning-operator/tuned-tjb9n"
Jul 13 02:56:26.641190 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.639813    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d365a05b-69cd-4a21-b6cf-d16d5560c7f3-device-dir\") pod \"aws-ebs-csi-driver-node-thdfw\" (UID: \"d365a05b-69cd-4a21-b6cf-d16d5560c7f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thdfw"
Jul 13 02:56:26.641190 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.640038    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3a6d5aea-0e22-4c6b-9ef3-802b77524517-sys\") pod \"tuned-tjb9n\" (UID: \"3a6d5aea-0e22-4c6b-9ef3-802b77524517\") " pod="openshift-cluster-node-tuning-operator/tuned-tjb9n"
Jul 13 02:56:26.641190 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.640094    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3a6d5aea-0e22-4c6b-9ef3-802b77524517-etc-kubernetes\") pod \"tuned-tjb9n\" (UID: \"3a6d5aea-0e22-4c6b-9ef3-802b77524517\") " pod="openshift-cluster-node-tuning-operator/tuned-tjb9n"
Jul 13 02:56:26.641190 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.640121    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3a6d5aea-0e22-4c6b-9ef3-802b77524517-var-lib-kubelet\") pod \"tuned-tjb9n\" (UID: \"3a6d5aea-0e22-4c6b-9ef3-802b77524517\") " pod="openshift-cluster-node-tuning-operator/tuned-tjb9n"
Jul 13 02:56:26.641190 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.640175    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3a6d5aea-0e22-4c6b-9ef3-802b77524517-etc-modprobe-d\") pod \"tuned-tjb9n\" (UID: \"3a6d5aea-0e22-4c6b-9ef3-802b77524517\") " pod="openshift-cluster-node-tuning-operator/tuned-tjb9n"
Jul 13 02:56:26.642486 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.642456    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a6d5aea-0e22-4c6b-9ef3-802b77524517-tmp\") pod \"tuned-tjb9n\" (UID: \"3a6d5aea-0e22-4c6b-9ef3-802b77524517\") " pod="openshift-cluster-node-tuning-operator/tuned-tjb9n"
Jul 13 02:56:26.642624 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.642601    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3a6d5aea-0e22-4c6b-9ef3-802b77524517-etc-tuned\") pod \"tuned-tjb9n\" (UID: \"3a6d5aea-0e22-4c6b-9ef3-802b77524517\") " pod="openshift-cluster-node-tuning-operator/tuned-tjb9n"
Jul 13 02:56:26.642788 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.642766    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f526e46c-7702-4938-986f-45c9199f8e78-agent-certs\") pod \"konnectivity-agent-dfsgr\" (UID: \"f526e46c-7702-4938-986f-45c9199f8e78\") " pod="kube-system/konnectivity-agent-dfsgr"
Jul 13 02:56:26.646590 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:26.646198    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 02:56:26.646590 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:26.646225    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 02:56:26.646590 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:26.646240    2563 projected.go:196] Error preparing data for projected volume kube-api-access-58sns for pod openshift-network-diagnostics/network-check-target-24d7h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 02:56:26.646590 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:26.646321    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/71eff5ef-6532-42ba-b932-2911cfaedcac-kube-api-access-58sns podName:71eff5ef-6532-42ba-b932-2911cfaedcac nodeName:}" failed. No retries permitted until 2026-07-13 02:56:27.146301976 +0000 UTC m=+3.129092087 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-58sns" (UniqueName: "kubernetes.io/projected/71eff5ef-6532-42ba-b932-2911cfaedcac-kube-api-access-58sns") pod "network-check-target-24d7h" (UID: "71eff5ef-6532-42ba-b932-2911cfaedcac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 02:56:26.648852 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.648833    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7vb8\" (UniqueName: \"kubernetes.io/projected/bbf72fd6-813d-4e7e-8168-7b41c4605230-kube-api-access-b7vb8\") pod \"node-ca-jvpfc\" (UID: \"bbf72fd6-813d-4e7e-8168-7b41c4605230\") " pod="openshift-image-registry/node-ca-jvpfc"
Jul 13 02:56:26.648938 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.648851    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s89g4\" (UniqueName: \"kubernetes.io/projected/d365a05b-69cd-4a21-b6cf-d16d5560c7f3-kube-api-access-s89g4\") pod \"aws-ebs-csi-driver-node-thdfw\" (UID: \"d365a05b-69cd-4a21-b6cf-d16d5560c7f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thdfw"
Jul 13 02:56:26.649063 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.649042    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fgp8\" (UniqueName: \"kubernetes.io/projected/3a6d5aea-0e22-4c6b-9ef3-802b77524517-kube-api-access-2fgp8\") pod \"tuned-tjb9n\" (UID: \"3a6d5aea-0e22-4c6b-9ef3-802b77524517\") " pod="openshift-cluster-node-tuning-operator/tuned-tjb9n"
Jul 13 02:56:26.649278 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.649262    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x56x9\" (UniqueName: \"kubernetes.io/projected/b3b58c31-485d-4010-b36b-049e6006b525-kube-api-access-x56x9\") pod \"node-resolver-xnfwg\" (UID: \"b3b58c31-485d-4010-b36b-049e6006b525\") " pod="openshift-dns/node-resolver-xnfwg"
Jul 13 02:56:26.730087 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.730049    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-f94rg"
Jul 13 02:56:26.737399 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.737374    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-v5jkl"
Jul 13 02:56:26.747318 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.747292    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-p85gh"
Jul 13 02:56:26.756188 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.756160    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-v2725"
Jul 13 02:56:26.763132 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.763113    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thdfw"
Jul 13 02:56:26.769992 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.769968    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dfsgr"
Jul 13 02:56:26.777886 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.777863    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xnfwg"
Jul 13 02:56:26.783979 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.783955    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tjb9n"
Jul 13 02:56:26.789811 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:26.789779    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jvpfc"
Jul 13 02:56:27.042465 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:27.042378    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd0ac0dd-db5b-41c3-b69d-bcf3af528e20-metrics-certs\") pod \"network-metrics-daemon-p44kl\" (UID: \"cd0ac0dd-db5b-41c3-b69d-bcf3af528e20\") " pod="openshift-multus/network-metrics-daemon-p44kl"
Jul 13 02:56:27.042465 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:27.042461    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6dc5ae9e-d973-46ae-9924-43fc3e1e80f7-original-pull-secret\") pod \"global-pull-secret-syncer-j7pcm\" (UID: \"6dc5ae9e-d973-46ae-9924-43fc3e1e80f7\") " pod="kube-system/global-pull-secret-syncer-j7pcm"
Jul 13 02:56:27.042634 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:27.042549    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 02:56:27.042634 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:27.042566    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 02:56:27.042634 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:27.042617    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dc5ae9e-d973-46ae-9924-43fc3e1e80f7-original-pull-secret podName:6dc5ae9e-d973-46ae-9924-43fc3e1e80f7 nodeName:}" failed. No retries permitted until 2026-07-13 02:56:28.042604621 +0000 UTC m=+4.025394710 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6dc5ae9e-d973-46ae-9924-43fc3e1e80f7-original-pull-secret") pod "global-pull-secret-syncer-j7pcm" (UID: "6dc5ae9e-d973-46ae-9924-43fc3e1e80f7") : object "kube-system"/"original-pull-secret" not registered
Jul 13 02:56:27.042634 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:27.042632    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd0ac0dd-db5b-41c3-b69d-bcf3af528e20-metrics-certs podName:cd0ac0dd-db5b-41c3-b69d-bcf3af528e20 nodeName:}" failed. No retries permitted until 2026-07-13 02:56:28.042625395 +0000 UTC m=+4.025415484 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd0ac0dd-db5b-41c3-b69d-bcf3af528e20-metrics-certs") pod "network-metrics-daemon-p44kl" (UID: "cd0ac0dd-db5b-41c3-b69d-bcf3af528e20") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 02:56:27.244566 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:27.244532    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58sns\" (UniqueName: \"kubernetes.io/projected/71eff5ef-6532-42ba-b932-2911cfaedcac-kube-api-access-58sns\") pod \"network-check-target-24d7h\" (UID: \"71eff5ef-6532-42ba-b932-2911cfaedcac\") " pod="openshift-network-diagnostics/network-check-target-24d7h"
Jul 13 02:56:27.244728 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:27.244706    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 02:56:27.244780 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:27.244736    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 02:56:27.244780 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:27.244752    2563 projected.go:196] Error preparing data for projected volume kube-api-access-58sns for pod openshift-network-diagnostics/network-check-target-24d7h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 02:56:27.244861 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:27.244817    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/71eff5ef-6532-42ba-b932-2911cfaedcac-kube-api-access-58sns podName:71eff5ef-6532-42ba-b932-2911cfaedcac nodeName:}" failed. No retries permitted until 2026-07-13 02:56:28.244797085 +0000 UTC m=+4.227587174 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-58sns" (UniqueName: "kubernetes.io/projected/71eff5ef-6532-42ba-b932-2911cfaedcac-kube-api-access-58sns") pod "network-check-target-24d7h" (UID: "71eff5ef-6532-42ba-b932-2911cfaedcac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 02:56:27.474078 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:27.473984    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-12 02:51:27 +0000 UTC" deadline="2028-02-10 12:26:48.81447841 +0000 UTC"
Jul 13 02:56:27.474078 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:27.474020    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13857h30m21.340463533s"
Jul 13 02:56:27.591014 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:27.590983    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf526e46c_7702_4938_986f_45c9199f8e78.slice/crio-6ad693ac573326d6fcfe01d1619563077a279cd7da993e31f75025487f6acfa7 WatchSource:0}: Error finding container 6ad693ac573326d6fcfe01d1619563077a279cd7da993e31f75025487f6acfa7: Status 404 returned error can't find the container with id 6ad693ac573326d6fcfe01d1619563077a279cd7da993e31f75025487f6acfa7
Jul 13 02:56:27.592630 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:27.592519    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98357ee0_0a92_426c_8da6_516bf9162a68.slice/crio-a161a2068f13a042558fd80732a6c17e8b7789b2785d1390f157b925e5a177db WatchSource:0}: Error finding container a161a2068f13a042558fd80732a6c17e8b7789b2785d1390f157b925e5a177db: Status 404 returned error can't find the container with id a161a2068f13a042558fd80732a6c17e8b7789b2785d1390f157b925e5a177db
Jul 13 02:56:27.593814 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:27.593788    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a6d5aea_0e22_4c6b_9ef3_802b77524517.slice/crio-afee0dd0fb8db4bf201c7485d4240afc72765be10113d1f94205d5c6a241548d WatchSource:0}: Error finding container afee0dd0fb8db4bf201c7485d4240afc72765be10113d1f94205d5c6a241548d: Status 404 returned error can't find the container with id afee0dd0fb8db4bf201c7485d4240afc72765be10113d1f94205d5c6a241548d
Jul 13 02:56:27.596896 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:27.596871    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbf72fd6_813d_4e7e_8168_7b41c4605230.slice/crio-e100c0f23c411a840e42f7b1e094aff4be665ecae37730e232ca16da93747401 WatchSource:0}: Error finding container e100c0f23c411a840e42f7b1e094aff4be665ecae37730e232ca16da93747401: Status 404 returned error can't find the container with id e100c0f23c411a840e42f7b1e094aff4be665ecae37730e232ca16da93747401
Jul 13 02:56:27.599289 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:27.599268    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8933b47_8580_45ab_9f75_57c9a3f26842.slice/crio-f4e875bcc74fb42f67cb56a6b853745387e43546f129a57bca66303b879f20a3 WatchSource:0}: Error finding container f4e875bcc74fb42f67cb56a6b853745387e43546f129a57bca66303b879f20a3: Status 404 returned error can't find the container with id f4e875bcc74fb42f67cb56a6b853745387e43546f129a57bca66303b879f20a3
Jul 13 02:56:27.600435 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:27.600411    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89566977_a84a_41c6_815a_dbb71c0752c6.slice/crio-71276bf33c111dc9ce7b64f94dbd8edc67ef83f1205c4ac34df309a9b680038b WatchSource:0}: Error finding container 71276bf33c111dc9ce7b64f94dbd8edc67ef83f1205c4ac34df309a9b680038b: Status 404 returned error can't find the container with id 71276bf33c111dc9ce7b64f94dbd8edc67ef83f1205c4ac34df309a9b680038b
Jul 13 02:56:27.602054 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:27.602032    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3b58c31_485d_4010_b36b_049e6006b525.slice/crio-41da1b4971ada4431404d864ae050d772940d83d3aefa45f71082b8a37854f7d WatchSource:0}: Error finding container 41da1b4971ada4431404d864ae050d772940d83d3aefa45f71082b8a37854f7d: Status 404 returned error can't find the container with id 41da1b4971ada4431404d864ae050d772940d83d3aefa45f71082b8a37854f7d
Jul 13 02:56:27.602994 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:27.602959    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadf25180_4382_4582_b363_81a08923156a.slice/crio-a8bf68b2e570ad3dd21ffde90ba1e938e572b4572b675f4b72b0e15e7884fd03 WatchSource:0}: Error finding container a8bf68b2e570ad3dd21ffde90ba1e938e572b4572b675f4b72b0e15e7884fd03: Status 404 returned error can't find the container with id a8bf68b2e570ad3dd21ffde90ba1e938e572b4572b675f4b72b0e15e7884fd03
Jul 13 02:56:27.605749 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:56:27.604780    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd365a05b_69cd_4a21_b6cf_d16d5560c7f3.slice/crio-dd9385a91ae339800e5a463fcf1bb26fd48568172eb9b8545fa37fc55a6d71e9 WatchSource:0}: Error finding container dd9385a91ae339800e5a463fcf1bb26fd48568172eb9b8545fa37fc55a6d71e9: Status 404 returned error can't find the container with id dd9385a91ae339800e5a463fcf1bb26fd48568172eb9b8545fa37fc55a6d71e9
Jul 13 02:56:27.643446 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:27.643295    2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 02:56:28.051427 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:28.051385    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6dc5ae9e-d973-46ae-9924-43fc3e1e80f7-original-pull-secret\") pod \"global-pull-secret-syncer-j7pcm\" (UID: \"6dc5ae9e-d973-46ae-9924-43fc3e1e80f7\") " pod="kube-system/global-pull-secret-syncer-j7pcm"
Jul 13 02:56:28.051603 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:28.051470    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd0ac0dd-db5b-41c3-b69d-bcf3af528e20-metrics-certs\") pod \"network-metrics-daemon-p44kl\" (UID: \"cd0ac0dd-db5b-41c3-b69d-bcf3af528e20\") " pod="openshift-multus/network-metrics-daemon-p44kl"
Jul 13 02:56:28.051722 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:28.051701    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 02:56:28.051790 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:28.051779    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd0ac0dd-db5b-41c3-b69d-bcf3af528e20-metrics-certs podName:cd0ac0dd-db5b-41c3-b69d-bcf3af528e20 nodeName:}" failed. No retries permitted until 2026-07-13 02:56:30.051757544 +0000 UTC m=+6.034547635 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd0ac0dd-db5b-41c3-b69d-bcf3af528e20-metrics-certs") pod "network-metrics-daemon-p44kl" (UID: "cd0ac0dd-db5b-41c3-b69d-bcf3af528e20") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 02:56:28.052302 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:28.052285    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 02:56:28.052375 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:28.052332    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dc5ae9e-d973-46ae-9924-43fc3e1e80f7-original-pull-secret podName:6dc5ae9e-d973-46ae-9924-43fc3e1e80f7 nodeName:}" failed. No retries permitted until 2026-07-13 02:56:30.052318941 +0000 UTC m=+6.035109029 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6dc5ae9e-d973-46ae-9924-43fc3e1e80f7-original-pull-secret") pod "global-pull-secret-syncer-j7pcm" (UID: "6dc5ae9e-d973-46ae-9924-43fc3e1e80f7") : object "kube-system"/"original-pull-secret" not registered
Jul 13 02:56:28.253146 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:28.253111    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58sns\" (UniqueName: \"kubernetes.io/projected/71eff5ef-6532-42ba-b932-2911cfaedcac-kube-api-access-58sns\") pod \"network-check-target-24d7h\" (UID: \"71eff5ef-6532-42ba-b932-2911cfaedcac\") " pod="openshift-network-diagnostics/network-check-target-24d7h"
Jul 13 02:56:28.253344 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:28.253327    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 02:56:28.253408 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:28.253357    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 02:56:28.253408 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:28.253371    2563 projected.go:196] Error preparing data for projected volume kube-api-access-58sns for pod openshift-network-diagnostics/network-check-target-24d7h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 02:56:28.253513 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:28.253433    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/71eff5ef-6532-42ba-b932-2911cfaedcac-kube-api-access-58sns podName:71eff5ef-6532-42ba-b932-2911cfaedcac nodeName:}" failed. No retries permitted until 2026-07-13 02:56:30.253413625 +0000 UTC m=+6.236203729 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-58sns" (UniqueName: "kubernetes.io/projected/71eff5ef-6532-42ba-b932-2911cfaedcac-kube-api-access-58sns") pod "network-check-target-24d7h" (UID: "71eff5ef-6532-42ba-b932-2911cfaedcac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 02:56:28.474443 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:28.474399    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-12 02:51:27 +0000 UTC" deadline="2028-03-24 16:03:28.713401626 +0000 UTC"
Jul 13 02:56:28.474443 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:28.474441    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14893h7m0.238965494s"
Jul 13 02:56:28.535870 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:28.535794    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-24d7h"
Jul 13 02:56:28.536055 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:28.536029    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-24d7h" podUID="71eff5ef-6532-42ba-b932-2911cfaedcac"
Jul 13 02:56:28.536565 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:28.536540    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j7pcm"
Jul 13 02:56:28.536709 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:28.536688    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j7pcm" podUID="6dc5ae9e-d973-46ae-9924-43fc3e1e80f7"
Jul 13 02:56:28.536802 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:28.536789    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p44kl"
Jul 13 02:56:28.536951 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:28.536933    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p44kl" podUID="cd0ac0dd-db5b-41c3-b69d-bcf3af528e20"
Jul 13 02:56:28.554213 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:28.554181    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f94rg" event={"ID":"89566977-a84a-41c6-815a-dbb71c0752c6","Type":"ContainerStarted","Data":"71276bf33c111dc9ce7b64f94dbd8edc67ef83f1205c4ac34df309a9b680038b"}
Jul 13 02:56:28.560913 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:28.560883    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v2725" event={"ID":"a8933b47-8580-45ab-9f75-57c9a3f26842","Type":"ContainerStarted","Data":"f4e875bcc74fb42f67cb56a6b853745387e43546f129a57bca66303b879f20a3"}
Jul 13 02:56:28.584950 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:28.584919    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tjb9n" event={"ID":"3a6d5aea-0e22-4c6b-9ef3-802b77524517","Type":"ContainerStarted","Data":"afee0dd0fb8db4bf201c7485d4240afc72765be10113d1f94205d5c6a241548d"}
Jul 13 02:56:28.592171 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:28.592142    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-v5jkl" event={"ID":"98357ee0-0a92-426c-8da6-516bf9162a68","Type":"ContainerStarted","Data":"a161a2068f13a042558fd80732a6c17e8b7789b2785d1390f157b925e5a177db"}
Jul 13 02:56:28.599364 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:28.598927    2563 generic.go:356] "Generic (PLEG): container finished" podID="4ecd9394d8fd6d5c9fb991ff91ceb8aa" containerID="c5d438be59073ffae690e248d5054141b9d2267c01665e5971139daef7d4c019" exitCode=0
Jul 13 02:56:28.599364 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:28.599030    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-39.ec2.internal" event={"ID":"4ecd9394d8fd6d5c9fb991ff91ceb8aa","Type":"ContainerDied","Data":"c5d438be59073ffae690e248d5054141b9d2267c01665e5971139daef7d4c019"}
Jul 13 02:56:28.623767 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:28.623740    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-39.ec2.internal" event={"ID":"22757a058972fd2ede1c4ccbaa378251","Type":"ContainerStarted","Data":"ea922f4524d8de0129d9d60b6cb85625aaebd055fc933348c4ff788a2669325e"}
Jul 13 02:56:28.636898 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:28.636871    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-p85gh" event={"ID":"adf25180-4382-4582-b363-81a08923156a","Type":"ContainerStarted","Data":"a8bf68b2e570ad3dd21ffde90ba1e938e572b4572b675f4b72b0e15e7884fd03"}
Jul 13 02:56:28.663619 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:28.663371    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jvpfc" event={"ID":"bbf72fd6-813d-4e7e-8168-7b41c4605230","Type":"ContainerStarted","Data":"e100c0f23c411a840e42f7b1e094aff4be665ecae37730e232ca16da93747401"}
Jul 13 02:56:28.676917 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:28.676885    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dfsgr" event={"ID":"f526e46c-7702-4938-986f-45c9199f8e78","Type":"ContainerStarted","Data":"6ad693ac573326d6fcfe01d1619563077a279cd7da993e31f75025487f6acfa7"}
Jul 13 02:56:28.685573 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:28.685474    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thdfw" event={"ID":"d365a05b-69cd-4a21-b6cf-d16d5560c7f3","Type":"ContainerStarted","Data":"dd9385a91ae339800e5a463fcf1bb26fd48568172eb9b8545fa37fc55a6d71e9"}
Jul 13 02:56:28.698030 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:28.697976    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xnfwg" event={"ID":"b3b58c31-485d-4010-b36b-049e6006b525","Type":"ContainerStarted","Data":"41da1b4971ada4431404d864ae050d772940d83d3aefa45f71082b8a37854f7d"}
Jul 13 02:56:29.706547 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:29.706366    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-39.ec2.internal" event={"ID":"4ecd9394d8fd6d5c9fb991ff91ceb8aa","Type":"ContainerStarted","Data":"6a9e387a6bfabc72ddc066d5ac1969c56af8ab43c211f4b4eac5955a8932b593"}
Jul 13 02:56:29.724107 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:29.723966    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-39.ec2.internal" podStartSLOduration=2.723945478 podStartE2EDuration="2.723945478s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 02:56:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 02:56:28.641377752 +0000 UTC m=+4.624167867" watchObservedRunningTime="2026-07-13 02:56:29.723945478 +0000 UTC m=+5.706735591"
Jul 13 02:56:29.724502 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:29.724467    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-39.ec2.internal" podStartSLOduration=2.724451547 podStartE2EDuration="2.724451547s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 02:56:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 02:56:29.723546476 +0000 UTC m=+5.706336591" watchObservedRunningTime="2026-07-13 02:56:29.724451547 +0000 UTC m=+5.707241662"
Jul 13 02:56:30.069752 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:30.069584    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd0ac0dd-db5b-41c3-b69d-bcf3af528e20-metrics-certs\") pod \"network-metrics-daemon-p44kl\" (UID: \"cd0ac0dd-db5b-41c3-b69d-bcf3af528e20\") " pod="openshift-multus/network-metrics-daemon-p44kl"
Jul 13 02:56:30.069752 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:30.069666    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6dc5ae9e-d973-46ae-9924-43fc3e1e80f7-original-pull-secret\") pod \"global-pull-secret-syncer-j7pcm\" (UID: \"6dc5ae9e-d973-46ae-9924-43fc3e1e80f7\") " pod="kube-system/global-pull-secret-syncer-j7pcm"
Jul 13 02:56:30.069983 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:30.069803    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 02:56:30.069983 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:30.069870    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dc5ae9e-d973-46ae-9924-43fc3e1e80f7-original-pull-secret podName:6dc5ae9e-d973-46ae-9924-43fc3e1e80f7 nodeName:}" failed. No retries permitted until 2026-07-13 02:56:34.069849942 +0000 UTC m=+10.052640038 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6dc5ae9e-d973-46ae-9924-43fc3e1e80f7-original-pull-secret") pod "global-pull-secret-syncer-j7pcm" (UID: "6dc5ae9e-d973-46ae-9924-43fc3e1e80f7") : object "kube-system"/"original-pull-secret" not registered
Jul 13 02:56:30.069983 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:30.069943    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 02:56:30.070193 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:30.069978    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd0ac0dd-db5b-41c3-b69d-bcf3af528e20-metrics-certs podName:cd0ac0dd-db5b-41c3-b69d-bcf3af528e20 nodeName:}" failed. No retries permitted until 2026-07-13 02:56:34.069966389 +0000 UTC m=+10.052756483 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd0ac0dd-db5b-41c3-b69d-bcf3af528e20-metrics-certs") pod "network-metrics-daemon-p44kl" (UID: "cd0ac0dd-db5b-41c3-b69d-bcf3af528e20") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 02:56:30.272076 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:30.271374    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58sns\" (UniqueName: \"kubernetes.io/projected/71eff5ef-6532-42ba-b932-2911cfaedcac-kube-api-access-58sns\") pod \"network-check-target-24d7h\" (UID: \"71eff5ef-6532-42ba-b932-2911cfaedcac\") " pod="openshift-network-diagnostics/network-check-target-24d7h"
Jul 13 02:56:30.272076 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:30.271579    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 02:56:30.272076 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:30.271604    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 02:56:30.272076 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:30.271617    2563 projected.go:196] Error preparing data for projected volume kube-api-access-58sns for pod openshift-network-diagnostics/network-check-target-24d7h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 02:56:30.272076 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:30.271686    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/71eff5ef-6532-42ba-b932-2911cfaedcac-kube-api-access-58sns podName:71eff5ef-6532-42ba-b932-2911cfaedcac nodeName:}" failed. No retries permitted until 2026-07-13 02:56:34.271665485 +0000 UTC m=+10.254455579 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-58sns" (UniqueName: "kubernetes.io/projected/71eff5ef-6532-42ba-b932-2911cfaedcac-kube-api-access-58sns") pod "network-check-target-24d7h" (UID: "71eff5ef-6532-42ba-b932-2911cfaedcac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 02:56:30.528602 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:30.528517    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-24d7h"
Jul 13 02:56:30.528772 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:30.528629    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-24d7h" podUID="71eff5ef-6532-42ba-b932-2911cfaedcac"
Jul 13 02:56:30.528973 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:30.528954    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p44kl"
Jul 13 02:56:30.529109 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:30.529087    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p44kl" podUID="cd0ac0dd-db5b-41c3-b69d-bcf3af528e20"
Jul 13 02:56:30.529239 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:30.529181    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j7pcm"
Jul 13 02:56:30.529297 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:30.529260    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j7pcm" podUID="6dc5ae9e-d973-46ae-9924-43fc3e1e80f7"
Jul 13 02:56:32.527638 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:32.527607    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-24d7h"
Jul 13 02:56:32.528120 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:32.527711    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-24d7h" podUID="71eff5ef-6532-42ba-b932-2911cfaedcac"
Jul 13 02:56:32.528120 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:32.528051    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p44kl"
Jul 13 02:56:32.528246 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:32.528174    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p44kl" podUID="cd0ac0dd-db5b-41c3-b69d-bcf3af528e20"
Jul 13 02:56:32.528246 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:32.528207    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j7pcm"
Jul 13 02:56:32.528350 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:32.528297    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j7pcm" podUID="6dc5ae9e-d973-46ae-9924-43fc3e1e80f7"
Jul 13 02:56:34.109886 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:34.109284    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6dc5ae9e-d973-46ae-9924-43fc3e1e80f7-original-pull-secret\") pod \"global-pull-secret-syncer-j7pcm\" (UID: \"6dc5ae9e-d973-46ae-9924-43fc3e1e80f7\") " pod="kube-system/global-pull-secret-syncer-j7pcm"
Jul 13 02:56:34.109886 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:34.109373    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd0ac0dd-db5b-41c3-b69d-bcf3af528e20-metrics-certs\") pod \"network-metrics-daemon-p44kl\" (UID: \"cd0ac0dd-db5b-41c3-b69d-bcf3af528e20\") " pod="openshift-multus/network-metrics-daemon-p44kl"
Jul 13 02:56:34.109886 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:34.109440    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 02:56:34.109886 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:34.109490    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 02:56:34.109886 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:34.109514    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dc5ae9e-d973-46ae-9924-43fc3e1e80f7-original-pull-secret podName:6dc5ae9e-d973-46ae-9924-43fc3e1e80f7 nodeName:}" failed. No retries permitted until 2026-07-13 02:56:42.109493461 +0000 UTC m=+18.092283563 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6dc5ae9e-d973-46ae-9924-43fc3e1e80f7-original-pull-secret") pod "global-pull-secret-syncer-j7pcm" (UID: "6dc5ae9e-d973-46ae-9924-43fc3e1e80f7") : object "kube-system"/"original-pull-secret" not registered
Jul 13 02:56:34.109886 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:34.109546    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd0ac0dd-db5b-41c3-b69d-bcf3af528e20-metrics-certs podName:cd0ac0dd-db5b-41c3-b69d-bcf3af528e20 nodeName:}" failed. No retries permitted until 2026-07-13 02:56:42.109526061 +0000 UTC m=+18.092316170 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd0ac0dd-db5b-41c3-b69d-bcf3af528e20-metrics-certs") pod "network-metrics-daemon-p44kl" (UID: "cd0ac0dd-db5b-41c3-b69d-bcf3af528e20") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 02:56:34.311853 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:34.311814    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58sns\" (UniqueName: \"kubernetes.io/projected/71eff5ef-6532-42ba-b932-2911cfaedcac-kube-api-access-58sns\") pod \"network-check-target-24d7h\" (UID: \"71eff5ef-6532-42ba-b932-2911cfaedcac\") " pod="openshift-network-diagnostics/network-check-target-24d7h"
Jul 13 02:56:34.312058 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:34.312032    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 02:56:34.312058 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:34.312057    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 02:56:34.312208 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:34.312070    2563 projected.go:196] Error preparing data for projected volume kube-api-access-58sns for pod openshift-network-diagnostics/network-check-target-24d7h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 02:56:34.312208 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:34.312137    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/71eff5ef-6532-42ba-b932-2911cfaedcac-kube-api-access-58sns podName:71eff5ef-6532-42ba-b932-2911cfaedcac nodeName:}" failed. No retries permitted until 2026-07-13 02:56:42.312117328 +0000 UTC m=+18.294907423 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-58sns" (UniqueName: "kubernetes.io/projected/71eff5ef-6532-42ba-b932-2911cfaedcac-kube-api-access-58sns") pod "network-check-target-24d7h" (UID: "71eff5ef-6532-42ba-b932-2911cfaedcac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 02:56:34.526686 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:34.526607    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-24d7h"
Jul 13 02:56:34.526841 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:34.526694    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-24d7h" podUID="71eff5ef-6532-42ba-b932-2911cfaedcac"
Jul 13 02:56:34.526841 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:34.526822    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p44kl"
Jul 13 02:56:34.527007 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:34.526925    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p44kl" podUID="cd0ac0dd-db5b-41c3-b69d-bcf3af528e20"
Jul 13 02:56:34.527078 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:34.527005    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j7pcm"
Jul 13 02:56:34.527136 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:34.527092    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j7pcm" podUID="6dc5ae9e-d973-46ae-9924-43fc3e1e80f7"
Jul 13 02:56:36.526138 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:36.526101    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-24d7h"
Jul 13 02:56:36.526593 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:36.526239    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-24d7h" podUID="71eff5ef-6532-42ba-b932-2911cfaedcac"
Jul 13 02:56:36.526654 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:36.526641    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j7pcm"
Jul 13 02:56:36.526776 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:36.526744    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j7pcm" podUID="6dc5ae9e-d973-46ae-9924-43fc3e1e80f7"
Jul 13 02:56:36.526890 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:36.526812    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p44kl"
Jul 13 02:56:36.526938 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:36.526902    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p44kl" podUID="cd0ac0dd-db5b-41c3-b69d-bcf3af528e20"
Jul 13 02:56:38.525265 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:38.525231    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p44kl"
Jul 13 02:56:38.525790 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:38.525236    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j7pcm"
Jul 13 02:56:38.525790 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:38.525382    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p44kl" podUID="cd0ac0dd-db5b-41c3-b69d-bcf3af528e20"
Jul 13 02:56:38.525790 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:38.525516    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-24d7h"
Jul 13 02:56:38.525790 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:38.525513    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j7pcm" podUID="6dc5ae9e-d973-46ae-9924-43fc3e1e80f7"
Jul 13 02:56:38.525790 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:38.525602    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-24d7h" podUID="71eff5ef-6532-42ba-b932-2911cfaedcac"
Jul 13 02:56:40.525184 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:40.525151    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-24d7h"
Jul 13 02:56:40.525621 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:40.525189    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p44kl"
Jul 13 02:56:40.525621 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:40.525151    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j7pcm"
Jul 13 02:56:40.525621 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:40.525274    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-24d7h" podUID="71eff5ef-6532-42ba-b932-2911cfaedcac"
Jul 13 02:56:40.525621 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:40.525406    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j7pcm" podUID="6dc5ae9e-d973-46ae-9924-43fc3e1e80f7"
Jul 13 02:56:40.525621 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:40.525492    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p44kl" podUID="cd0ac0dd-db5b-41c3-b69d-bcf3af528e20"
Jul 13 02:56:42.171267 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:42.171217    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd0ac0dd-db5b-41c3-b69d-bcf3af528e20-metrics-certs\") pod \"network-metrics-daemon-p44kl\" (UID: \"cd0ac0dd-db5b-41c3-b69d-bcf3af528e20\") " pod="openshift-multus/network-metrics-daemon-p44kl"
Jul 13 02:56:42.171692 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:42.171327    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6dc5ae9e-d973-46ae-9924-43fc3e1e80f7-original-pull-secret\") pod \"global-pull-secret-syncer-j7pcm\" (UID: \"6dc5ae9e-d973-46ae-9924-43fc3e1e80f7\") " pod="kube-system/global-pull-secret-syncer-j7pcm"
Jul 13 02:56:42.171692 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:42.171495    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 02:56:42.171692 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:42.171566    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dc5ae9e-d973-46ae-9924-43fc3e1e80f7-original-pull-secret podName:6dc5ae9e-d973-46ae-9924-43fc3e1e80f7 nodeName:}" failed. No retries permitted until 2026-07-13 02:56:58.171546714 +0000 UTC m=+34.154336816 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6dc5ae9e-d973-46ae-9924-43fc3e1e80f7-original-pull-secret") pod "global-pull-secret-syncer-j7pcm" (UID: "6dc5ae9e-d973-46ae-9924-43fc3e1e80f7") : object "kube-system"/"original-pull-secret" not registered
Jul 13 02:56:42.172093 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:42.172074    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 02:56:42.172167 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:42.172137    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd0ac0dd-db5b-41c3-b69d-bcf3af528e20-metrics-certs podName:cd0ac0dd-db5b-41c3-b69d-bcf3af528e20 nodeName:}" failed. No retries permitted until 2026-07-13 02:56:58.17212109 +0000 UTC m=+34.154911191 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd0ac0dd-db5b-41c3-b69d-bcf3af528e20-metrics-certs") pod "network-metrics-daemon-p44kl" (UID: "cd0ac0dd-db5b-41c3-b69d-bcf3af528e20") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 02:56:42.373607 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:42.373570    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58sns\" (UniqueName: \"kubernetes.io/projected/71eff5ef-6532-42ba-b932-2911cfaedcac-kube-api-access-58sns\") pod \"network-check-target-24d7h\" (UID: \"71eff5ef-6532-42ba-b932-2911cfaedcac\") " pod="openshift-network-diagnostics/network-check-target-24d7h"
Jul 13 02:56:42.373765 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:42.373750    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 02:56:42.373810 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:42.373772    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 02:56:42.373810 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:42.373781    2563 projected.go:196] Error preparing data for projected volume kube-api-access-58sns for pod openshift-network-diagnostics/network-check-target-24d7h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 02:56:42.373907 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:42.373832    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/71eff5ef-6532-42ba-b932-2911cfaedcac-kube-api-access-58sns podName:71eff5ef-6532-42ba-b932-2911cfaedcac nodeName:}" failed. No retries permitted until 2026-07-13 02:56:58.373819171 +0000 UTC m=+34.356609258 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-58sns" (UniqueName: "kubernetes.io/projected/71eff5ef-6532-42ba-b932-2911cfaedcac-kube-api-access-58sns") pod "network-check-target-24d7h" (UID: "71eff5ef-6532-42ba-b932-2911cfaedcac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 02:56:42.525440 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:42.525345    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-24d7h"
Jul 13 02:56:42.525602 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:42.525357    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p44kl"
Jul 13 02:56:42.525602 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:42.525467    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-24d7h" podUID="71eff5ef-6532-42ba-b932-2911cfaedcac"
Jul 13 02:56:42.525602 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:42.525575    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p44kl" podUID="cd0ac0dd-db5b-41c3-b69d-bcf3af528e20"
Jul 13 02:56:42.525782 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:42.525632    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j7pcm"
Jul 13 02:56:42.525782 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:42.525703    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j7pcm" podUID="6dc5ae9e-d973-46ae-9924-43fc3e1e80f7"
Jul 13 02:56:44.526494 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:44.526463    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j7pcm"
Jul 13 02:56:44.526944 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:44.526566    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-24d7h"
Jul 13 02:56:44.526944 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:44.526608    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j7pcm" podUID="6dc5ae9e-d973-46ae-9924-43fc3e1e80f7"
Jul 13 02:56:44.526944 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:44.526638    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-24d7h" podUID="71eff5ef-6532-42ba-b932-2911cfaedcac"
Jul 13 02:56:44.526944 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:44.526663    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p44kl"
Jul 13 02:56:44.526944 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:44.526746    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p44kl" podUID="cd0ac0dd-db5b-41c3-b69d-bcf3af528e20"
Jul 13 02:56:46.525122 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:46.525090    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j7pcm"
Jul 13 02:56:46.525595 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:46.525101    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-24d7h"
Jul 13 02:56:46.525595 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:46.525208    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p44kl"
Jul 13 02:56:46.525595 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:46.525208    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j7pcm" podUID="6dc5ae9e-d973-46ae-9924-43fc3e1e80f7"
Jul 13 02:56:46.525595 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:46.525280    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-24d7h" podUID="71eff5ef-6532-42ba-b932-2911cfaedcac"
Jul 13 02:56:46.525595 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:46.525359    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p44kl" podUID="cd0ac0dd-db5b-41c3-b69d-bcf3af528e20"
Jul 13 02:56:47.743512 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:47.743350    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jvpfc" event={"ID":"bbf72fd6-813d-4e7e-8168-7b41c4605230","Type":"ContainerStarted","Data":"e7c5c3fd00596d5ccc26e7e056c432fd53339069ac88623a415200da83c1ba45"}
Jul 13 02:56:47.744716 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:47.744692    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dfsgr" event={"ID":"f526e46c-7702-4938-986f-45c9199f8e78","Type":"ContainerStarted","Data":"33a54d0384fc06cbbc1ab6d9df6174add3e25511e3a48e7c9ac58750b3528333"}
Jul 13 02:56:47.745978 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:47.745954    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thdfw" event={"ID":"d365a05b-69cd-4a21-b6cf-d16d5560c7f3","Type":"ContainerStarted","Data":"ee127363a52a569558f3cf6ec34d13a0e2d30afc50e8ea6e369a240db1aae7ef"}
Jul 13 02:56:47.747266 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:47.747243    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xnfwg" event={"ID":"b3b58c31-485d-4010-b36b-049e6006b525","Type":"ContainerStarted","Data":"9b511c7842a3b72fc9c903da3ceceda9801b9ce7fc2e9cb9a9b812b404c4a7eb"}
Jul 13 02:56:47.748472 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:47.748449    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f94rg" event={"ID":"89566977-a84a-41c6-815a-dbb71c0752c6","Type":"ContainerStarted","Data":"b8d8f92a54ceb134ed1bf6ddee26c5300a625de6dc8028176c512f30780684f1"}
Jul 13 02:56:47.749720 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:47.749703    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v2725" event={"ID":"a8933b47-8580-45ab-9f75-57c9a3f26842","Type":"ContainerStarted","Data":"7d5a4bc93276a53f3f93984d36fc2ec1e33f62bd3791522207cce5525236a5c1"}
Jul 13 02:56:47.751082 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:47.751064    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tjb9n" event={"ID":"3a6d5aea-0e22-4c6b-9ef3-802b77524517","Type":"ContainerStarted","Data":"0207ed9adb5ac32f9ab6d89102ad0afa5c9c410df56fd8cab1c210aba7624f48"}
Jul 13 02:56:47.752553 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:47.752504    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-v5jkl" event={"ID":"98357ee0-0a92-426c-8da6-516bf9162a68","Type":"ContainerStarted","Data":"dcc26fa71b252a136e6ffe223007e3f948d6149fb855e384cb4c47bd33337c5f"}
Jul 13 02:56:47.758748 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:47.758712    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-jvpfc" podStartSLOduration=3.012207089 podStartE2EDuration="22.75870055s" totalImagesPullingTime="19.746493461s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 02:56:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 02:56:47.758387604 +0000 UTC m=+23.741177712" watchObservedRunningTime="2026-07-13 02:56:47.75870055 +0000 UTC m=+23.741490685"
Jul 13 02:56:47.806480 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:47.806442    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-v5jkl" podStartSLOduration=2.982223592 podStartE2EDuration="22.806430394s" totalImagesPullingTime="19.824206802s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 02:56:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 02:56:47.806391124 +0000 UTC m=+23.789181233" watchObservedRunningTime="2026-07-13 02:56:47.806430394 +0000 UTC m=+23.789220502"
Jul 13 02:56:47.806892 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:47.806873    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-dfsgr" podStartSLOduration=7.289948235 podStartE2EDuration="22.806866826s" totalImagesPullingTime="15.516918591s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 02:56:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 02:56:47.791434414 +0000 UTC m=+23.774224524" watchObservedRunningTime="2026-07-13 02:56:47.806866826 +0000 UTC m=+23.789656934"
Jul 13 02:56:47.820968 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:47.820916    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-xnfwg" podStartSLOduration=3.050979843 podStartE2EDuration="22.820906188s" totalImagesPullingTime="19.769926345s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 02:56:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 02:56:47.820664869 +0000 UTC m=+23.803454976" watchObservedRunningTime="2026-07-13 02:56:47.820906188 +0000 UTC m=+23.803696297"
Jul 13 02:56:47.839419 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:47.839379    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-tjb9n" podStartSLOduration=3.059661394 podStartE2EDuration="22.839368732s" totalImagesPullingTime="19.779707338s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 02:56:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 02:56:47.83904532 +0000 UTC m=+23.821835429" watchObservedRunningTime="2026-07-13 02:56:47.839368732 +0000 UTC m=+23.822158841"
Jul 13 02:56:48.526282 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:48.526100    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-24d7h"
Jul 13 02:56:48.526448 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:48.526100    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j7pcm"
Jul 13 02:56:48.526448 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:48.526384    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-24d7h" podUID="71eff5ef-6532-42ba-b932-2911cfaedcac"
Jul 13 02:56:48.526448 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:48.526164    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p44kl"
Jul 13 02:56:48.526448 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:48.526430    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j7pcm" podUID="6dc5ae9e-d973-46ae-9924-43fc3e1e80f7"
Jul 13 02:56:48.526646 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:48.526534    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p44kl" podUID="cd0ac0dd-db5b-41c3-b69d-bcf3af528e20"
Jul 13 02:56:48.755485 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:48.755457    2563 generic.go:356] "Generic (PLEG): container finished" podID="89566977-a84a-41c6-815a-dbb71c0752c6" containerID="b8d8f92a54ceb134ed1bf6ddee26c5300a625de6dc8028176c512f30780684f1" exitCode=0
Jul 13 02:56:48.755863 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:48.755533    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f94rg" event={"ID":"89566977-a84a-41c6-815a-dbb71c0752c6","Type":"ContainerDied","Data":"b8d8f92a54ceb134ed1bf6ddee26c5300a625de6dc8028176c512f30780684f1"}
Jul 13 02:56:48.758191 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:48.758174    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v2725_a8933b47-8580-45ab-9f75-57c9a3f26842/ovn-acl-logging/0.log"
Jul 13 02:56:48.758502 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:48.758478    2563 generic.go:356] "Generic (PLEG): container finished" podID="a8933b47-8580-45ab-9f75-57c9a3f26842" containerID="c40b7a7a7eb2902b7cd8470c83707d03af241ae3c804d2f9d20c70ff7f2a5500" exitCode=1
Jul 13 02:56:48.758593 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:48.758552    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v2725" event={"ID":"a8933b47-8580-45ab-9f75-57c9a3f26842","Type":"ContainerStarted","Data":"126f54b916375ea4ba5c87f271b693855a684558ba1b52f6a707bf3353d77e92"}
Jul 13 02:56:48.758644 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:48.758627    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v2725" event={"ID":"a8933b47-8580-45ab-9f75-57c9a3f26842","Type":"ContainerStarted","Data":"534e30988c43e00f6a7bfaa8de3f0335074a70cc741b5450b47872fee8b11024"}
Jul 13 02:56:48.758691 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:48.758679    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v2725" event={"ID":"a8933b47-8580-45ab-9f75-57c9a3f26842","Type":"ContainerStarted","Data":"e8a918244f4527575e828d6e2ed813c6a1d1db530fbac7be6d8eb2d2b2b068e0"}
Jul 13 02:56:48.758736 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:48.758728    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v2725" event={"ID":"a8933b47-8580-45ab-9f75-57c9a3f26842","Type":"ContainerStarted","Data":"a03211c13116fd0507bf918a7ed0fd3dceeca7d0f534c0410b6eb48a90a55758"}
Jul 13 02:56:48.758788 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:48.758774    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v2725" event={"ID":"a8933b47-8580-45ab-9f75-57c9a3f26842","Type":"ContainerDied","Data":"c40b7a7a7eb2902b7cd8470c83707d03af241ae3c804d2f9d20c70ff7f2a5500"}
Jul 13 02:56:48.760035 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:48.760012    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-p85gh" event={"ID":"adf25180-4382-4582-b363-81a08923156a","Type":"ContainerStarted","Data":"b35dc2ac77756c414baade61b1a3c57096e1270911be8c7e51ac2699cefa43d9"}
Jul 13 02:56:48.790966 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:48.790885    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-p85gh" podStartSLOduration=4.022164268 podStartE2EDuration="23.790873027s" totalImagesPullingTime="19.768708759s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 02:56:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 02:56:48.790598521 +0000 UTC m=+24.773388630" watchObservedRunningTime="2026-07-13 02:56:48.790873027 +0000 UTC m=+24.773663135"
Jul 13 02:56:48.981926 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:48.981903    2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 13 02:56:49.507536 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:49.507425    2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-13T02:56:48.981922094Z","UUID":"0a9e3043-4e33-49a6-a7b5-9950eb222f53","Handler":null,"Name":"","Endpoint":""}
Jul 13 02:56:49.509138 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:49.509116    2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 13 02:56:49.509260 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:49.509147    2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 13 02:56:49.764889 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:49.764812    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thdfw" event={"ID":"d365a05b-69cd-4a21-b6cf-d16d5560c7f3","Type":"ContainerStarted","Data":"357ae9397026be4591d017fce4c842032946a9245d48587907532b4edb53bcff"}
Jul 13 02:56:50.525827 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:50.525600    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-24d7h"
Jul 13 02:56:50.526021 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:50.525606    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p44kl"
Jul 13 02:56:50.526021 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:50.525958    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-24d7h" podUID="71eff5ef-6532-42ba-b932-2911cfaedcac"
Jul 13 02:56:50.526021 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:50.525668    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j7pcm"
Jul 13 02:56:50.526192 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:50.526045    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p44kl" podUID="cd0ac0dd-db5b-41c3-b69d-bcf3af528e20"
Jul 13 02:56:50.526192 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:50.526108    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j7pcm" podUID="6dc5ae9e-d973-46ae-9924-43fc3e1e80f7"
Jul 13 02:56:50.568618 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:50.568535    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-dfsgr"
Jul 13 02:56:50.569100 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:50.569079    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-dfsgr"
Jul 13 02:56:50.768862 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:50.768832    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thdfw" event={"ID":"d365a05b-69cd-4a21-b6cf-d16d5560c7f3","Type":"ContainerStarted","Data":"cd92139261a2522a5c374430f1586e594a19e4a55212f0c3cbfc8a14fccc4e54"}
Jul 13 02:56:50.772272 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:50.772219    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v2725_a8933b47-8580-45ab-9f75-57c9a3f26842/ovn-acl-logging/0.log"
Jul 13 02:56:50.772627 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:50.772607    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v2725" event={"ID":"a8933b47-8580-45ab-9f75-57c9a3f26842","Type":"ContainerStarted","Data":"ba6807b7849ac6600a2a1be16e6e238fe3b6fdd329ce582dbd97a20a669890fa"}
Jul 13 02:56:50.772894 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:50.772876    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-dfsgr"
Jul 13 02:56:50.773396 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:50.773379    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-dfsgr"
Jul 13 02:56:50.801905 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:50.801866    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-thdfw" podStartSLOduration=3.980799852 podStartE2EDuration="25.801851201s" totalImagesPullingTime="21.821051349s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 02:56:25 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 02:56:50.787724623 +0000 UTC m=+26.770514732" watchObservedRunningTime="2026-07-13 02:56:50.801851201 +0000 UTC m=+26.784641312"
Jul 13 02:56:52.525375 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:52.525343    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j7pcm"
Jul 13 02:56:52.525951 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:52.525341    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p44kl"
Jul 13 02:56:52.525951 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:52.525464    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j7pcm" podUID="6dc5ae9e-d973-46ae-9924-43fc3e1e80f7"
Jul 13 02:56:52.525951 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:52.525561    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p44kl" podUID="cd0ac0dd-db5b-41c3-b69d-bcf3af528e20"
Jul 13 02:56:52.525951 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:52.525354    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-24d7h"
Jul 13 02:56:52.525951 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:52.525658    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-24d7h" podUID="71eff5ef-6532-42ba-b932-2911cfaedcac"
Jul 13 02:56:53.781092 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:53.780896    2563 generic.go:356] "Generic (PLEG): container finished" podID="89566977-a84a-41c6-815a-dbb71c0752c6" containerID="bf6ea59b2459cee2251b6e3fee6d7f6a9ad8be2d979fe63ef399ac2b2a5b6986" exitCode=0
Jul 13 02:56:53.781698 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:53.780991    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f94rg" event={"ID":"89566977-a84a-41c6-815a-dbb71c0752c6","Type":"ContainerDied","Data":"bf6ea59b2459cee2251b6e3fee6d7f6a9ad8be2d979fe63ef399ac2b2a5b6986"}
Jul 13 02:56:53.784710 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:53.784695    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v2725_a8933b47-8580-45ab-9f75-57c9a3f26842/ovn-acl-logging/0.log"
Jul 13 02:56:53.785034 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:53.785009    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v2725" event={"ID":"a8933b47-8580-45ab-9f75-57c9a3f26842","Type":"ContainerStarted","Data":"2aaa9d27b3a3f96f399eb01b293214c8c364c1ac9efc3495f25709ffeaf64a94"}
Jul 13 02:56:53.785250 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:53.785237    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-v2725"
Jul 13 02:56:53.785309 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:53.785281    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-v2725"
Jul 13 02:56:53.785426 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:53.785410    2563 scope.go:117] "RemoveContainer" containerID="c40b7a7a7eb2902b7cd8470c83707d03af241ae3c804d2f9d20c70ff7f2a5500"
Jul 13 02:56:53.801633 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:53.801613    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v2725"
Jul 13 02:56:54.526060 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:54.526032    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-24d7h"
Jul 13 02:56:54.526060 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:54.526052    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j7pcm"
Jul 13 02:56:54.526209 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:54.526039    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p44kl"
Jul 13 02:56:54.526209 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:54.526139    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j7pcm" podUID="6dc5ae9e-d973-46ae-9924-43fc3e1e80f7"
Jul 13 02:56:54.526209 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:54.526188    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p44kl" podUID="cd0ac0dd-db5b-41c3-b69d-bcf3af528e20"
Jul 13 02:56:54.526494 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:54.526272    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-24d7h" podUID="71eff5ef-6532-42ba-b932-2911cfaedcac"
Jul 13 02:56:54.529528 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:54.529504    2563 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89566977_a84a_41c6_815a_dbb71c0752c6.slice/crio-conmon-7b7c4372660cd21da2ba9d23d027358139ce894edd246403ad28383ec1f74c80.scope\": RecentStats: unable to find data in memory cache]"
Jul 13 02:56:54.788997 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:54.788906    2563 generic.go:356] "Generic (PLEG): container finished" podID="89566977-a84a-41c6-815a-dbb71c0752c6" containerID="7b7c4372660cd21da2ba9d23d027358139ce894edd246403ad28383ec1f74c80" exitCode=0
Jul 13 02:56:54.789510 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:54.788991    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f94rg" event={"ID":"89566977-a84a-41c6-815a-dbb71c0752c6","Type":"ContainerDied","Data":"7b7c4372660cd21da2ba9d23d027358139ce894edd246403ad28383ec1f74c80"}
Jul 13 02:56:54.793024 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:54.793008    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v2725_a8933b47-8580-45ab-9f75-57c9a3f26842/ovn-acl-logging/0.log"
Jul 13 02:56:54.793353 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:54.793332    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v2725" event={"ID":"a8933b47-8580-45ab-9f75-57c9a3f26842","Type":"ContainerStarted","Data":"d201e32e85d7077c7eb5aa36e25351e08ff4ea33ddbd72ccdb5c9ad6457d1c54"}
Jul 13 02:56:54.793546 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:54.793526    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-v2725"
Jul 13 02:56:54.808956 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:54.808921    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v2725"
Jul 13 02:56:54.836005 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:54.835966    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-v2725" podStartSLOduration=10.044154746 podStartE2EDuration="29.835952861s" totalImagesPullingTime="19.791798115s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 02:56:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 02:56:54.834395785 +0000 UTC m=+30.817185893" watchObservedRunningTime="2026-07-13 02:56:54.835952861 +0000 UTC m=+30.818742964"
Jul 13 02:56:54.913633 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:54.913582    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-j7pcm"]
Jul 13 02:56:54.913814 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:54.913704    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j7pcm"
Jul 13 02:56:54.913873 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:54.913814    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j7pcm" podUID="6dc5ae9e-d973-46ae-9924-43fc3e1e80f7"
Jul 13 02:56:54.914561 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:54.914535    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-p44kl"]
Jul 13 02:56:54.914664 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:54.914633    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p44kl"
Jul 13 02:56:54.914773 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:54.914750    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p44kl" podUID="cd0ac0dd-db5b-41c3-b69d-bcf3af528e20"
Jul 13 02:56:54.915128 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:54.915108    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-24d7h"]
Jul 13 02:56:54.915206 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:54.915186    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-24d7h"
Jul 13 02:56:54.915286 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:54.915263    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-24d7h" podUID="71eff5ef-6532-42ba-b932-2911cfaedcac"
Jul 13 02:56:55.798051 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:55.797853    2563 generic.go:356] "Generic (PLEG): container finished" podID="89566977-a84a-41c6-815a-dbb71c0752c6" containerID="f1767b94e9a9b4491d56437e865ff33d89dffc8986d70dad3385434fc4ecd72f" exitCode=0
Jul 13 02:56:55.798366 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:55.797922    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f94rg" event={"ID":"89566977-a84a-41c6-815a-dbb71c0752c6","Type":"ContainerDied","Data":"f1767b94e9a9b4491d56437e865ff33d89dffc8986d70dad3385434fc4ecd72f"}
Jul 13 02:56:56.525466 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:56.525441    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j7pcm"
Jul 13 02:56:56.525610 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:56.525472    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p44kl"
Jul 13 02:56:56.525610 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:56.525445    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-24d7h"
Jul 13 02:56:56.525610 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:56.525579    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j7pcm" podUID="6dc5ae9e-d973-46ae-9924-43fc3e1e80f7"
Jul 13 02:56:56.525748 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:56.525652    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p44kl" podUID="cd0ac0dd-db5b-41c3-b69d-bcf3af528e20"
Jul 13 02:56:56.525748 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:56.525729    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-24d7h" podUID="71eff5ef-6532-42ba-b932-2911cfaedcac"
Jul 13 02:56:58.197430 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:58.197395    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd0ac0dd-db5b-41c3-b69d-bcf3af528e20-metrics-certs\") pod \"network-metrics-daemon-p44kl\" (UID: \"cd0ac0dd-db5b-41c3-b69d-bcf3af528e20\") " pod="openshift-multus/network-metrics-daemon-p44kl"
Jul 13 02:56:58.198100 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:58.197462    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6dc5ae9e-d973-46ae-9924-43fc3e1e80f7-original-pull-secret\") pod \"global-pull-secret-syncer-j7pcm\" (UID: \"6dc5ae9e-d973-46ae-9924-43fc3e1e80f7\") " pod="kube-system/global-pull-secret-syncer-j7pcm"
Jul 13 02:56:58.198100 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:58.197587    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 02:56:58.198100 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:58.197619    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 02:56:58.198100 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:58.197644    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dc5ae9e-d973-46ae-9924-43fc3e1e80f7-original-pull-secret podName:6dc5ae9e-d973-46ae-9924-43fc3e1e80f7 nodeName:}" failed. No retries permitted until 2026-07-13 02:57:30.197629651 +0000 UTC m=+66.180419738 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6dc5ae9e-d973-46ae-9924-43fc3e1e80f7-original-pull-secret") pod "global-pull-secret-syncer-j7pcm" (UID: "6dc5ae9e-d973-46ae-9924-43fc3e1e80f7") : object "kube-system"/"original-pull-secret" not registered
Jul 13 02:56:58.198100 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:58.197680    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd0ac0dd-db5b-41c3-b69d-bcf3af528e20-metrics-certs podName:cd0ac0dd-db5b-41c3-b69d-bcf3af528e20 nodeName:}" failed. No retries permitted until 2026-07-13 02:57:30.197663821 +0000 UTC m=+66.180453913 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd0ac0dd-db5b-41c3-b69d-bcf3af528e20-metrics-certs") pod "network-metrics-daemon-p44kl" (UID: "cd0ac0dd-db5b-41c3-b69d-bcf3af528e20") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 02:56:58.399239 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:58.399201    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58sns\" (UniqueName: \"kubernetes.io/projected/71eff5ef-6532-42ba-b932-2911cfaedcac-kube-api-access-58sns\") pod \"network-check-target-24d7h\" (UID: \"71eff5ef-6532-42ba-b932-2911cfaedcac\") " pod="openshift-network-diagnostics/network-check-target-24d7h"
Jul 13 02:56:58.399414 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:58.399367    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 02:56:58.399414 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:58.399389    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 02:56:58.399414 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:58.399400    2563 projected.go:196] Error preparing data for projected volume kube-api-access-58sns for pod openshift-network-diagnostics/network-check-target-24d7h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 02:56:58.399570 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:58.399454    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/71eff5ef-6532-42ba-b932-2911cfaedcac-kube-api-access-58sns podName:71eff5ef-6532-42ba-b932-2911cfaedcac nodeName:}" failed. No retries permitted until 2026-07-13 02:57:30.399436344 +0000 UTC m=+66.382226446 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-58sns" (UniqueName: "kubernetes.io/projected/71eff5ef-6532-42ba-b932-2911cfaedcac-kube-api-access-58sns") pod "network-check-target-24d7h" (UID: "71eff5ef-6532-42ba-b932-2911cfaedcac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 02:56:58.525754 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:58.525671    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j7pcm"
Jul 13 02:56:58.525754 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:58.525686    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-24d7h"
Jul 13 02:56:58.525986 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:58.525791    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j7pcm" podUID="6dc5ae9e-d973-46ae-9924-43fc3e1e80f7"
Jul 13 02:56:58.525986 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:58.525848    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-24d7h" podUID="71eff5ef-6532-42ba-b932-2911cfaedcac"
Jul 13 02:56:58.525986 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:56:58.525906    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p44kl"
Jul 13 02:56:58.526154 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:56:58.526018    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p44kl" podUID="cd0ac0dd-db5b-41c3-b69d-bcf3af528e20"
Jul 13 02:57:00.310961 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.310918    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-39.ec2.internal" event="NodeReady"
Jul 13 02:57:00.311418 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.311085    2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 13 02:57:00.372110 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.371999    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-654597fc58-2jqwg"]
Jul 13 02:57:00.378594 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.378572    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c856c9c8-pdqzk"]
Jul 13 02:57:00.378696 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.378679    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-654597fc58-2jqwg"
Jul 13 02:57:00.381145 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.381121    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 13 02:57:00.381245 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.381182    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-jtncw\""
Jul 13 02:57:00.381314 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.381271    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 13 02:57:00.381314 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.381296    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 13 02:57:00.388853 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.388835    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-4pspv"]
Jul 13 02:57:00.389052 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.389035    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c856c9c8-pdqzk"
Jul 13 02:57:00.391091 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.391066    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 13 02:57:00.391541 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.391518    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 13 02:57:00.392204 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.392188    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 13 02:57:00.392295 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.392279    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 13 02:57:00.392358 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.392319    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 13 02:57:00.396998 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.396978    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f7ddc8b98-6mtmk"]
Jul 13 02:57:00.397122 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.397094    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-4pspv"
Jul 13 02:57:00.404946 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.404908    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66c9ddcf4c-zjjkf"]
Jul 13 02:57:00.405035 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.405017    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f7ddc8b98-6mtmk"
Jul 13 02:57:00.413112 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.413086    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-5tx4z"]
Jul 13 02:57:00.413279 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.413261    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66c9ddcf4c-zjjkf"
Jul 13 02:57:00.414565 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.414550    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 13 02:57:00.420260 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.417103    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-2x46b\""
Jul 13 02:57:00.420260 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.419202    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-4pspv"]
Jul 13 02:57:00.420260 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.419244    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c856c9c8-pdqzk"]
Jul 13 02:57:00.420260 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.419342    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5tx4z"
Jul 13 02:57:00.422402 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.422384    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 13 02:57:00.425998 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.425980    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66c9ddcf4c-zjjkf"]
Jul 13 02:57:00.426923 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.426903    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-sgg7j"]
Jul 13 02:57:00.433380 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.433333    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-sgg7j"
Jul 13 02:57:00.435103 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.435041    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-654597fc58-2jqwg"]
Jul 13 02:57:00.439009 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.438990    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5tx4z"]
Jul 13 02:57:00.440458 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.439923    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 13 02:57:00.440564 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.440515    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 13 02:57:00.441292 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.441277    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 13 02:57:00.442839 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.442818    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 13 02:57:00.443487 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.443468    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 13 02:57:00.443487 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.443487    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 13 02:57:00.443611 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.443562    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-ldcpz\""
Jul 13 02:57:00.445290 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.445275    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 13 02:57:00.445457 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.445446    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-vw8zn\""
Jul 13 02:57:00.451888 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.451868    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 13 02:57:00.451991 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.451927    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 13 02:57:00.452060 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.451998    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9bqmq\""
Jul 13 02:57:00.452135 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.452121    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 13 02:57:00.453078 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.453055    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 02:57:00.460032 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.459996    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f7ddc8b98-6mtmk"]
Jul 13 02:57:00.460648 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.460628    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-sgg7j"]
Jul 13 02:57:00.513611 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.513589    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8a77feae-62c9-449c-a6ee-c896d674943d-registry-tls\") pod \"image-registry-654597fc58-2jqwg\" (UID: \"8a77feae-62c9-449c-a6ee-c896d674943d\") " pod="openshift-image-registry/image-registry-654597fc58-2jqwg"
Jul 13 02:57:00.513719 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.513620    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1b37dc03-7412-4c20-b134-7e6865ef104c-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5f7ddc8b98-6mtmk\" (UID: \"1b37dc03-7412-4c20-b134-7e6865ef104c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f7ddc8b98-6mtmk"
Jul 13 02:57:00.513719 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.513641    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e7b90bb5-05ef-4ae5-af93-553c55d28775-ca\") pod \"cluster-proxy-proxy-agent-66c9ddcf4c-zjjkf\" (UID: \"e7b90bb5-05ef-4ae5-af93-553c55d28775\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66c9ddcf4c-zjjkf"
Jul 13 02:57:00.513719 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.513658    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8a77feae-62c9-449c-a6ee-c896d674943d-registry-certificates\") pod \"image-registry-654597fc58-2jqwg\" (UID: \"8a77feae-62c9-449c-a6ee-c896d674943d\") " pod="openshift-image-registry/image-registry-654597fc58-2jqwg"
Jul 13 02:57:00.513719 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.513674    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3c83f9f2-ef52-44de-888a-6273032827fe-tmp\") pod \"klusterlet-addon-workmgr-9c856c9c8-pdqzk\" (UID: \"3c83f9f2-ef52-44de-888a-6273032827fe\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c856c9c8-pdqzk"
Jul 13 02:57:00.513719 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.513689    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7b90bb5-05ef-4ae5-af93-553c55d28775-additional-service-ca\") pod \"cluster-proxy-proxy-agent-66c9ddcf4c-zjjkf\" (UID: \"e7b90bb5-05ef-4ae5-af93-553c55d28775\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66c9ddcf4c-zjjkf"
Jul 13 02:57:00.513916 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.513771    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/917248b5-3953-4ace-831e-99a59df139c1-nginx-conf\") pod \"networking-console-plugin-6cf856758c-4pspv\" (UID: \"917248b5-3953-4ace-831e-99a59df139c1\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4pspv"
Jul 13 02:57:00.513916 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.513794    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/917248b5-3953-4ace-831e-99a59df139c1-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-4pspv\" (UID: \"917248b5-3953-4ace-831e-99a59df139c1\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4pspv"
Jul 13 02:57:00.513916 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.513812    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b32f1a22-542e-47d1-9c40-9de1fb178864-config-volume\") pod \"dns-default-5tx4z\" (UID: \"b32f1a22-542e-47d1-9c40-9de1fb178864\") " pod="openshift-dns/dns-default-5tx4z"
Jul 13 02:57:00.513916 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.513833    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e7b90bb5-05ef-4ae5-af93-553c55d28775-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-66c9ddcf4c-zjjkf\" (UID: \"e7b90bb5-05ef-4ae5-af93-553c55d28775\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66c9ddcf4c-zjjkf"
Jul 13 02:57:00.513916 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.513854    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b32f1a22-542e-47d1-9c40-9de1fb178864-metrics-tls\") pod \"dns-default-5tx4z\" (UID: \"b32f1a22-542e-47d1-9c40-9de1fb178864\") " pod="openshift-dns/dns-default-5tx4z"
Jul 13 02:57:00.513916 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.513874    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b32f1a22-542e-47d1-9c40-9de1fb178864-tmp-dir\") pod \"dns-default-5tx4z\" (UID: \"b32f1a22-542e-47d1-9c40-9de1fb178864\") " pod="openshift-dns/dns-default-5tx4z"
Jul 13 02:57:00.513916 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.513914    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e7b90bb5-05ef-4ae5-af93-553c55d28775-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-66c9ddcf4c-zjjkf\" (UID: \"e7b90bb5-05ef-4ae5-af93-553c55d28775\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66c9ddcf4c-zjjkf"
Jul 13 02:57:00.514357 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.513966    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8a77feae-62c9-449c-a6ee-c896d674943d-image-registry-private-configuration\") pod \"image-registry-654597fc58-2jqwg\" (UID: \"8a77feae-62c9-449c-a6ee-c896d674943d\") " pod="openshift-image-registry/image-registry-654597fc58-2jqwg"
Jul 13 02:57:00.514357 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.513991    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8a77feae-62c9-449c-a6ee-c896d674943d-trusted-ca\") pod \"image-registry-654597fc58-2jqwg\" (UID: \"8a77feae-62c9-449c-a6ee-c896d674943d\") " pod="openshift-image-registry/image-registry-654597fc58-2jqwg"
Jul 13 02:57:00.514357 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.514026    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8a77feae-62c9-449c-a6ee-c896d674943d-installation-pull-secrets\") pod \"image-registry-654597fc58-2jqwg\" (UID: \"8a77feae-62c9-449c-a6ee-c896d674943d\") " pod="openshift-image-registry/image-registry-654597fc58-2jqwg"
Jul 13 02:57:00.514357 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.514041    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dcjj\" (UniqueName: \"kubernetes.io/projected/1b37dc03-7412-4c20-b134-7e6865ef104c-kube-api-access-7dcjj\") pod \"managed-serviceaccount-addon-agent-5f7ddc8b98-6mtmk\" (UID: \"1b37dc03-7412-4c20-b134-7e6865ef104c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f7ddc8b98-6mtmk"
Jul 13 02:57:00.514357 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.514065    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/3c83f9f2-ef52-44de-888a-6273032827fe-klusterlet-config\") pod \"klusterlet-addon-workmgr-9c856c9c8-pdqzk\" (UID: \"3c83f9f2-ef52-44de-888a-6273032827fe\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c856c9c8-pdqzk"
Jul 13 02:57:00.514357 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.514117    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8a77feae-62c9-449c-a6ee-c896d674943d-ca-trust-extracted\") pod \"image-registry-654597fc58-2jqwg\" (UID: \"8a77feae-62c9-449c-a6ee-c896d674943d\") " pod="openshift-image-registry/image-registry-654597fc58-2jqwg"
Jul 13 02:57:00.514357 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.514157    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8a77feae-62c9-449c-a6ee-c896d674943d-bound-sa-token\") pod \"image-registry-654597fc58-2jqwg\" (UID: \"8a77feae-62c9-449c-a6ee-c896d674943d\") " pod="openshift-image-registry/image-registry-654597fc58-2jqwg"
Jul 13 02:57:00.514357 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.514189    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwfr8\" (UniqueName: \"kubernetes.io/projected/e7b90bb5-05ef-4ae5-af93-553c55d28775-kube-api-access-mwfr8\") pod \"cluster-proxy-proxy-agent-66c9ddcf4c-zjjkf\" (UID: \"e7b90bb5-05ef-4ae5-af93-553c55d28775\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66c9ddcf4c-zjjkf"
Jul 13 02:57:00.514357 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.514230    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skghx\" (UniqueName: \"kubernetes.io/projected/8a77feae-62c9-449c-a6ee-c896d674943d-kube-api-access-skghx\") pod \"image-registry-654597fc58-2jqwg\" (UID: \"8a77feae-62c9-449c-a6ee-c896d674943d\") " pod="openshift-image-registry/image-registry-654597fc58-2jqwg"
Jul 13 02:57:00.514357 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.514255    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24b52\" (UniqueName: \"kubernetes.io/projected/3c83f9f2-ef52-44de-888a-6273032827fe-kube-api-access-24b52\") pod \"klusterlet-addon-workmgr-9c856c9c8-pdqzk\" (UID: \"3c83f9f2-ef52-44de-888a-6273032827fe\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c856c9c8-pdqzk"
Jul 13 02:57:00.514357 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.514277    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e7b90bb5-05ef-4ae5-af93-553c55d28775-hub\") pod \"cluster-proxy-proxy-agent-66c9ddcf4c-zjjkf\" (UID: \"e7b90bb5-05ef-4ae5-af93-553c55d28775\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66c9ddcf4c-zjjkf"
Jul 13 02:57:00.514357 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.514302    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmknl\" (UniqueName: \"kubernetes.io/projected/b32f1a22-542e-47d1-9c40-9de1fb178864-kube-api-access-nmknl\") pod \"dns-default-5tx4z\" (UID: \"b32f1a22-542e-47d1-9c40-9de1fb178864\") " pod="openshift-dns/dns-default-5tx4z"
Jul 13 02:57:00.525722 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.525704    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j7pcm"
Jul 13 02:57:00.525803 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.525733    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p44kl"
Jul 13 02:57:00.525921 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.525908    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-24d7h"
Jul 13 02:57:00.529453 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.529422    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 13 02:57:00.529453 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.529428    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 13 02:57:00.529586 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.529455    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 13 02:57:00.529708 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.529688    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 13 02:57:00.529834 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.529820    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8nlv8\""
Jul 13 02:57:00.529904 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.529850    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nv65t\""
Jul 13 02:57:00.615135 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.615107    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/917248b5-3953-4ace-831e-99a59df139c1-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-4pspv\" (UID: \"917248b5-3953-4ace-831e-99a59df139c1\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4pspv"
Jul 13 02:57:00.615236 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.615147    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/917248b5-3953-4ace-831e-99a59df139c1-nginx-conf\") pod \"networking-console-plugin-6cf856758c-4pspv\" (UID: \"917248b5-3953-4ace-831e-99a59df139c1\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4pspv"
Jul 13 02:57:00.615236 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.615174    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b32f1a22-542e-47d1-9c40-9de1fb178864-config-volume\") pod \"dns-default-5tx4z\" (UID: \"b32f1a22-542e-47d1-9c40-9de1fb178864\") " pod="openshift-dns/dns-default-5tx4z"
Jul 13 02:57:00.615236 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:57:00.615204    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 13 02:57:00.615429 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.615207    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b32f1a22-542e-47d1-9c40-9de1fb178864-metrics-tls\") pod \"dns-default-5tx4z\" (UID: \"b32f1a22-542e-47d1-9c40-9de1fb178864\") " pod="openshift-dns/dns-default-5tx4z"
Jul 13 02:57:00.615429 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:57:00.615261    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/917248b5-3953-4ace-831e-99a59df139c1-networking-console-plugin-cert podName:917248b5-3953-4ace-831e-99a59df139c1 nodeName:}" failed. No retries permitted until 2026-07-13 02:57:01.115240287 +0000 UTC m=+37.098030374 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/917248b5-3953-4ace-831e-99a59df139c1-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-4pspv" (UID: "917248b5-3953-4ace-831e-99a59df139c1") : secret "networking-console-plugin-cert" not found
Jul 13 02:57:00.615429 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:57:00.615280    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 02:57:00.615429 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.615286    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b32f1a22-542e-47d1-9c40-9de1fb178864-tmp-dir\") pod \"dns-default-5tx4z\" (UID: \"b32f1a22-542e-47d1-9c40-9de1fb178864\") " pod="openshift-dns/dns-default-5tx4z"
Jul 13 02:57:00.615429 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:57:00.615325    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b32f1a22-542e-47d1-9c40-9de1fb178864-metrics-tls podName:b32f1a22-542e-47d1-9c40-9de1fb178864 nodeName:}" failed. No retries permitted until 2026-07-13 02:57:01.115309412 +0000 UTC m=+37.098099500 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b32f1a22-542e-47d1-9c40-9de1fb178864-metrics-tls") pod "dns-default-5tx4z" (UID: "b32f1a22-542e-47d1-9c40-9de1fb178864") : secret "dns-default-metrics-tls" not found
Jul 13 02:57:00.615429 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.615343    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8a77feae-62c9-449c-a6ee-c896d674943d-image-registry-private-configuration\") pod \"image-registry-654597fc58-2jqwg\" (UID: \"8a77feae-62c9-449c-a6ee-c896d674943d\") " pod="openshift-image-registry/image-registry-654597fc58-2jqwg"
Jul 13 02:57:00.615429 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.615372    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8a77feae-62c9-449c-a6ee-c896d674943d-bound-sa-token\") pod \"image-registry-654597fc58-2jqwg\" (UID: \"8a77feae-62c9-449c-a6ee-c896d674943d\") " pod="openshift-image-registry/image-registry-654597fc58-2jqwg"
Jul 13 02:57:00.615429 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.615401    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmknl\" (UniqueName: \"kubernetes.io/projected/b32f1a22-542e-47d1-9c40-9de1fb178864-kube-api-access-nmknl\") pod \"dns-default-5tx4z\" (UID: \"b32f1a22-542e-47d1-9c40-9de1fb178864\") " pod="openshift-dns/dns-default-5tx4z"
Jul 13 02:57:00.615429 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.615426    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dcjj\" (UniqueName: \"kubernetes.io/projected/1b37dc03-7412-4c20-b134-7e6865ef104c-kube-api-access-7dcjj\") pod \"managed-serviceaccount-addon-agent-5f7ddc8b98-6mtmk\" (UID: \"1b37dc03-7412-4c20-b134-7e6865ef104c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f7ddc8b98-6mtmk"
Jul 13 02:57:00.615878 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.615450    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/3c83f9f2-ef52-44de-888a-6273032827fe-klusterlet-config\") pod \"klusterlet-addon-workmgr-9c856c9c8-pdqzk\" (UID: \"3c83f9f2-ef52-44de-888a-6273032827fe\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c856c9c8-pdqzk"
Jul 13 02:57:00.615878 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.615478    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skghx\" (UniqueName: \"kubernetes.io/projected/8a77feae-62c9-449c-a6ee-c896d674943d-kube-api-access-skghx\") pod \"image-registry-654597fc58-2jqwg\" (UID: \"8a77feae-62c9-449c-a6ee-c896d674943d\") " pod="openshift-image-registry/image-registry-654597fc58-2jqwg"
Jul 13 02:57:00.615878 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.615504    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24b52\" (UniqueName: \"kubernetes.io/projected/3c83f9f2-ef52-44de-888a-6273032827fe-kube-api-access-24b52\") pod \"klusterlet-addon-workmgr-9c856c9c8-pdqzk\" (UID: \"3c83f9f2-ef52-44de-888a-6273032827fe\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c856c9c8-pdqzk"
Jul 13 02:57:00.615878 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.615556    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b32f1a22-542e-47d1-9c40-9de1fb178864-tmp-dir\") pod \"dns-default-5tx4z\" (UID: \"b32f1a22-542e-47d1-9c40-9de1fb178864\") " pod="openshift-dns/dns-default-5tx4z"
Jul 13 02:57:00.615878 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.615815    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b32f1a22-542e-47d1-9c40-9de1fb178864-config-volume\") pod \"dns-default-5tx4z\" (UID: \"b32f1a22-542e-47d1-9c40-9de1fb178864\") " pod="openshift-dns/dns-default-5tx4z"
Jul 13 02:57:00.615878 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.615825    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8a77feae-62c9-449c-a6ee-c896d674943d-registry-tls\") pod \"image-registry-654597fc58-2jqwg\" (UID: \"8a77feae-62c9-449c-a6ee-c896d674943d\") " pod="openshift-image-registry/image-registry-654597fc58-2jqwg"
Jul 13 02:57:00.615878 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.615856    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/917248b5-3953-4ace-831e-99a59df139c1-nginx-conf\") pod \"networking-console-plugin-6cf856758c-4pspv\" (UID: \"917248b5-3953-4ace-831e-99a59df139c1\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4pspv"
Jul 13 02:57:00.616221 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.615885    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8a77feae-62c9-449c-a6ee-c896d674943d-registry-certificates\") pod \"image-registry-654597fc58-2jqwg\" (UID: \"8a77feae-62c9-449c-a6ee-c896d674943d\") " pod="openshift-image-registry/image-registry-654597fc58-2jqwg"
Jul 13 02:57:00.616221 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:57:00.615904    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 02:57:00.616221 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:57:00.615917    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-654597fc58-2jqwg: secret "image-registry-tls" not found
Jul 13 02:57:00.616221 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.615920    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e7b90bb5-05ef-4ae5-af93-553c55d28775-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-66c9ddcf4c-zjjkf\" (UID: \"e7b90bb5-05ef-4ae5-af93-553c55d28775\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66c9ddcf4c-zjjkf"
Jul 13 02:57:00.616221 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:57:00.615979    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8a77feae-62c9-449c-a6ee-c896d674943d-registry-tls podName:8a77feae-62c9-449c-a6ee-c896d674943d nodeName:}" failed. No retries permitted until 2026-07-13 02:57:01.115966436 +0000 UTC m=+37.098756522 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8a77feae-62c9-449c-a6ee-c896d674943d-registry-tls") pod "image-registry-654597fc58-2jqwg" (UID: "8a77feae-62c9-449c-a6ee-c896d674943d") : secret "image-registry-tls" not found
Jul 13 02:57:00.616221 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.616195    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e7b90bb5-05ef-4ae5-af93-553c55d28775-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-66c9ddcf4c-zjjkf\" (UID: \"e7b90bb5-05ef-4ae5-af93-553c55d28775\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66c9ddcf4c-zjjkf"
Jul 13 02:57:00.616519 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.616225    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8a77feae-62c9-449c-a6ee-c896d674943d-trusted-ca\") pod \"image-registry-654597fc58-2jqwg\" (UID: \"8a77feae-62c9-449c-a6ee-c896d674943d\") " pod="openshift-image-registry/image-registry-654597fc58-2jqwg"
Jul 13 02:57:00.616519 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.616261    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8a77feae-62c9-449c-a6ee-c896d674943d-installation-pull-secrets\") pod \"image-registry-654597fc58-2jqwg\" (UID: \"8a77feae-62c9-449c-a6ee-c896d674943d\") " pod="openshift-image-registry/image-registry-654597fc58-2jqwg"
Jul 13 02:57:00.616519 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.616286    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e7b90bb5-05ef-4ae5-af93-553c55d28775-hub\") pod \"cluster-proxy-proxy-agent-66c9ddcf4c-zjjkf\" (UID: \"e7b90bb5-05ef-4ae5-af93-553c55d28775\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66c9ddcf4c-zjjkf"
Jul 13 02:57:00.616519 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.616314    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8a77feae-62c9-449c-a6ee-c896d674943d-ca-trust-extracted\") pod \"image-registry-654597fc58-2jqwg\" (UID: \"8a77feae-62c9-449c-a6ee-c896d674943d\") " pod="openshift-image-registry/image-registry-654597fc58-2jqwg"
Jul 13 02:57:00.616519 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.616345    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwfr8\" (UniqueName: \"kubernetes.io/projected/e7b90bb5-05ef-4ae5-af93-553c55d28775-kube-api-access-mwfr8\") pod \"cluster-proxy-proxy-agent-66c9ddcf4c-zjjkf\" (UID: \"e7b90bb5-05ef-4ae5-af93-553c55d28775\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66c9ddcf4c-zjjkf"
Jul 13 02:57:00.616519 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.616377    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3965be9b-fcc2-48b2-b5b0-d75dd94206a4-cert\") pod \"ingress-canary-sgg7j\" (UID: \"3965be9b-fcc2-48b2-b5b0-d75dd94206a4\") " pod="openshift-ingress-canary/ingress-canary-sgg7j"
Jul 13 02:57:00.616519 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.616411    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhgpr\" (UniqueName: \"kubernetes.io/projected/3965be9b-fcc2-48b2-b5b0-d75dd94206a4-kube-api-access-hhgpr\") pod \"ingress-canary-sgg7j\" (UID: \"3965be9b-fcc2-48b2-b5b0-d75dd94206a4\") " pod="openshift-ingress-canary/ingress-canary-sgg7j"
Jul 13 02:57:00.616519 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.616451    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7b90bb5-05ef-4ae5-af93-553c55d28775-additional-service-ca\") pod \"cluster-proxy-proxy-agent-66c9ddcf4c-zjjkf\" (UID: \"e7b90bb5-05ef-4ae5-af93-553c55d28775\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66c9ddcf4c-zjjkf"
Jul 13 02:57:00.616519 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.616499    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1b37dc03-7412-4c20-b134-7e6865ef104c-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5f7ddc8b98-6mtmk\" (UID: \"1b37dc03-7412-4c20-b134-7e6865ef104c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f7ddc8b98-6mtmk"
Jul 13 02:57:00.616867 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.616524    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e7b90bb5-05ef-4ae5-af93-553c55d28775-ca\") pod \"cluster-proxy-proxy-agent-66c9ddcf4c-zjjkf\" (UID: \"e7b90bb5-05ef-4ae5-af93-553c55d28775\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66c9ddcf4c-zjjkf"
Jul 13 02:57:00.616867 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.616575    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3c83f9f2-ef52-44de-888a-6273032827fe-tmp\") pod \"klusterlet-addon-workmgr-9c856c9c8-pdqzk\" (UID: \"3c83f9f2-ef52-44de-888a-6273032827fe\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c856c9c8-pdqzk"
Jul 13 02:57:00.617248 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.617049    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3c83f9f2-ef52-44de-888a-6273032827fe-tmp\") pod \"klusterlet-addon-workmgr-9c856c9c8-pdqzk\" (UID: \"3c83f9f2-ef52-44de-888a-6273032827fe\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c856c9c8-pdqzk"
Jul 13 02:57:00.617248 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.616453    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8a77feae-62c9-449c-a6ee-c896d674943d-registry-certificates\") pod \"image-registry-654597fc58-2jqwg\" (UID: \"8a77feae-62c9-449c-a6ee-c896d674943d\") " pod="openshift-image-registry/image-registry-654597fc58-2jqwg"
Jul 13 02:57:00.617377 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.617304    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8a77feae-62c9-449c-a6ee-c896d674943d-trusted-ca\") pod \"image-registry-654597fc58-2jqwg\" (UID: \"8a77feae-62c9-449c-a6ee-c896d674943d\") " pod="openshift-image-registry/image-registry-654597fc58-2jqwg"
Jul 13 02:57:00.617682 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.617505    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8a77feae-62c9-449c-a6ee-c896d674943d-ca-trust-extracted\") pod \"image-registry-654597fc58-2jqwg\" (UID: \"8a77feae-62c9-449c-a6ee-c896d674943d\") " pod="openshift-image-registry/image-registry-654597fc58-2jqwg"
Jul 13 02:57:00.618411 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.618385    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7b90bb5-05ef-4ae5-af93-553c55d28775-additional-service-ca\") pod \"cluster-proxy-proxy-agent-66c9ddcf4c-zjjkf\" (UID: \"e7b90bb5-05ef-4ae5-af93-553c55d28775\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66c9ddcf4c-zjjkf"
Jul 13 02:57:00.619172 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.619138    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 02:57:00.620630 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.620599    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8a77feae-62c9-449c-a6ee-c896d674943d-image-registry-private-configuration\") pod \"image-registry-654597fc58-2jqwg\" (UID: \"8a77feae-62c9-449c-a6ee-c896d674943d\") " pod="openshift-image-registry/image-registry-654597fc58-2jqwg"
Jul 13 02:57:00.620734 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.620672    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e7b90bb5-05ef-4ae5-af93-553c55d28775-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-66c9ddcf4c-zjjkf\" (UID: \"e7b90bb5-05ef-4ae5-af93-553c55d28775\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66c9ddcf4c-zjjkf"
Jul 13 02:57:00.620734 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.620726    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/3c83f9f2-ef52-44de-888a-6273032827fe-klusterlet-config\") pod \"klusterlet-addon-workmgr-9c856c9c8-pdqzk\" (UID: \"3c83f9f2-ef52-44de-888a-6273032827fe\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c856c9c8-pdqzk"
Jul 13 02:57:00.621079 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.621057    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e7b90bb5-05ef-4ae5-af93-553c55d28775-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-66c9ddcf4c-zjjkf\" (UID: \"e7b90bb5-05ef-4ae5-af93-553c55d28775\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66c9ddcf4c-zjjkf"
Jul 13 02:57:00.621168 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.621064    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1b37dc03-7412-4c20-b134-7e6865ef104c-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5f7ddc8b98-6mtmk\" (UID: \"1b37dc03-7412-4c20-b134-7e6865ef104c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f7ddc8b98-6mtmk"
Jul 13 02:57:00.621222 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.621178    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e7b90bb5-05ef-4ae5-af93-553c55d28775-hub\") pod \"cluster-proxy-proxy-agent-66c9ddcf4c-zjjkf\" (UID: \"e7b90bb5-05ef-4ae5-af93-553c55d28775\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66c9ddcf4c-zjjkf"
Jul 13 02:57:00.621698 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.621681    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8a77feae-62c9-449c-a6ee-c896d674943d-installation-pull-secrets\") pod \"image-registry-654597fc58-2jqwg\" (UID: \"8a77feae-62c9-449c-a6ee-c896d674943d\") " pod="openshift-image-registry/image-registry-654597fc58-2jqwg"
Jul 13 02:57:00.628820 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.628797    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e7b90bb5-05ef-4ae5-af93-553c55d28775-ca\") pod \"cluster-proxy-proxy-agent-66c9ddcf4c-zjjkf\" (UID: \"e7b90bb5-05ef-4ae5-af93-553c55d28775\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66c9ddcf4c-zjjkf"
Jul 13 02:57:00.632682 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.632639    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8a77feae-62c9-449c-a6ee-c896d674943d-bound-sa-token\") pod \"image-registry-654597fc58-2jqwg\" (UID: \"8a77feae-62c9-449c-a6ee-c896d674943d\") " pod="openshift-image-registry/image-registry-654597fc58-2jqwg"
Jul 13 02:57:00.632902 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.632879    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-skghx\" (UniqueName: \"kubernetes.io/projected/8a77feae-62c9-449c-a6ee-c896d674943d-kube-api-access-skghx\") pod \"image-registry-654597fc58-2jqwg\" (UID: \"8a77feae-62c9-449c-a6ee-c896d674943d\") " pod="openshift-image-registry/image-registry-654597fc58-2jqwg"
Jul 13 02:57:00.633033 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.632957    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dcjj\" (UniqueName: \"kubernetes.io/projected/1b37dc03-7412-4c20-b134-7e6865ef104c-kube-api-access-7dcjj\") pod \"managed-serviceaccount-addon-agent-5f7ddc8b98-6mtmk\" (UID: \"1b37dc03-7412-4c20-b134-7e6865ef104c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f7ddc8b98-6mtmk"
Jul 13 02:57:00.633087 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.633035    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmknl\" (UniqueName: \"kubernetes.io/projected/b32f1a22-542e-47d1-9c40-9de1fb178864-kube-api-access-nmknl\") pod \"dns-default-5tx4z\" (UID: \"b32f1a22-542e-47d1-9c40-9de1fb178864\") " pod="openshift-dns/dns-default-5tx4z"
Jul 13 02:57:00.642793 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.642776    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-24b52\" (UniqueName: \"kubernetes.io/projected/3c83f9f2-ef52-44de-888a-6273032827fe-kube-api-access-24b52\") pod \"klusterlet-addon-workmgr-9c856c9c8-pdqzk\" (UID: \"3c83f9f2-ef52-44de-888a-6273032827fe\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c856c9c8-pdqzk"
Jul 13 02:57:00.650157 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.650139    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwfr8\" (UniqueName: \"kubernetes.io/projected/e7b90bb5-05ef-4ae5-af93-553c55d28775-kube-api-access-mwfr8\") pod \"cluster-proxy-proxy-agent-66c9ddcf4c-zjjkf\" (UID: \"e7b90bb5-05ef-4ae5-af93-553c55d28775\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66c9ddcf4c-zjjkf"
Jul 13 02:57:00.699651 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.699578    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c856c9c8-pdqzk"
Jul 13 02:57:00.717479 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.717462    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3965be9b-fcc2-48b2-b5b0-d75dd94206a4-cert\") pod \"ingress-canary-sgg7j\" (UID: \"3965be9b-fcc2-48b2-b5b0-d75dd94206a4\") " pod="openshift-ingress-canary/ingress-canary-sgg7j"
Jul 13 02:57:00.717550 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.717486    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhgpr\" (UniqueName: \"kubernetes.io/projected/3965be9b-fcc2-48b2-b5b0-d75dd94206a4-kube-api-access-hhgpr\") pod \"ingress-canary-sgg7j\" (UID: \"3965be9b-fcc2-48b2-b5b0-d75dd94206a4\") " pod="openshift-ingress-canary/ingress-canary-sgg7j"
Jul 13 02:57:00.719907 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.719884    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3965be9b-fcc2-48b2-b5b0-d75dd94206a4-cert\") pod \"ingress-canary-sgg7j\" (UID: \"3965be9b-fcc2-48b2-b5b0-d75dd94206a4\") " pod="openshift-ingress-canary/ingress-canary-sgg7j"
Jul 13 02:57:00.728816 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.728800    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhgpr\" (UniqueName: \"kubernetes.io/projected/3965be9b-fcc2-48b2-b5b0-d75dd94206a4-kube-api-access-hhgpr\") pod \"ingress-canary-sgg7j\" (UID: \"3965be9b-fcc2-48b2-b5b0-d75dd94206a4\") " pod="openshift-ingress-canary/ingress-canary-sgg7j"
Jul 13 02:57:00.729574 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.729550    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f7ddc8b98-6mtmk"
Jul 13 02:57:00.739512 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.739475    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66c9ddcf4c-zjjkf"
Jul 13 02:57:00.758113 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.758086    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-sgg7j"
Jul 13 02:57:00.848470 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.848259    2563 generic.go:356] "Generic (PLEG): container finished" podID="89566977-a84a-41c6-815a-dbb71c0752c6" containerID="c20d943c4c8c5b15b09444ec0c2d68b339769e120442ef804a834cb162a8edd3" exitCode=0
Jul 13 02:57:00.848470 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.848342    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f94rg" event={"ID":"89566977-a84a-41c6-815a-dbb71c0752c6","Type":"ContainerDied","Data":"c20d943c4c8c5b15b09444ec0c2d68b339769e120442ef804a834cb162a8edd3"}
Jul 13 02:57:00.920855 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.920748    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c856c9c8-pdqzk"]
Jul 13 02:57:00.922755 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:57:00.922725    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c83f9f2_ef52_44de_888a_6273032827fe.slice/crio-89234044c57b8959750ba07efa8596446fe02c7ae11a745e880c0724a7e6089b WatchSource:0}: Error finding container 89234044c57b8959750ba07efa8596446fe02c7ae11a745e880c0724a7e6089b: Status 404 returned error can't find the container with id 89234044c57b8959750ba07efa8596446fe02c7ae11a745e880c0724a7e6089b
Jul 13 02:57:00.926120 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.926079    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f7ddc8b98-6mtmk"]
Jul 13 02:57:00.930089 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:57:00.930062    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1b37dc03_7412_4c20_b134_7e6865ef104c.slice/crio-1150c42613244f930daf16e60279fdd4e1ba430ea5f832eef1b4891ce7e7d5d7 WatchSource:0}: Error finding container 1150c42613244f930daf16e60279fdd4e1ba430ea5f832eef1b4891ce7e7d5d7: Status 404 returned error can't find the container with id 1150c42613244f930daf16e60279fdd4e1ba430ea5f832eef1b4891ce7e7d5d7
Jul 13 02:57:00.948016 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.947997    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66c9ddcf4c-zjjkf"]
Jul 13 02:57:00.950690 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:57:00.950643    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode7b90bb5_05ef_4ae5_af93_553c55d28775.slice/crio-96f4f63f0b5295344f7c65b16cd2238220af4dc61be5598b27ba9c6517d8f4a5 WatchSource:0}: Error finding container 96f4f63f0b5295344f7c65b16cd2238220af4dc61be5598b27ba9c6517d8f4a5: Status 404 returned error can't find the container with id 96f4f63f0b5295344f7c65b16cd2238220af4dc61be5598b27ba9c6517d8f4a5
Jul 13 02:57:00.952906 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:00.952484    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-sgg7j"]
Jul 13 02:57:00.955353 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:57:00.955330    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3965be9b_fcc2_48b2_b5b0_d75dd94206a4.slice/crio-61d96d5d342647cfdeaecdb1ab414706a69a2c964332bb59e75a5d3113e174d7 WatchSource:0}: Error finding container 61d96d5d342647cfdeaecdb1ab414706a69a2c964332bb59e75a5d3113e174d7: Status 404 returned error can't find the container with id 61d96d5d342647cfdeaecdb1ab414706a69a2c964332bb59e75a5d3113e174d7
Jul 13 02:57:01.121122 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:01.121093    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/917248b5-3953-4ace-831e-99a59df139c1-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-4pspv\" (UID: \"917248b5-3953-4ace-831e-99a59df139c1\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4pspv"
Jul 13 02:57:01.121227 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:01.121128    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b32f1a22-542e-47d1-9c40-9de1fb178864-metrics-tls\") pod \"dns-default-5tx4z\" (UID: \"b32f1a22-542e-47d1-9c40-9de1fb178864\") " pod="openshift-dns/dns-default-5tx4z"
Jul 13 02:57:01.121270 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:57:01.121228    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 02:57:01.121270 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:57:01.121231    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 13 02:57:01.121270 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:01.121262    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8a77feae-62c9-449c-a6ee-c896d674943d-registry-tls\") pod \"image-registry-654597fc58-2jqwg\" (UID: \"8a77feae-62c9-449c-a6ee-c896d674943d\") " pod="openshift-image-registry/image-registry-654597fc58-2jqwg"
Jul 13 02:57:01.121401 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:57:01.121273    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b32f1a22-542e-47d1-9c40-9de1fb178864-metrics-tls podName:b32f1a22-542e-47d1-9c40-9de1fb178864 nodeName:}" failed. No retries permitted until 2026-07-13 02:57:02.121260813 +0000 UTC m=+38.104050900 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b32f1a22-542e-47d1-9c40-9de1fb178864-metrics-tls") pod "dns-default-5tx4z" (UID: "b32f1a22-542e-47d1-9c40-9de1fb178864") : secret "dns-default-metrics-tls" not found
Jul 13 02:57:01.121401 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:57:01.121338    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 02:57:01.121401 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:57:01.121347    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-654597fc58-2jqwg: secret "image-registry-tls" not found
Jul 13 02:57:01.121401 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:57:01.121346    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/917248b5-3953-4ace-831e-99a59df139c1-networking-console-plugin-cert podName:917248b5-3953-4ace-831e-99a59df139c1 nodeName:}" failed. No retries permitted until 2026-07-13 02:57:02.12132183 +0000 UTC m=+38.104111933 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/917248b5-3953-4ace-831e-99a59df139c1-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-4pspv" (UID: "917248b5-3953-4ace-831e-99a59df139c1") : secret "networking-console-plugin-cert" not found
Jul 13 02:57:01.121401 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:57:01.121382    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8a77feae-62c9-449c-a6ee-c896d674943d-registry-tls podName:8a77feae-62c9-449c-a6ee-c896d674943d nodeName:}" failed. No retries permitted until 2026-07-13 02:57:02.121371056 +0000 UTC m=+38.104161143 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8a77feae-62c9-449c-a6ee-c896d674943d-registry-tls") pod "image-registry-654597fc58-2jqwg" (UID: "8a77feae-62c9-449c-a6ee-c896d674943d") : secret "image-registry-tls" not found
Jul 13 02:57:01.126950 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:01.126904    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 02:57:01.228004 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:01.227884    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 02:57:01.545541 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:01.545506    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 02:57:01.649707 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:01.649666    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 02:57:01.858860 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:01.858747    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f7ddc8b98-6mtmk" event={"ID":"1b37dc03-7412-4c20-b134-7e6865ef104c","Type":"ContainerStarted","Data":"1150c42613244f930daf16e60279fdd4e1ba430ea5f832eef1b4891ce7e7d5d7"}
Jul 13 02:57:01.862387 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:01.862179    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-sgg7j" event={"ID":"3965be9b-fcc2-48b2-b5b0-d75dd94206a4","Type":"ContainerStarted","Data":"61d96d5d342647cfdeaecdb1ab414706a69a2c964332bb59e75a5d3113e174d7"}
Jul 13 02:57:01.866975 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:01.866873    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66c9ddcf4c-zjjkf" event={"ID":"e7b90bb5-05ef-4ae5-af93-553c55d28775","Type":"ContainerStarted","Data":"96f4f63f0b5295344f7c65b16cd2238220af4dc61be5598b27ba9c6517d8f4a5"}
Jul 13 02:57:01.872448 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:01.872367    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c856c9c8-pdqzk" event={"ID":"3c83f9f2-ef52-44de-888a-6273032827fe","Type":"ContainerStarted","Data":"89234044c57b8959750ba07efa8596446fe02c7ae11a745e880c0724a7e6089b"}
Jul 13 02:57:01.882717 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:01.881914    2563 generic.go:356] "Generic (PLEG): container finished" podID="89566977-a84a-41c6-815a-dbb71c0752c6" containerID="480be7eb45129a8b278ce92303b7c48375dcd932879e2033db67f8205819c961" exitCode=0
Jul 13 02:57:01.882717 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:01.882055    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f94rg" event={"ID":"89566977-a84a-41c6-815a-dbb71c0752c6","Type":"ContainerDied","Data":"480be7eb45129a8b278ce92303b7c48375dcd932879e2033db67f8205819c961"}
Jul 13 02:57:02.131415 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:02.130290    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/917248b5-3953-4ace-831e-99a59df139c1-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-4pspv\" (UID: \"917248b5-3953-4ace-831e-99a59df139c1\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4pspv"
Jul 13 02:57:02.131415 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:02.130538    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b32f1a22-542e-47d1-9c40-9de1fb178864-metrics-tls\") pod \"dns-default-5tx4z\" (UID: \"b32f1a22-542e-47d1-9c40-9de1fb178864\") " pod="openshift-dns/dns-default-5tx4z"
Jul 13 02:57:02.131415 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:02.130598    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8a77feae-62c9-449c-a6ee-c896d674943d-registry-tls\") pod \"image-registry-654597fc58-2jqwg\" (UID: \"8a77feae-62c9-449c-a6ee-c896d674943d\") " pod="openshift-image-registry/image-registry-654597fc58-2jqwg"
Jul 13 02:57:02.131415 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:57:02.130739    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 02:57:02.131415 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:57:02.130755    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-654597fc58-2jqwg: secret "image-registry-tls" not found
Jul 13 02:57:02.131415 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:57:02.130810    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8a77feae-62c9-449c-a6ee-c896d674943d-registry-tls podName:8a77feae-62c9-449c-a6ee-c896d674943d nodeName:}" failed. No retries permitted until 2026-07-13 02:57:04.130792006 +0000 UTC m=+40.113582117 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8a77feae-62c9-449c-a6ee-c896d674943d-registry-tls") pod "image-registry-654597fc58-2jqwg" (UID: "8a77feae-62c9-449c-a6ee-c896d674943d") : secret "image-registry-tls" not found
Jul 13 02:57:02.131415 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:57:02.131248    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 13 02:57:02.131415 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:57:02.131299    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/917248b5-3953-4ace-831e-99a59df139c1-networking-console-plugin-cert podName:917248b5-3953-4ace-831e-99a59df139c1 nodeName:}" failed. No retries permitted until 2026-07-13 02:57:04.131283592 +0000 UTC m=+40.114073682 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/917248b5-3953-4ace-831e-99a59df139c1-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-4pspv" (UID: "917248b5-3953-4ace-831e-99a59df139c1") : secret "networking-console-plugin-cert" not found
Jul 13 02:57:02.131415 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:57:02.131357    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 02:57:02.131415 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:57:02.131388    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b32f1a22-542e-47d1-9c40-9de1fb178864-metrics-tls podName:b32f1a22-542e-47d1-9c40-9de1fb178864 nodeName:}" failed. No retries permitted until 2026-07-13 02:57:04.131376916 +0000 UTC m=+40.114167016 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b32f1a22-542e-47d1-9c40-9de1fb178864-metrics-tls") pod "dns-default-5tx4z" (UID: "b32f1a22-542e-47d1-9c40-9de1fb178864") : secret "dns-default-metrics-tls" not found
Jul 13 02:57:02.892598 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:02.891799    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f94rg" event={"ID":"89566977-a84a-41c6-815a-dbb71c0752c6","Type":"ContainerStarted","Data":"13d1c9a75a07b03ed585ef3b784e54a3756872b15739b1a0a4348dae87cf299f"}
Jul 13 02:57:02.916270 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:02.915694    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-f94rg" podStartSLOduration=8.41338289 podStartE2EDuration="37.915675774s" totalImagesPullingTime="29.502292884s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 02:56:25 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 02:57:02.914247582 +0000 UTC m=+38.897037692" watchObservedRunningTime="2026-07-13 02:57:02.915675774 +0000 UTC m=+38.898465884"
Jul 13 02:57:03.036414 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:03.036358    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 02:57:03.136575 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:03.136355    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 02:57:03.282181 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:03.282108    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 02:57:03.340366 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:03.340314    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 02:57:04.149342 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:04.149299    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/917248b5-3953-4ace-831e-99a59df139c1-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-4pspv\" (UID: \"917248b5-3953-4ace-831e-99a59df139c1\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4pspv"
Jul 13 02:57:04.150088 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:04.149354    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b32f1a22-542e-47d1-9c40-9de1fb178864-metrics-tls\") pod \"dns-default-5tx4z\" (UID: \"b32f1a22-542e-47d1-9c40-9de1fb178864\") " pod="openshift-dns/dns-default-5tx4z"
Jul 13 02:57:04.150088 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:04.149411    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8a77feae-62c9-449c-a6ee-c896d674943d-registry-tls\") pod \"image-registry-654597fc58-2jqwg\" (UID: \"8a77feae-62c9-449c-a6ee-c896d674943d\") " pod="openshift-image-registry/image-registry-654597fc58-2jqwg"
Jul 13 02:57:04.150088 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:57:04.149459    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 13 02:57:04.150088 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:57:04.149537    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/917248b5-3953-4ace-831e-99a59df139c1-networking-console-plugin-cert podName:917248b5-3953-4ace-831e-99a59df139c1 nodeName:}" failed. No retries permitted until 2026-07-13 02:57:08.149515194 +0000 UTC m=+44.132305299 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/917248b5-3953-4ace-831e-99a59df139c1-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-4pspv" (UID: "917248b5-3953-4ace-831e-99a59df139c1") : secret "networking-console-plugin-cert" not found
Jul 13 02:57:04.150088 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:57:04.149560    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 02:57:04.150088 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:57:04.149579    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-654597fc58-2jqwg: secret "image-registry-tls" not found
Jul 13 02:57:04.150088 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:57:04.149612    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8a77feae-62c9-449c-a6ee-c896d674943d-registry-tls podName:8a77feae-62c9-449c-a6ee-c896d674943d nodeName:}" failed. No retries permitted until 2026-07-13 02:57:08.149600721 +0000 UTC m=+44.132390831 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8a77feae-62c9-449c-a6ee-c896d674943d-registry-tls") pod "image-registry-654597fc58-2jqwg" (UID: "8a77feae-62c9-449c-a6ee-c896d674943d") : secret "image-registry-tls" not found
Jul 13 02:57:04.150088 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:57:04.149671    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 02:57:04.150088 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:57:04.149698    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b32f1a22-542e-47d1-9c40-9de1fb178864-metrics-tls podName:b32f1a22-542e-47d1-9c40-9de1fb178864 nodeName:}" failed. No retries permitted until 2026-07-13 02:57:08.149689366 +0000 UTC m=+44.132479471 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b32f1a22-542e-47d1-9c40-9de1fb178864-metrics-tls") pod "dns-default-5tx4z" (UID: "b32f1a22-542e-47d1-9c40-9de1fb178864") : secret "dns-default-metrics-tls" not found
Jul 13 02:57:06.320457 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:06.320420    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 02:57:06.385527 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:06.385419    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 02:57:08.183443 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:08.183414    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8a77feae-62c9-449c-a6ee-c896d674943d-registry-tls\") pod \"image-registry-654597fc58-2jqwg\" (UID: \"8a77feae-62c9-449c-a6ee-c896d674943d\") " pod="openshift-image-registry/image-registry-654597fc58-2jqwg"
Jul 13 02:57:08.183878 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:08.183489    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/917248b5-3953-4ace-831e-99a59df139c1-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-4pspv\" (UID: \"917248b5-3953-4ace-831e-99a59df139c1\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4pspv"
Jul 13 02:57:08.183878 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:08.183512    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b32f1a22-542e-47d1-9c40-9de1fb178864-metrics-tls\") pod \"dns-default-5tx4z\" (UID: \"b32f1a22-542e-47d1-9c40-9de1fb178864\") " pod="openshift-dns/dns-default-5tx4z"
Jul 13 02:57:08.183878 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:57:08.183580    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 02:57:08.183878 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:57:08.183600    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-654597fc58-2jqwg: secret "image-registry-tls" not found
Jul 13 02:57:08.183878 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:57:08.183618    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 02:57:08.183878 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:57:08.183619    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 13 02:57:08.183878 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:57:08.183671    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8a77feae-62c9-449c-a6ee-c896d674943d-registry-tls podName:8a77feae-62c9-449c-a6ee-c896d674943d nodeName:}" failed. No retries permitted until 2026-07-13 02:57:16.183650772 +0000 UTC m=+52.166440873 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8a77feae-62c9-449c-a6ee-c896d674943d-registry-tls") pod "image-registry-654597fc58-2jqwg" (UID: "8a77feae-62c9-449c-a6ee-c896d674943d") : secret "image-registry-tls" not found
Jul 13 02:57:08.183878 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:57:08.183718    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b32f1a22-542e-47d1-9c40-9de1fb178864-metrics-tls podName:b32f1a22-542e-47d1-9c40-9de1fb178864 nodeName:}" failed. No retries permitted until 2026-07-13 02:57:16.183681305 +0000 UTC m=+52.166471397 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b32f1a22-542e-47d1-9c40-9de1fb178864-metrics-tls") pod "dns-default-5tx4z" (UID: "b32f1a22-542e-47d1-9c40-9de1fb178864") : secret "dns-default-metrics-tls" not found
Jul 13 02:57:08.183878 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:57:08.183736    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/917248b5-3953-4ace-831e-99a59df139c1-networking-console-plugin-cert podName:917248b5-3953-4ace-831e-99a59df139c1 nodeName:}" failed. No retries permitted until 2026-07-13 02:57:16.183726171 +0000 UTC m=+52.166516261 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/917248b5-3953-4ace-831e-99a59df139c1-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-4pspv" (UID: "917248b5-3953-4ace-831e-99a59df139c1") : secret "networking-console-plugin-cert" not found
Jul 13 02:57:08.908752 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:08.908714    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f7ddc8b98-6mtmk" event={"ID":"1b37dc03-7412-4c20-b134-7e6865ef104c","Type":"ContainerStarted","Data":"541cd76b755588216f48e90e92c2ee28d30794b280fde0fcf11b5fbaaacbc592"}
Jul 13 02:57:08.910294 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:08.910265    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-sgg7j" event={"ID":"3965be9b-fcc2-48b2-b5b0-d75dd94206a4","Type":"ContainerStarted","Data":"d87f46db79fe531ea9aa9adc191a436b15c12e2d6f6f784a44751660e4040e2a"}
Jul 13 02:57:08.911988 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:08.911966    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66c9ddcf4c-zjjkf" event={"ID":"e7b90bb5-05ef-4ae5-af93-553c55d28775","Type":"ContainerStarted","Data":"9dc1c53cc39d358cc6a27a20cb525e8978f86c3e8399406b8fc7daac8b347b33"}
Jul 13 02:57:08.913874 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:08.913847    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c856c9c8-pdqzk" event={"ID":"3c83f9f2-ef52-44de-888a-6273032827fe","Type":"ContainerStarted","Data":"df0c3ba4c6f781039aa4886ad6168b78e48937be851b6074557606d6cffaac3f"}
Jul 13 02:57:08.914023 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:08.914008    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c856c9c8-pdqzk"
Jul 13 02:57:08.915948 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:08.915910    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c856c9c8-pdqzk"
Jul 13 02:57:08.928454 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:08.928400    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f7ddc8b98-6mtmk" podStartSLOduration=18.22321313 podStartE2EDuration="25.928387549s" totalImagesPullingTime="7.705174419s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 02:56:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 02:57:08.928080261 +0000 UTC m=+44.910870373" watchObservedRunningTime="2026-07-13 02:57:08.928387549 +0000 UTC m=+44.911177686"
Jul 13 02:57:08.954281 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:08.954228    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-sgg7j" podStartSLOduration=1.273471467 podStartE2EDuration="8.954212575s" totalImagesPullingTime="7.680741108s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 02:57:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 02:57:08.953507442 +0000 UTC m=+44.936297551" watchObservedRunningTime="2026-07-13 02:57:08.954212575 +0000 UTC m=+44.937002683"
Jul 13 02:57:09.919606 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:09.919557    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66c9ddcf4c-zjjkf" event={"ID":"e7b90bb5-05ef-4ae5-af93-553c55d28775","Type":"ContainerStarted","Data":"b5c7e8be892404a01bde97828b1ca538900818fa517ef145740669846422e6da"}
Jul 13 02:57:09.920063 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:09.919619    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66c9ddcf4c-zjjkf" event={"ID":"e7b90bb5-05ef-4ae5-af93-553c55d28775","Type":"ContainerStarted","Data":"fb91271a71424f13acecfc38e252502aa178fbbd0b88e374f09df21b3ce38d57"}
Jul 13 02:57:09.939253 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:09.939172    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c856c9c8-pdqzk" podStartSLOduration=19.216197734 podStartE2EDuration="26.939152859s" totalImagesPullingTime="7.722955125s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 02:56:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 02:57:08.996497234 +0000 UTC m=+44.979287343" watchObservedRunningTime="2026-07-13 02:57:09.939152859 +0000 UTC m=+45.921942967"
Jul 13 02:57:09.939420 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:09.939324    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66c9ddcf4c-zjjkf" podStartSLOduration=19.254797421 podStartE2EDuration="26.939315335s" totalImagesPullingTime="7.684517914s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 02:56:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 02:57:09.939281599 +0000 UTC m=+45.922071711" watchObservedRunningTime="2026-07-13 02:57:09.939315335 +0000 UTC m=+45.922105445"
Jul 13 02:57:16.244244 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:16.244205    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8a77feae-62c9-449c-a6ee-c896d674943d-registry-tls\") pod \"image-registry-654597fc58-2jqwg\" (UID: \"8a77feae-62c9-449c-a6ee-c896d674943d\") " pod="openshift-image-registry/image-registry-654597fc58-2jqwg"
Jul 13 02:57:16.244622 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:16.244271    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/917248b5-3953-4ace-831e-99a59df139c1-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-4pspv\" (UID: \"917248b5-3953-4ace-831e-99a59df139c1\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4pspv"
Jul 13 02:57:16.244622 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:16.244292    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b32f1a22-542e-47d1-9c40-9de1fb178864-metrics-tls\") pod \"dns-default-5tx4z\" (UID: \"b32f1a22-542e-47d1-9c40-9de1fb178864\") " pod="openshift-dns/dns-default-5tx4z"
Jul 13 02:57:16.244622 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:57:16.244351    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 02:57:16.244622 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:57:16.244371    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-654597fc58-2jqwg: secret "image-registry-tls" not found
Jul 13 02:57:16.244622 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:57:16.244372    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 02:57:16.244622 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:57:16.244401    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 13 02:57:16.244622 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:57:16.244423    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8a77feae-62c9-449c-a6ee-c896d674943d-registry-tls podName:8a77feae-62c9-449c-a6ee-c896d674943d nodeName:}" failed. No retries permitted until 2026-07-13 02:57:32.244409119 +0000 UTC m=+68.227199205 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8a77feae-62c9-449c-a6ee-c896d674943d-registry-tls") pod "image-registry-654597fc58-2jqwg" (UID: "8a77feae-62c9-449c-a6ee-c896d674943d") : secret "image-registry-tls" not found
Jul 13 02:57:16.244622 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:57:16.244443    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/917248b5-3953-4ace-831e-99a59df139c1-networking-console-plugin-cert podName:917248b5-3953-4ace-831e-99a59df139c1 nodeName:}" failed. No retries permitted until 2026-07-13 02:57:32.244430754 +0000 UTC m=+68.227220841 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/917248b5-3953-4ace-831e-99a59df139c1-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-4pspv" (UID: "917248b5-3953-4ace-831e-99a59df139c1") : secret "networking-console-plugin-cert" not found
Jul 13 02:57:16.244622 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:57:16.244457    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b32f1a22-542e-47d1-9c40-9de1fb178864-metrics-tls podName:b32f1a22-542e-47d1-9c40-9de1fb178864 nodeName:}" failed. No retries permitted until 2026-07-13 02:57:32.244450973 +0000 UTC m=+68.227241059 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b32f1a22-542e-47d1-9c40-9de1fb178864-metrics-tls") pod "dns-default-5tx4z" (UID: "b32f1a22-542e-47d1-9c40-9de1fb178864") : secret "dns-default-metrics-tls" not found
Jul 13 02:57:21.482808 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:21.482767    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 02:57:21.584494 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:21.584458    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 02:57:22.463585 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:22.463549    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 02:57:22.563135 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:22.563103    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 02:57:22.845373 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:22.845346    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 02:57:22.908004 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:22.907968    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 02:57:23.011731 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:23.011703    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 02:57:23.109563 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:23.109496    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 02:57:23.923710 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:23.923678    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 02:57:24.023847 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:24.023806    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 02:57:24.085297 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:24.085267    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 02:57:24.889566 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:24.889536    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 02:57:25.767111 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:25.767078    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 02:57:26.811792 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:26.811768    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v2725"
Jul 13 02:57:26.963720 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:26.963688    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 02:57:27.064425 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:27.064327    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 02:57:30.245191 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:30.245156    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd0ac0dd-db5b-41c3-b69d-bcf3af528e20-metrics-certs\") pod \"network-metrics-daemon-p44kl\" (UID: \"cd0ac0dd-db5b-41c3-b69d-bcf3af528e20\") " pod="openshift-multus/network-metrics-daemon-p44kl"
Jul 13 02:57:30.245571 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:30.245210    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6dc5ae9e-d973-46ae-9924-43fc3e1e80f7-original-pull-secret\") pod \"global-pull-secret-syncer-j7pcm\" (UID: \"6dc5ae9e-d973-46ae-9924-43fc3e1e80f7\") " pod="kube-system/global-pull-secret-syncer-j7pcm"
Jul 13 02:57:30.248015 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:30.247998    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 13 02:57:30.248089 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:30.248001    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 13 02:57:30.255672 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:57:30.255650    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 13 02:57:30.255765 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:57:30.255751    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd0ac0dd-db5b-41c3-b69d-bcf3af528e20-metrics-certs podName:cd0ac0dd-db5b-41c3-b69d-bcf3af528e20 nodeName:}" failed. No retries permitted until 2026-07-13 02:58:34.255729182 +0000 UTC m=+130.238519287 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd0ac0dd-db5b-41c3-b69d-bcf3af528e20-metrics-certs") pod "network-metrics-daemon-p44kl" (UID: "cd0ac0dd-db5b-41c3-b69d-bcf3af528e20") : secret "metrics-daemon-secret" not found
Jul 13 02:57:30.258910 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:30.258894    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6dc5ae9e-d973-46ae-9924-43fc3e1e80f7-original-pull-secret\") pod \"global-pull-secret-syncer-j7pcm\" (UID: \"6dc5ae9e-d973-46ae-9924-43fc3e1e80f7\") " pod="kube-system/global-pull-secret-syncer-j7pcm"
Jul 13 02:57:30.447264 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:30.447231    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58sns\" (UniqueName: \"kubernetes.io/projected/71eff5ef-6532-42ba-b932-2911cfaedcac-kube-api-access-58sns\") pod \"network-check-target-24d7h\" (UID: \"71eff5ef-6532-42ba-b932-2911cfaedcac\") " pod="openshift-network-diagnostics/network-check-target-24d7h"
Jul 13 02:57:30.449918 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:30.449896    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 13 02:57:30.460252 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:30.460234    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 13 02:57:30.470613 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:30.470585    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58sns\" (UniqueName: \"kubernetes.io/projected/71eff5ef-6532-42ba-b932-2911cfaedcac-kube-api-access-58sns\") pod \"network-check-target-24d7h\" (UID: \"71eff5ef-6532-42ba-b932-2911cfaedcac\") " pod="openshift-network-diagnostics/network-check-target-24d7h"
Jul 13 02:57:30.535811 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:30.535734    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j7pcm"
Jul 13 02:57:30.551022 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:30.550998    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nv65t\""
Jul 13 02:57:30.556090 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:30.556075    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-24d7h"
Jul 13 02:57:30.707492 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:30.707466    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-j7pcm"]
Jul 13 02:57:30.710725 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:57:30.710700    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dc5ae9e_d973_46ae_9924_43fc3e1e80f7.slice/crio-52093849f593df639d1455915c96339ed4eedf63262977adffc31014a37e1212 WatchSource:0}: Error finding container 52093849f593df639d1455915c96339ed4eedf63262977adffc31014a37e1212: Status 404 returned error can't find the container with id 52093849f593df639d1455915c96339ed4eedf63262977adffc31014a37e1212
Jul 13 02:57:30.729778 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:30.729662    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-24d7h"]
Jul 13 02:57:30.734992 ip-10-0-142-39 kubenswrapper[2563]: W0713 02:57:30.734963    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71eff5ef_6532_42ba_b932_2911cfaedcac.slice/crio-74a15f2f5a768636a42c71a22bfbbd73501324f1effe82e26c4fe61c2928c370 WatchSource:0}: Error finding container 74a15f2f5a768636a42c71a22bfbbd73501324f1effe82e26c4fe61c2928c370: Status 404 returned error can't find the container with id 74a15f2f5a768636a42c71a22bfbbd73501324f1effe82e26c4fe61c2928c370
Jul 13 02:57:30.983245 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:30.983201    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-24d7h" event={"ID":"71eff5ef-6532-42ba-b932-2911cfaedcac","Type":"ContainerStarted","Data":"74a15f2f5a768636a42c71a22bfbbd73501324f1effe82e26c4fe61c2928c370"}
Jul 13 02:57:30.984244 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:30.984218    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-j7pcm" event={"ID":"6dc5ae9e-d973-46ae-9924-43fc3e1e80f7","Type":"ContainerStarted","Data":"52093849f593df639d1455915c96339ed4eedf63262977adffc31014a37e1212"}
Jul 13 02:57:32.263544 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:32.263130    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8a77feae-62c9-449c-a6ee-c896d674943d-registry-tls\") pod \"image-registry-654597fc58-2jqwg\" (UID: \"8a77feae-62c9-449c-a6ee-c896d674943d\") " pod="openshift-image-registry/image-registry-654597fc58-2jqwg"
Jul 13 02:57:32.263544 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:32.263244    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/917248b5-3953-4ace-831e-99a59df139c1-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-4pspv\" (UID: \"917248b5-3953-4ace-831e-99a59df139c1\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4pspv"
Jul 13 02:57:32.263544 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:32.263276    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b32f1a22-542e-47d1-9c40-9de1fb178864-metrics-tls\") pod \"dns-default-5tx4z\" (UID: \"b32f1a22-542e-47d1-9c40-9de1fb178864\") " pod="openshift-dns/dns-default-5tx4z"
Jul 13 02:57:32.263544 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:57:32.263328    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 02:57:32.263544 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:57:32.263352    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-654597fc58-2jqwg: secret "image-registry-tls" not found
Jul 13 02:57:32.263544 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:57:32.263383    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 02:57:32.263544 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:57:32.263431    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8a77feae-62c9-449c-a6ee-c896d674943d-registry-tls podName:8a77feae-62c9-449c-a6ee-c896d674943d nodeName:}" failed. No retries permitted until 2026-07-13 02:58:04.263410267 +0000 UTC m=+100.246200377 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8a77feae-62c9-449c-a6ee-c896d674943d-registry-tls") pod "image-registry-654597fc58-2jqwg" (UID: "8a77feae-62c9-449c-a6ee-c896d674943d") : secret "image-registry-tls" not found
Jul 13 02:57:32.263544 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:57:32.263450    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b32f1a22-542e-47d1-9c40-9de1fb178864-metrics-tls podName:b32f1a22-542e-47d1-9c40-9de1fb178864 nodeName:}" failed. No retries permitted until 2026-07-13 02:58:04.263440826 +0000 UTC m=+100.246230919 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b32f1a22-542e-47d1-9c40-9de1fb178864-metrics-tls") pod "dns-default-5tx4z" (UID: "b32f1a22-542e-47d1-9c40-9de1fb178864") : secret "dns-default-metrics-tls" not found
Jul 13 02:57:32.263544 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:57:32.263479    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 13 02:57:32.263544 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:57:32.263517    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/917248b5-3953-4ace-831e-99a59df139c1-networking-console-plugin-cert podName:917248b5-3953-4ace-831e-99a59df139c1 nodeName:}" failed. No retries permitted until 2026-07-13 02:58:04.263501065 +0000 UTC m=+100.246291166 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/917248b5-3953-4ace-831e-99a59df139c1-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-4pspv" (UID: "917248b5-3953-4ace-831e-99a59df139c1") : secret "networking-console-plugin-cert" not found
Jul 13 02:57:34.606472 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:34.606440    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 02:57:34.708171 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:34.708139    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 02:57:34.925450 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:34.925369    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 02:57:35.025903 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:35.025807    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 02:57:36.008318 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:36.008275    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-24d7h" event={"ID":"71eff5ef-6532-42ba-b932-2911cfaedcac","Type":"ContainerStarted","Data":"22f010b5749da5ca21f4a27700af4c53f81d845d3696c5bfd6ed4f3d1b966265"}
Jul 13 02:57:36.008887 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:36.008396    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-24d7h"
Jul 13 02:57:36.009683 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:36.009656    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-j7pcm" event={"ID":"6dc5ae9e-d973-46ae-9924-43fc3e1e80f7","Type":"ContainerStarted","Data":"d49606187baa2e40df4b2a7f0f3e33ec15c91f2e54ccbc07ed0e371812512d12"}
Jul 13 02:57:36.023629 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:36.023584    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-24d7h" podStartSLOduration=66.546241802 podStartE2EDuration="1m11.023570449s" totalImagesPullingTime="4.477328647s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 02:56:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 02:57:36.022956539 +0000 UTC m=+72.005746649" watchObservedRunningTime="2026-07-13 02:57:36.023570449 +0000 UTC m=+72.006360558"
Jul 13 02:57:36.037094 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:36.037047    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-j7pcm" podStartSLOduration=66.497526383 podStartE2EDuration="1m11.03703304s" totalImagesPullingTime="4.539506657s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 02:56:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 02:57:36.036319144 +0000 UTC m=+72.019109254" watchObservedRunningTime="2026-07-13 02:57:36.03703304 +0000 UTC m=+72.019823184"
Jul 13 02:57:37.551415 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:37.551385    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 02:57:37.652853 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:37.652820    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 02:57:37.916180 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:37.916097    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 02:57:37.977246 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:37.977215    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 02:57:38.989463 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:38.989432    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 02:57:39.050453 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:39.050422    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 02:57:39.106492 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:39.106432    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 02:57:40.213074 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:40.213039    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 02:57:40.316952 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:40.316902    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 02:57:58.531907 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:58.531785    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 02:57:58.620438 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:58.620408    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 02:57:59.955524 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:57:59.955489    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 02:58:00.011772 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:58:00.011736    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 02:58:00.077044 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:58:00.077010    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 02:58:04.299707 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:58:04.299673    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/917248b5-3953-4ace-831e-99a59df139c1-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-4pspv\" (UID: \"917248b5-3953-4ace-831e-99a59df139c1\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4pspv"
Jul 13 02:58:04.299707 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:58:04.299710    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b32f1a22-542e-47d1-9c40-9de1fb178864-metrics-tls\") pod \"dns-default-5tx4z\" (UID: \"b32f1a22-542e-47d1-9c40-9de1fb178864\") " pod="openshift-dns/dns-default-5tx4z"
Jul 13 02:58:04.300123 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:58:04.299764    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8a77feae-62c9-449c-a6ee-c896d674943d-registry-tls\") pod \"image-registry-654597fc58-2jqwg\" (UID: \"8a77feae-62c9-449c-a6ee-c896d674943d\") " pod="openshift-image-registry/image-registry-654597fc58-2jqwg"
Jul 13 02:58:04.300123 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:58:04.299827    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 13 02:58:04.300123 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:58:04.299860    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 02:58:04.300123 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:58:04.299872    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-654597fc58-2jqwg: secret "image-registry-tls" not found
Jul 13 02:58:04.300123 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:58:04.299895    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/917248b5-3953-4ace-831e-99a59df139c1-networking-console-plugin-cert podName:917248b5-3953-4ace-831e-99a59df139c1 nodeName:}" failed. No retries permitted until 2026-07-13 02:59:08.299876582 +0000 UTC m=+164.282666689 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/917248b5-3953-4ace-831e-99a59df139c1-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-4pspv" (UID: "917248b5-3953-4ace-831e-99a59df139c1") : secret "networking-console-plugin-cert" not found
Jul 13 02:58:04.300123 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:58:04.299903    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 02:58:04.300123 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:58:04.299910    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8a77feae-62c9-449c-a6ee-c896d674943d-registry-tls podName:8a77feae-62c9-449c-a6ee-c896d674943d nodeName:}" failed. No retries permitted until 2026-07-13 02:59:08.299902521 +0000 UTC m=+164.282692608 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8a77feae-62c9-449c-a6ee-c896d674943d-registry-tls") pod "image-registry-654597fc58-2jqwg" (UID: "8a77feae-62c9-449c-a6ee-c896d674943d") : secret "image-registry-tls" not found
Jul 13 02:58:04.300123 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:58:04.299994    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b32f1a22-542e-47d1-9c40-9de1fb178864-metrics-tls podName:b32f1a22-542e-47d1-9c40-9de1fb178864 nodeName:}" failed. No retries permitted until 2026-07-13 02:59:08.299978459 +0000 UTC m=+164.282768545 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b32f1a22-542e-47d1-9c40-9de1fb178864-metrics-tls") pod "dns-default-5tx4z" (UID: "b32f1a22-542e-47d1-9c40-9de1fb178864") : secret "dns-default-metrics-tls" not found
Jul 13 02:58:07.015974 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:58:07.015926    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-24d7h"
Jul 13 02:58:27.523373 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:58:27.523295    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 02:58:27.624717 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:58:27.624684    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 02:58:34.310002 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:58:34.309972    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd0ac0dd-db5b-41c3-b69d-bcf3af528e20-metrics-certs\") pod \"network-metrics-daemon-p44kl\" (UID: \"cd0ac0dd-db5b-41c3-b69d-bcf3af528e20\") " pod="openshift-multus/network-metrics-daemon-p44kl"
Jul 13 02:58:34.310375 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:58:34.310118    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 13 02:58:34.310375 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:58:34.310181    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd0ac0dd-db5b-41c3-b69d-bcf3af528e20-metrics-certs podName:cd0ac0dd-db5b-41c3-b69d-bcf3af528e20 nodeName:}" failed. No retries permitted until 2026-07-13 03:00:36.310165389 +0000 UTC m=+252.292955475 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd0ac0dd-db5b-41c3-b69d-bcf3af528e20-metrics-certs") pod "network-metrics-daemon-p44kl" (UID: "cd0ac0dd-db5b-41c3-b69d-bcf3af528e20") : secret "metrics-daemon-secret" not found
Jul 13 02:59:03.388568 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:59:03.388521    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-654597fc58-2jqwg" podUID="8a77feae-62c9-449c-a6ee-c896d674943d"
Jul 13 02:59:03.407869 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:59:03.407835    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6cf856758c-4pspv" podUID="917248b5-3953-4ace-831e-99a59df139c1"
Jul 13 02:59:03.453676 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:59:03.453642    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-5tx4z" podUID="b32f1a22-542e-47d1-9c40-9de1fb178864"
Jul 13 02:59:03.542035 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:59:03.542006    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-p44kl" podUID="cd0ac0dd-db5b-41c3-b69d-bcf3af528e20"
Jul 13 02:59:04.263033 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:59:04.263001    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5tx4z"
Jul 13 02:59:04.263033 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:59:04.263030    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-654597fc58-2jqwg"
Jul 13 02:59:04.263232 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:59:04.263145    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-4pspv"
Jul 13 02:59:08.347168 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:59:08.347133    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/917248b5-3953-4ace-831e-99a59df139c1-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-4pspv\" (UID: \"917248b5-3953-4ace-831e-99a59df139c1\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4pspv"
Jul 13 02:59:08.347168 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:59:08.347166    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b32f1a22-542e-47d1-9c40-9de1fb178864-metrics-tls\") pod \"dns-default-5tx4z\" (UID: \"b32f1a22-542e-47d1-9c40-9de1fb178864\") " pod="openshift-dns/dns-default-5tx4z"
Jul 13 02:59:08.347561 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:59:08.347204    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8a77feae-62c9-449c-a6ee-c896d674943d-registry-tls\") pod \"image-registry-654597fc58-2jqwg\" (UID: \"8a77feae-62c9-449c-a6ee-c896d674943d\") " pod="openshift-image-registry/image-registry-654597fc58-2jqwg"
Jul 13 02:59:08.347561 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:59:08.347278    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 13 02:59:08.347561 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:59:08.347284    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 02:59:08.347561 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:59:08.347343    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/917248b5-3953-4ace-831e-99a59df139c1-networking-console-plugin-cert podName:917248b5-3953-4ace-831e-99a59df139c1 nodeName:}" failed. No retries permitted until 2026-07-13 03:01:10.347328197 +0000 UTC m=+286.330118284 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/917248b5-3953-4ace-831e-99a59df139c1-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-4pspv" (UID: "917248b5-3953-4ace-831e-99a59df139c1") : secret "networking-console-plugin-cert" not found
Jul 13 02:59:08.347561 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:59:08.347291    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 02:59:08.347561 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:59:08.347356    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b32f1a22-542e-47d1-9c40-9de1fb178864-metrics-tls podName:b32f1a22-542e-47d1-9c40-9de1fb178864 nodeName:}" failed. No retries permitted until 2026-07-13 03:01:10.347349857 +0000 UTC m=+286.330139943 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b32f1a22-542e-47d1-9c40-9de1fb178864-metrics-tls") pod "dns-default-5tx4z" (UID: "b32f1a22-542e-47d1-9c40-9de1fb178864") : secret "dns-default-metrics-tls" not found
Jul 13 02:59:08.347561 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:59:08.347357    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-654597fc58-2jqwg: secret "image-registry-tls" not found
Jul 13 02:59:08.347561 ip-10-0-142-39 kubenswrapper[2563]: E0713 02:59:08.347388    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8a77feae-62c9-449c-a6ee-c896d674943d-registry-tls podName:8a77feae-62c9-449c-a6ee-c896d674943d nodeName:}" failed. No retries permitted until 2026-07-13 03:01:10.347375655 +0000 UTC m=+286.330165741 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8a77feae-62c9-449c-a6ee-c896d674943d-registry-tls") pod "image-registry-654597fc58-2jqwg" (UID: "8a77feae-62c9-449c-a6ee-c896d674943d") : secret "image-registry-tls" not found
Jul 13 02:59:08.914891 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:59:08.914848    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c856c9c8-pdqzk" podUID="3c83f9f2-ef52-44de-888a-6273032827fe" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.7:8000/readyz\": dial tcp 10.132.0.7:8000: connect: connection refused"
Jul 13 02:59:09.277449 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:59:09.277370    2563 generic.go:356] "Generic (PLEG): container finished" podID="1b37dc03-7412-4c20-b134-7e6865ef104c" containerID="541cd76b755588216f48e90e92c2ee28d30794b280fde0fcf11b5fbaaacbc592" exitCode=255
Jul 13 02:59:09.277601 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:59:09.277448    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f7ddc8b98-6mtmk" event={"ID":"1b37dc03-7412-4c20-b134-7e6865ef104c","Type":"ContainerDied","Data":"541cd76b755588216f48e90e92c2ee28d30794b280fde0fcf11b5fbaaacbc592"}
Jul 13 02:59:09.277756 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:59:09.277741    2563 scope.go:117] "RemoveContainer" containerID="541cd76b755588216f48e90e92c2ee28d30794b280fde0fcf11b5fbaaacbc592"
Jul 13 02:59:09.278909 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:59:09.278882    2563 generic.go:356] "Generic (PLEG): container finished" podID="3c83f9f2-ef52-44de-888a-6273032827fe" containerID="df0c3ba4c6f781039aa4886ad6168b78e48937be851b6074557606d6cffaac3f" exitCode=1
Jul 13 02:59:09.279133 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:59:09.278913    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c856c9c8-pdqzk" event={"ID":"3c83f9f2-ef52-44de-888a-6273032827fe","Type":"ContainerDied","Data":"df0c3ba4c6f781039aa4886ad6168b78e48937be851b6074557606d6cffaac3f"}
Jul 13 02:59:09.279244 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:59:09.279230    2563 scope.go:117] "RemoveContainer" containerID="df0c3ba4c6f781039aa4886ad6168b78e48937be851b6074557606d6cffaac3f"
Jul 13 02:59:10.283685 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:59:10.283648    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f7ddc8b98-6mtmk" event={"ID":"1b37dc03-7412-4c20-b134-7e6865ef104c","Type":"ContainerStarted","Data":"d485668d7c38b1b8c298fc4f33f6e33f1c3219144eed354895fef8cf4149f379"}
Jul 13 02:59:10.285262 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:59:10.285238    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c856c9c8-pdqzk" event={"ID":"3c83f9f2-ef52-44de-888a-6273032827fe","Type":"ContainerStarted","Data":"da64c28672531f4d1a01244876371c5e66ed55049c636a722929f34c37764ddc"}
Jul 13 02:59:10.285488 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:59:10.285475    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c856c9c8-pdqzk"
Jul 13 02:59:10.286037 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:59:10.286019    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c856c9c8-pdqzk"
Jul 13 02:59:17.525858 ip-10-0-142-39 kubenswrapper[2563]: I0713 02:59:17.525775    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p44kl"
Jul 13 03:00:26.068161 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:00:26.068119    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:00:36.347584 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:00:36.347472    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd0ac0dd-db5b-41c3-b69d-bcf3af528e20-metrics-certs\") pod \"network-metrics-daemon-p44kl\" (UID: \"cd0ac0dd-db5b-41c3-b69d-bcf3af528e20\") " pod="openshift-multus/network-metrics-daemon-p44kl"
Jul 13 03:00:36.347976 ip-10-0-142-39 kubenswrapper[2563]: E0713 03:00:36.347624    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 13 03:00:36.347976 ip-10-0-142-39 kubenswrapper[2563]: E0713 03:00:36.347702    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd0ac0dd-db5b-41c3-b69d-bcf3af528e20-metrics-certs podName:cd0ac0dd-db5b-41c3-b69d-bcf3af528e20 nodeName:}" failed. No retries permitted until 2026-07-13 03:02:38.347686523 +0000 UTC m=+374.330476613 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd0ac0dd-db5b-41c3-b69d-bcf3af528e20-metrics-certs") pod "network-metrics-daemon-p44kl" (UID: "cd0ac0dd-db5b-41c3-b69d-bcf3af528e20") : secret "metrics-daemon-secret" not found
Jul 13 03:00:39.172714 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:00:39.172665    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:00:48.737172 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:00:48.737091    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:00:48.786659 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:00:48.786636    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:00:50.923149 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:00:50.923115    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:00:50.982321 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:00:50.982285    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:00:52.701882 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:00:52.701848    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:00:52.752165 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:00:52.752139    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:00:53.410141 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:00:53.410111    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:00:53.509913 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:00:53.509886    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:00:53.863474 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:00:53.863447    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-bn5nq"]
Jul 13 03:00:53.866324 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:00:53.866306    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bn5nq"
Jul 13 03:00:53.869218 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:00:53.869192    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 13 03:00:53.869327 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:00:53.869194    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 13 03:00:53.869901 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:00:53.869879    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7mbnd\""
Jul 13 03:00:53.870024 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:00:53.869902    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 13 03:00:53.870024 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:00:53.869907    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 13 03:00:53.878510 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:00:53.878450    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bn5nq"]
Jul 13 03:00:53.910097 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:00:53.910075    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:00:53.966149 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:00:53.966117    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:00:53.970147 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:00:53.970130    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jx4s8\" (UniqueName: \"kubernetes.io/projected/6d73644f-10d2-45bc-821e-9a7c3177b107-kube-api-access-jx4s8\") pod \"insights-runtime-extractor-bn5nq\" (UID: \"6d73644f-10d2-45bc-821e-9a7c3177b107\") " pod="openshift-insights/insights-runtime-extractor-bn5nq"
Jul 13 03:00:53.970209 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:00:53.970158    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6d73644f-10d2-45bc-821e-9a7c3177b107-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bn5nq\" (UID: \"6d73644f-10d2-45bc-821e-9a7c3177b107\") " pod="openshift-insights/insights-runtime-extractor-bn5nq"
Jul 13 03:00:53.970245 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:00:53.970231    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6d73644f-10d2-45bc-821e-9a7c3177b107-crio-socket\") pod \"insights-runtime-extractor-bn5nq\" (UID: \"6d73644f-10d2-45bc-821e-9a7c3177b107\") " pod="openshift-insights/insights-runtime-extractor-bn5nq"
Jul 13 03:00:53.970277 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:00:53.970253    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6d73644f-10d2-45bc-821e-9a7c3177b107-data-volume\") pod \"insights-runtime-extractor-bn5nq\" (UID: \"6d73644f-10d2-45bc-821e-9a7c3177b107\") " pod="openshift-insights/insights-runtime-extractor-bn5nq"
Jul 13 03:00:53.970337 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:00:53.970325    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6d73644f-10d2-45bc-821e-9a7c3177b107-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bn5nq\" (UID: \"6d73644f-10d2-45bc-821e-9a7c3177b107\") " pod="openshift-insights/insights-runtime-extractor-bn5nq"
Jul 13 03:00:54.071120 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:00:54.071096    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6d73644f-10d2-45bc-821e-9a7c3177b107-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bn5nq\" (UID: \"6d73644f-10d2-45bc-821e-9a7c3177b107\") " pod="openshift-insights/insights-runtime-extractor-bn5nq"
Jul 13 03:00:54.071226 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:00:54.071127    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jx4s8\" (UniqueName: \"kubernetes.io/projected/6d73644f-10d2-45bc-821e-9a7c3177b107-kube-api-access-jx4s8\") pod \"insights-runtime-extractor-bn5nq\" (UID: \"6d73644f-10d2-45bc-821e-9a7c3177b107\") " pod="openshift-insights/insights-runtime-extractor-bn5nq"
Jul 13 03:00:54.071226 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:00:54.071151    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6d73644f-10d2-45bc-821e-9a7c3177b107-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bn5nq\" (UID: \"6d73644f-10d2-45bc-821e-9a7c3177b107\") " pod="openshift-insights/insights-runtime-extractor-bn5nq"
Jul 13 03:00:54.071226 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:00:54.071176    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6d73644f-10d2-45bc-821e-9a7c3177b107-crio-socket\") pod \"insights-runtime-extractor-bn5nq\" (UID: \"6d73644f-10d2-45bc-821e-9a7c3177b107\") " pod="openshift-insights/insights-runtime-extractor-bn5nq"
Jul 13 03:00:54.071226 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:00:54.071208    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6d73644f-10d2-45bc-821e-9a7c3177b107-data-volume\") pod \"insights-runtime-extractor-bn5nq\" (UID: \"6d73644f-10d2-45bc-821e-9a7c3177b107\") " pod="openshift-insights/insights-runtime-extractor-bn5nq"
Jul 13 03:00:54.071365 ip-10-0-142-39 kubenswrapper[2563]: E0713 03:00:54.071244    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 13 03:00:54.071365 ip-10-0-142-39 kubenswrapper[2563]: E0713 03:00:54.071246    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 13 03:00:54.071365 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:00:54.071272    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6d73644f-10d2-45bc-821e-9a7c3177b107-crio-socket\") pod \"insights-runtime-extractor-bn5nq\" (UID: \"6d73644f-10d2-45bc-821e-9a7c3177b107\") " pod="openshift-insights/insights-runtime-extractor-bn5nq"
Jul 13 03:00:54.071365 ip-10-0-142-39 kubenswrapper[2563]: E0713 03:00:54.071306    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d73644f-10d2-45bc-821e-9a7c3177b107-insights-runtime-extractor-tls podName:6d73644f-10d2-45bc-821e-9a7c3177b107 nodeName:}" failed. No retries permitted until 2026-07-13 03:00:54.571288838 +0000 UTC m=+270.554078929 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6d73644f-10d2-45bc-821e-9a7c3177b107-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bn5nq" (UID: "6d73644f-10d2-45bc-821e-9a7c3177b107") : secret "insights-runtime-extractor-tls" not found
Jul 13 03:00:54.071365 ip-10-0-142-39 kubenswrapper[2563]: E0713 03:00:54.071323    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6d73644f-10d2-45bc-821e-9a7c3177b107-kube-rbac-proxy-cm podName:6d73644f-10d2-45bc-821e-9a7c3177b107 nodeName:}" failed. No retries permitted until 2026-07-13 03:00:54.571316127 +0000 UTC m=+270.554106215 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6d73644f-10d2-45bc-821e-9a7c3177b107-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bn5nq" (UID: "6d73644f-10d2-45bc-821e-9a7c3177b107") : configmap "kube-rbac-proxy" not found
Jul 13 03:00:54.071560 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:00:54.071546    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6d73644f-10d2-45bc-821e-9a7c3177b107-data-volume\") pod \"insights-runtime-extractor-bn5nq\" (UID: \"6d73644f-10d2-45bc-821e-9a7c3177b107\") " pod="openshift-insights/insights-runtime-extractor-bn5nq"
Jul 13 03:00:54.079258 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:00:54.079235    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jx4s8\" (UniqueName: \"kubernetes.io/projected/6d73644f-10d2-45bc-821e-9a7c3177b107-kube-api-access-jx4s8\") pod \"insights-runtime-extractor-bn5nq\" (UID: \"6d73644f-10d2-45bc-821e-9a7c3177b107\") " pod="openshift-insights/insights-runtime-extractor-bn5nq"
Jul 13 03:00:54.171986 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:00:54.171908    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:00:54.266801 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:00:54.266781    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:00:54.376775 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:00:54.376754    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:00:54.573643 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:00:54.573619    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6d73644f-10d2-45bc-821e-9a7c3177b107-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bn5nq\" (UID: \"6d73644f-10d2-45bc-821e-9a7c3177b107\") " pod="openshift-insights/insights-runtime-extractor-bn5nq"
Jul 13 03:00:54.573865 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:00:54.573707    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6d73644f-10d2-45bc-821e-9a7c3177b107-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bn5nq\" (UID: \"6d73644f-10d2-45bc-821e-9a7c3177b107\") " pod="openshift-insights/insights-runtime-extractor-bn5nq"
Jul 13 03:00:54.573865 ip-10-0-142-39 kubenswrapper[2563]: E0713 03:00:54.573720    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 13 03:00:54.573865 ip-10-0-142-39 kubenswrapper[2563]: E0713 03:00:54.573763    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6d73644f-10d2-45bc-821e-9a7c3177b107-kube-rbac-proxy-cm podName:6d73644f-10d2-45bc-821e-9a7c3177b107 nodeName:}" failed. No retries permitted until 2026-07-13 03:00:55.573751104 +0000 UTC m=+271.556541191 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6d73644f-10d2-45bc-821e-9a7c3177b107-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bn5nq" (UID: "6d73644f-10d2-45bc-821e-9a7c3177b107") : configmap "kube-rbac-proxy" not found
Jul 13 03:00:54.573865 ip-10-0-142-39 kubenswrapper[2563]: E0713 03:00:54.573793    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 13 03:00:54.573865 ip-10-0-142-39 kubenswrapper[2563]: E0713 03:00:54.573846    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d73644f-10d2-45bc-821e-9a7c3177b107-insights-runtime-extractor-tls podName:6d73644f-10d2-45bc-821e-9a7c3177b107 nodeName:}" failed. No retries permitted until 2026-07-13 03:00:55.573835803 +0000 UTC m=+271.556625890 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6d73644f-10d2-45bc-821e-9a7c3177b107-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bn5nq" (UID: "6d73644f-10d2-45bc-821e-9a7c3177b107") : secret "insights-runtime-extractor-tls" not found
Jul 13 03:00:55.027186 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:00:55.027105    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:00:55.080666 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:00:55.080639    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:00:55.580623 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:00:55.580597    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6d73644f-10d2-45bc-821e-9a7c3177b107-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bn5nq\" (UID: \"6d73644f-10d2-45bc-821e-9a7c3177b107\") " pod="openshift-insights/insights-runtime-extractor-bn5nq"
Jul 13 03:00:55.580801 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:00:55.580631    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6d73644f-10d2-45bc-821e-9a7c3177b107-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bn5nq\" (UID: \"6d73644f-10d2-45bc-821e-9a7c3177b107\") " pod="openshift-insights/insights-runtime-extractor-bn5nq"
Jul 13 03:00:55.580801 ip-10-0-142-39 kubenswrapper[2563]: E0713 03:00:55.580720    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 13 03:00:55.580801 ip-10-0-142-39 kubenswrapper[2563]: E0713 03:00:55.580757    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 13 03:00:55.580801 ip-10-0-142-39 kubenswrapper[2563]: E0713 03:00:55.580774    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6d73644f-10d2-45bc-821e-9a7c3177b107-kube-rbac-proxy-cm podName:6d73644f-10d2-45bc-821e-9a7c3177b107 nodeName:}" failed. No retries permitted until 2026-07-13 03:00:57.580757114 +0000 UTC m=+273.563547202 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6d73644f-10d2-45bc-821e-9a7c3177b107-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bn5nq" (UID: "6d73644f-10d2-45bc-821e-9a7c3177b107") : configmap "kube-rbac-proxy" not found
Jul 13 03:00:55.580801 ip-10-0-142-39 kubenswrapper[2563]: E0713 03:00:55.580802    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d73644f-10d2-45bc-821e-9a7c3177b107-insights-runtime-extractor-tls podName:6d73644f-10d2-45bc-821e-9a7c3177b107 nodeName:}" failed. No retries permitted until 2026-07-13 03:00:57.580789958 +0000 UTC m=+273.563580048 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6d73644f-10d2-45bc-821e-9a7c3177b107-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bn5nq" (UID: "6d73644f-10d2-45bc-821e-9a7c3177b107") : secret "insights-runtime-extractor-tls" not found
Jul 13 03:00:56.169870 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:00:56.169840    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xnfwg_b3b58c31-485d-4010-b36b-049e6006b525/dns-node-resolver/0.log"
Jul 13 03:00:56.278735 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:00:56.278700    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:00:56.768863 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:00:56.768838    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jvpfc_bbf72fd6-813d-4e7e-8168-7b41c4605230/node-ca/0.log"
Jul 13 03:00:57.041898 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:00:57.041812    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:00:57.197537 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:00:57.197506    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:00:57.306803 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:00:57.306778    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:00:57.476448 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:00:57.476422    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:00:57.595731 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:00:57.595649    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6d73644f-10d2-45bc-821e-9a7c3177b107-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bn5nq\" (UID: \"6d73644f-10d2-45bc-821e-9a7c3177b107\") " pod="openshift-insights/insights-runtime-extractor-bn5nq"
Jul 13 03:00:57.595731 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:00:57.595697    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6d73644f-10d2-45bc-821e-9a7c3177b107-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bn5nq\" (UID: \"6d73644f-10d2-45bc-821e-9a7c3177b107\") " pod="openshift-insights/insights-runtime-extractor-bn5nq"
Jul 13 03:00:57.595906 ip-10-0-142-39 kubenswrapper[2563]: E0713 03:00:57.595791    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 13 03:00:57.595906 ip-10-0-142-39 kubenswrapper[2563]: E0713 03:00:57.595796    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 13 03:00:57.595906 ip-10-0-142-39 kubenswrapper[2563]: E0713 03:00:57.595856    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6d73644f-10d2-45bc-821e-9a7c3177b107-kube-rbac-proxy-cm podName:6d73644f-10d2-45bc-821e-9a7c3177b107 nodeName:}" failed. No retries permitted until 2026-07-13 03:01:01.595843659 +0000 UTC m=+277.578633745 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6d73644f-10d2-45bc-821e-9a7c3177b107-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bn5nq" (UID: "6d73644f-10d2-45bc-821e-9a7c3177b107") : configmap "kube-rbac-proxy" not found
Jul 13 03:00:57.595906 ip-10-0-142-39 kubenswrapper[2563]: E0713 03:00:57.595868    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d73644f-10d2-45bc-821e-9a7c3177b107-insights-runtime-extractor-tls podName:6d73644f-10d2-45bc-821e-9a7c3177b107 nodeName:}" failed. No retries permitted until 2026-07-13 03:01:01.595862818 +0000 UTC m=+277.578652904 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6d73644f-10d2-45bc-821e-9a7c3177b107-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bn5nq" (UID: "6d73644f-10d2-45bc-821e-9a7c3177b107") : secret "insights-runtime-extractor-tls" not found
Jul 13 03:00:57.740655 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:00:57.740629    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:00:57.969088 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:00:57.969024    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-sgg7j_3965be9b-fcc2-48b2-b5b0-d75dd94206a4/serve-healthcheck-canary/0.log"
Jul 13 03:00:58.274170 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:00:58.274100    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:00:58.740578 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:00:58.740549    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:00:58.942375 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:00:58.942350    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:00:59.092796 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:00:59.092771    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:00:59.332319 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:00:59.332293    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:00:59.529231 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:00:59.529167    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:00.133185 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:00.133154    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:00.530297 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:00.530217    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:00.729307 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:00.729278    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:00.926578 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:00.926552    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:01.157896 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:01.157862    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:01.230894 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:01.230823    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:01.534171 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:01.534092    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:01.626651 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:01.626625    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6d73644f-10d2-45bc-821e-9a7c3177b107-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bn5nq\" (UID: \"6d73644f-10d2-45bc-821e-9a7c3177b107\") " pod="openshift-insights/insights-runtime-extractor-bn5nq"
Jul 13 03:01:01.626792 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:01.626662    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6d73644f-10d2-45bc-821e-9a7c3177b107-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bn5nq\" (UID: \"6d73644f-10d2-45bc-821e-9a7c3177b107\") " pod="openshift-insights/insights-runtime-extractor-bn5nq"
Jul 13 03:01:01.626792 ip-10-0-142-39 kubenswrapper[2563]: E0713 03:01:01.626759    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 13 03:01:01.626864 ip-10-0-142-39 kubenswrapper[2563]: E0713 03:01:01.626818    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d73644f-10d2-45bc-821e-9a7c3177b107-insights-runtime-extractor-tls podName:6d73644f-10d2-45bc-821e-9a7c3177b107 nodeName:}" failed. No retries permitted until 2026-07-13 03:01:09.626804114 +0000 UTC m=+285.609594201 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6d73644f-10d2-45bc-821e-9a7c3177b107-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bn5nq" (UID: "6d73644f-10d2-45bc-821e-9a7c3177b107") : secret "insights-runtime-extractor-tls" not found
Jul 13 03:01:01.627165 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:01.627149    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6d73644f-10d2-45bc-821e-9a7c3177b107-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bn5nq\" (UID: \"6d73644f-10d2-45bc-821e-9a7c3177b107\") " pod="openshift-insights/insights-runtime-extractor-bn5nq"
Jul 13 03:01:01.733535 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:01.733511    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:02.131526 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:02.131496    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:02.878208 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:02.878172    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:02.979030 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:02.979002    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:03.135401 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:03.135318    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:03.290845 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:03.290813    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:03.391442 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:03.391369    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:03.521527 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:03.521499    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:03.637229 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:03.637196    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:03.731762 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:03.731685    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:04.730279 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:04.730246    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:04.931611 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:04.931579    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:05.335909 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:05.335880    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:05.532178 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:05.532147    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:05.941570 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:05.941540    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:06.733669 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:06.733638    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:06.934887 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:06.934844    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:07.134471 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:07.134438    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:07.264405 ip-10-0-142-39 kubenswrapper[2563]: E0713 03:01:07.264368    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6cf856758c-4pspv" podUID="917248b5-3953-4ace-831e-99a59df139c1"
Jul 13 03:01:07.264405 ip-10-0-142-39 kubenswrapper[2563]: E0713 03:01:07.264365    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-5tx4z" podUID="b32f1a22-542e-47d1-9c40-9de1fb178864"
Jul 13 03:01:07.264616 ip-10-0-142-39 kubenswrapper[2563]: E0713 03:01:07.264364    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-654597fc58-2jqwg" podUID="8a77feae-62c9-449c-a6ee-c896d674943d"
Jul 13 03:01:07.611880 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:07.611842    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-4pspv"
Jul 13 03:01:07.611880 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:07.611872    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-654597fc58-2jqwg"
Jul 13 03:01:07.612136 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:07.611982    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5tx4z"
Jul 13 03:01:07.612798 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:07.612776    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:07.713745 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:07.713721    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:07.813883 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:07.813856    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:07.875752 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:07.875681    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:08.139906 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:08.139834    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:09.618234 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:09.618160    2563 generic.go:356] "Generic (PLEG): container finished" podID="1b37dc03-7412-4c20-b134-7e6865ef104c" containerID="d485668d7c38b1b8c298fc4f33f6e33f1c3219144eed354895fef8cf4149f379" exitCode=255
Jul 13 03:01:09.618613 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:09.618240    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f7ddc8b98-6mtmk" event={"ID":"1b37dc03-7412-4c20-b134-7e6865ef104c","Type":"ContainerDied","Data":"d485668d7c38b1b8c298fc4f33f6e33f1c3219144eed354895fef8cf4149f379"}
Jul 13 03:01:09.618613 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:09.618284    2563 scope.go:117] "RemoveContainer" containerID="541cd76b755588216f48e90e92c2ee28d30794b280fde0fcf11b5fbaaacbc592"
Jul 13 03:01:09.618613 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:09.618561    2563 scope.go:117] "RemoveContainer" containerID="d485668d7c38b1b8c298fc4f33f6e33f1c3219144eed354895fef8cf4149f379"
Jul 13 03:01:09.618752 ip-10-0-142-39 kubenswrapper[2563]: E0713 03:01:09.618726    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-5f7ddc8b98-6mtmk_open-cluster-management-agent-addon(1b37dc03-7412-4c20-b134-7e6865ef104c)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f7ddc8b98-6mtmk" podUID="1b37dc03-7412-4c20-b134-7e6865ef104c"
Jul 13 03:01:09.620046 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:09.620026    2563 generic.go:356] "Generic (PLEG): container finished" podID="3c83f9f2-ef52-44de-888a-6273032827fe" containerID="da64c28672531f4d1a01244876371c5e66ed55049c636a722929f34c37764ddc" exitCode=1
Jul 13 03:01:09.620118 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:09.620073    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c856c9c8-pdqzk" event={"ID":"3c83f9f2-ef52-44de-888a-6273032827fe","Type":"ContainerDied","Data":"da64c28672531f4d1a01244876371c5e66ed55049c636a722929f34c37764ddc"}
Jul 13 03:01:09.620300 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:09.620288    2563 scope.go:117] "RemoveContainer" containerID="da64c28672531f4d1a01244876371c5e66ed55049c636a722929f34c37764ddc"
Jul 13 03:01:09.620418 ip-10-0-142-39 kubenswrapper[2563]: E0713 03:01:09.620404    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-9c856c9c8-pdqzk_open-cluster-management-agent-addon(3c83f9f2-ef52-44de-888a-6273032827fe)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c856c9c8-pdqzk" podUID="3c83f9f2-ef52-44de-888a-6273032827fe"
Jul 13 03:01:09.628139 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:09.628122    2563 scope.go:117] "RemoveContainer" containerID="df0c3ba4c6f781039aa4886ad6168b78e48937be851b6074557606d6cffaac3f"
Jul 13 03:01:09.691617 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:09.691591    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6d73644f-10d2-45bc-821e-9a7c3177b107-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bn5nq\" (UID: \"6d73644f-10d2-45bc-821e-9a7c3177b107\") " pod="openshift-insights/insights-runtime-extractor-bn5nq"
Jul 13 03:01:09.693789 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:09.693770    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6d73644f-10d2-45bc-821e-9a7c3177b107-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bn5nq\" (UID: \"6d73644f-10d2-45bc-821e-9a7c3177b107\") " pod="openshift-insights/insights-runtime-extractor-bn5nq"
Jul 13 03:01:09.774672 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:09.774655    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bn5nq"
Jul 13 03:01:09.896587 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:09.896512    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bn5nq"]
Jul 13 03:01:09.899527 ip-10-0-142-39 kubenswrapper[2563]: W0713 03:01:09.899503    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d73644f_10d2_45bc_821e_9a7c3177b107.slice/crio-f0cf23647967e84ef3c9dc53cb69540b9f14a165a39c12e8853ac3a959022eac WatchSource:0}: Error finding container f0cf23647967e84ef3c9dc53cb69540b9f14a165a39c12e8853ac3a959022eac: Status 404 returned error can't find the container with id f0cf23647967e84ef3c9dc53cb69540b9f14a165a39c12e8853ac3a959022eac
Jul 13 03:01:10.285839 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:10.285748    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c856c9c8-pdqzk"
Jul 13 03:01:10.398004 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:10.397970    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/917248b5-3953-4ace-831e-99a59df139c1-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-4pspv\" (UID: \"917248b5-3953-4ace-831e-99a59df139c1\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4pspv"
Jul 13 03:01:10.398004 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:10.398007    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b32f1a22-542e-47d1-9c40-9de1fb178864-metrics-tls\") pod \"dns-default-5tx4z\" (UID: \"b32f1a22-542e-47d1-9c40-9de1fb178864\") " pod="openshift-dns/dns-default-5tx4z"
Jul 13 03:01:10.398182 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:10.398053    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8a77feae-62c9-449c-a6ee-c896d674943d-registry-tls\") pod \"image-registry-654597fc58-2jqwg\" (UID: \"8a77feae-62c9-449c-a6ee-c896d674943d\") " pod="openshift-image-registry/image-registry-654597fc58-2jqwg"
Jul 13 03:01:10.400532 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:10.400499    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b32f1a22-542e-47d1-9c40-9de1fb178864-metrics-tls\") pod \"dns-default-5tx4z\" (UID: \"b32f1a22-542e-47d1-9c40-9de1fb178864\") " pod="openshift-dns/dns-default-5tx4z"
Jul 13 03:01:10.400655 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:10.400612    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/917248b5-3953-4ace-831e-99a59df139c1-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-4pspv\" (UID: \"917248b5-3953-4ace-831e-99a59df139c1\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-4pspv"
Jul 13 03:01:10.400735 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:10.400712    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8a77feae-62c9-449c-a6ee-c896d674943d-registry-tls\") pod \"image-registry-654597fc58-2jqwg\" (UID: \"8a77feae-62c9-449c-a6ee-c896d674943d\") " pod="openshift-image-registry/image-registry-654597fc58-2jqwg"
Jul 13 03:01:10.616267 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:10.616234    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-jtncw\""
Jul 13 03:01:10.616732 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:10.616556    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-vw8zn\""
Jul 13 03:01:10.616732 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:10.616615    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-2x46b\""
Jul 13 03:01:10.622421 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:10.622400    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5tx4z"
Jul 13 03:01:10.622801 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:10.622447    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-4pspv"
Jul 13 03:01:10.622801 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:10.622507    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-654597fc58-2jqwg"
Jul 13 03:01:10.628900 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:10.628326    2563 scope.go:117] "RemoveContainer" containerID="da64c28672531f4d1a01244876371c5e66ed55049c636a722929f34c37764ddc"
Jul 13 03:01:10.629385 ip-10-0-142-39 kubenswrapper[2563]: E0713 03:01:10.629064    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-9c856c9c8-pdqzk_open-cluster-management-agent-addon(3c83f9f2-ef52-44de-888a-6273032827fe)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c856c9c8-pdqzk" podUID="3c83f9f2-ef52-44de-888a-6273032827fe"
Jul 13 03:01:10.636132 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:10.636105    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bn5nq" event={"ID":"6d73644f-10d2-45bc-821e-9a7c3177b107","Type":"ContainerStarted","Data":"f0cf23647967e84ef3c9dc53cb69540b9f14a165a39c12e8853ac3a959022eac"}
Jul 13 03:01:10.701848 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:10.700341    2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c856c9c8-pdqzk"
Jul 13 03:01:10.731697 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:10.731306    2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f7ddc8b98-6mtmk"
Jul 13 03:01:10.731864 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:10.731740    2563 scope.go:117] "RemoveContainer" containerID="d485668d7c38b1b8c298fc4f33f6e33f1c3219144eed354895fef8cf4149f379"
Jul 13 03:01:10.732190 ip-10-0-142-39 kubenswrapper[2563]: E0713 03:01:10.731998    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-5f7ddc8b98-6mtmk_open-cluster-management-agent-addon(1b37dc03-7412-4c20-b134-7e6865ef104c)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f7ddc8b98-6mtmk" podUID="1b37dc03-7412-4c20-b134-7e6865ef104c"
Jul 13 03:01:10.823544 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:10.823455    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-654597fc58-2jqwg"]
Jul 13 03:01:10.828227 ip-10-0-142-39 kubenswrapper[2563]: W0713 03:01:10.828181    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a77feae_62c9_449c_a6ee_c896d674943d.slice/crio-2bda2d08ed45409deda1ba6673c65d54f031325b4fb63aa3b1bdd61bf9558ddf WatchSource:0}: Error finding container 2bda2d08ed45409deda1ba6673c65d54f031325b4fb63aa3b1bdd61bf9558ddf: Status 404 returned error can't find the container with id 2bda2d08ed45409deda1ba6673c65d54f031325b4fb63aa3b1bdd61bf9558ddf
Jul 13 03:01:10.846490 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:10.846462    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5tx4z"]
Jul 13 03:01:10.849521 ip-10-0-142-39 kubenswrapper[2563]: W0713 03:01:10.849494    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb32f1a22_542e_47d1_9c40_9de1fb178864.slice/crio-64d32532513e839cd24de84f74153103847664ec9beec0540f8da47795534e9c WatchSource:0}: Error finding container 64d32532513e839cd24de84f74153103847664ec9beec0540f8da47795534e9c: Status 404 returned error can't find the container with id 64d32532513e839cd24de84f74153103847664ec9beec0540f8da47795534e9c
Jul 13 03:01:10.870339 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:10.870157    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-4pspv"]
Jul 13 03:01:10.873686 ip-10-0-142-39 kubenswrapper[2563]: W0713 03:01:10.873658    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod917248b5_3953_4ace_831e_99a59df139c1.slice/crio-fec4e1c5517f6aca73841166cb64c6ff1be763bc155ef39f8110fa2f96077ce6 WatchSource:0}: Error finding container fec4e1c5517f6aca73841166cb64c6ff1be763bc155ef39f8110fa2f96077ce6: Status 404 returned error can't find the container with id fec4e1c5517f6aca73841166cb64c6ff1be763bc155ef39f8110fa2f96077ce6
Jul 13 03:01:11.641757 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:11.641712    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-4pspv" event={"ID":"917248b5-3953-4ace-831e-99a59df139c1","Type":"ContainerStarted","Data":"fec4e1c5517f6aca73841166cb64c6ff1be763bc155ef39f8110fa2f96077ce6"}
Jul 13 03:01:11.643635 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:11.643595    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-654597fc58-2jqwg" event={"ID":"8a77feae-62c9-449c-a6ee-c896d674943d","Type":"ContainerStarted","Data":"cea06a8d2c2e2c9bf602ed5bcffe8ae1d2b29bda32a3adf1fb766bee0c565586"}
Jul 13 03:01:11.643778 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:11.643663    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-654597fc58-2jqwg" event={"ID":"8a77feae-62c9-449c-a6ee-c896d674943d","Type":"ContainerStarted","Data":"2bda2d08ed45409deda1ba6673c65d54f031325b4fb63aa3b1bdd61bf9558ddf"}
Jul 13 03:01:11.643895 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:11.643856    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-654597fc58-2jqwg"
Jul 13 03:01:11.644987 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:11.644952    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5tx4z" event={"ID":"b32f1a22-542e-47d1-9c40-9de1fb178864","Type":"ContainerStarted","Data":"64d32532513e839cd24de84f74153103847664ec9beec0540f8da47795534e9c"}
Jul 13 03:01:11.645260 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:11.645246    2563 scope.go:117] "RemoveContainer" containerID="da64c28672531f4d1a01244876371c5e66ed55049c636a722929f34c37764ddc"
Jul 13 03:01:11.645442 ip-10-0-142-39 kubenswrapper[2563]: E0713 03:01:11.645418    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-9c856c9c8-pdqzk_open-cluster-management-agent-addon(3c83f9f2-ef52-44de-888a-6273032827fe)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c856c9c8-pdqzk" podUID="3c83f9f2-ef52-44de-888a-6273032827fe"
Jul 13 03:01:11.664821 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:11.664478    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-654597fc58-2jqwg" podStartSLOduration=285.664460184 podStartE2EDuration="4m45.664460184s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 02:56:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:01:11.663674102 +0000 UTC m=+287.646464206" watchObservedRunningTime="2026-07-13 03:01:11.664460184 +0000 UTC m=+287.647250296"
Jul 13 03:01:15.372116 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:15.372088    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:15.549539 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:15.549511    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:15.663049 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:15.662958    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bn5nq" event={"ID":"6d73644f-10d2-45bc-821e-9a7c3177b107","Type":"ContainerStarted","Data":"ccf02c44a1581ac71e19e745f84b456013df91e8f1b3190f8e4c7c2aede7b8af"}
Jul 13 03:01:15.665639 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:15.665486    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5tx4z" event={"ID":"b32f1a22-542e-47d1-9c40-9de1fb178864","Type":"ContainerStarted","Data":"93af4b77a66cbb0430ded92481cb6e0b336d157459ba06bb85714b0e7a011db2"}
Jul 13 03:01:15.665639 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:15.665552    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5tx4z" event={"ID":"b32f1a22-542e-47d1-9c40-9de1fb178864","Type":"ContainerStarted","Data":"55e96f54e6667e6f154cbde5794a10896c61c0637dd67ceb583ef31c0db5b3bd"}
Jul 13 03:01:15.665639 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:15.665585    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-5tx4z"
Jul 13 03:01:15.667262 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:15.667242    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-4pspv" event={"ID":"917248b5-3953-4ace-831e-99a59df139c1","Type":"ContainerStarted","Data":"9f3752aad454553f795c48c9ec8dad0a1f221abe8a51d13f5e580778b6774dae"}
Jul 13 03:01:15.670307 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:15.670281    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:15.690593 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:15.690539    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-5tx4z" podStartSLOduration=251.752199637 podStartE2EDuration="4m15.690519507s" totalImagesPullingTime="3.93831987s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 02:57:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:01:15.68882889 +0000 UTC m=+291.671619001" watchObservedRunningTime="2026-07-13 03:01:15.690519507 +0000 UTC m=+291.673309617"
Jul 13 03:01:15.715157 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:15.715108    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-4pspv" podStartSLOduration=261.799218079 podStartE2EDuration="4m25.715087608s" totalImagesPullingTime="3.915869529s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 02:56:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:01:15.712912332 +0000 UTC m=+291.695702442" watchObservedRunningTime="2026-07-13 03:01:15.715087608 +0000 UTC m=+291.697877719"
Jul 13 03:01:15.782846 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:15.782812    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:15.881059 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:15.881037    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:15.997730 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:15.997644    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:16.098102 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:16.098070    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:16.211132 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:16.211104    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:16.312365 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:16.312339    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:16.672422 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:16.672334    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bn5nq" event={"ID":"6d73644f-10d2-45bc-821e-9a7c3177b107","Type":"ContainerStarted","Data":"4d4ebd4d497ef0ee547f3afef5d2ab2a74abec795058057ea56a5444bcdc1506"}
Jul 13 03:01:16.984263 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:16.984179    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:17.058163 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:17.058119    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:17.199441 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:17.199409    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:17.336092 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:17.336060    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:17.435286 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:17.435254    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:17.805029 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:17.805002    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:18.210794 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:18.210715    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:18.310778 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:18.310755    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:18.410758 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:18.410724    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:18.681001 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:18.680967    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bn5nq" event={"ID":"6d73644f-10d2-45bc-821e-9a7c3177b107","Type":"ContainerStarted","Data":"482b52dc043f346fb40fc4d76e9fd72ad056af6be97e3b4a5bc05becc946d457"}
Jul 13 03:01:18.702520 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:18.702450    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-bn5nq" podStartSLOduration=17.458115093 podStartE2EDuration="25.702435891s" totalImagesPullingTime="8.244320798s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 03:00:53 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:01:18.701414398 +0000 UTC m=+294.684204507" watchObservedRunningTime="2026-07-13 03:01:18.702435891 +0000 UTC m=+294.685225996"
Jul 13 03:01:18.853280 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:18.853247    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:18.930668 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:18.930644    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:19.236538 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:19.236504    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:20.527159 ip-10-0-142-39 kubenswrapper[2563]: E0713 03:01:20.527121    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-p44kl" podUID="cd0ac0dd-db5b-41c3-b69d-bcf3af528e20"
Jul 13 03:01:21.602597 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:21.602563    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:22.530152 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:22.530123    2563 scope.go:117] "RemoveContainer" containerID="d485668d7c38b1b8c298fc4f33f6e33f1c3219144eed354895fef8cf4149f379"
Jul 13 03:01:22.696914 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:22.696883    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f7ddc8b98-6mtmk" event={"ID":"1b37dc03-7412-4c20-b134-7e6865ef104c","Type":"ContainerStarted","Data":"4026a4a3a5607cec2fdf17fefa74b7e46a0ccec519e63c0d14a10c2ee928d6bb"}
Jul 13 03:01:24.012762 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:24.012736    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:24.254842 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:24.254813    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:24.297400 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:24.297377    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-vq7cc"]
Jul 13 03:01:24.300487 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:24.300470    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vq7cc"
Jul 13 03:01:24.303428 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:24.303410    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 13 03:01:24.303686 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:24.303652    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 13 03:01:24.303686 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:24.303670    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 13 03:01:24.303832 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:24.303688    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 13 03:01:24.303832 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:24.303714    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 13 03:01:24.303832 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:24.303775    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 13 03:01:24.304359 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:24.304346    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-9w62j\""
Jul 13 03:01:24.354427 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:24.354377    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:24.402311 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:24.402286    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/66a2170d-cced-4865-9429-6285f8bab2e6-node-exporter-wtmp\") pod \"node-exporter-vq7cc\" (UID: \"66a2170d-cced-4865-9429-6285f8bab2e6\") " pod="openshift-monitoring/node-exporter-vq7cc"
Jul 13 03:01:24.402423 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:24.402316    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvttp\" (UniqueName: \"kubernetes.io/projected/66a2170d-cced-4865-9429-6285f8bab2e6-kube-api-access-zvttp\") pod \"node-exporter-vq7cc\" (UID: \"66a2170d-cced-4865-9429-6285f8bab2e6\") " pod="openshift-monitoring/node-exporter-vq7cc"
Jul 13 03:01:24.402423 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:24.402339    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/66a2170d-cced-4865-9429-6285f8bab2e6-metrics-client-ca\") pod \"node-exporter-vq7cc\" (UID: \"66a2170d-cced-4865-9429-6285f8bab2e6\") " pod="openshift-monitoring/node-exporter-vq7cc"
Jul 13 03:01:24.402423 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:24.402366    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/66a2170d-cced-4865-9429-6285f8bab2e6-node-exporter-accelerators-collector-config\") pod \"node-exporter-vq7cc\" (UID: \"66a2170d-cced-4865-9429-6285f8bab2e6\") " pod="openshift-monitoring/node-exporter-vq7cc"
Jul 13 03:01:24.402423 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:24.402409    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/66a2170d-cced-4865-9429-6285f8bab2e6-sys\") pod \"node-exporter-vq7cc\" (UID: \"66a2170d-cced-4865-9429-6285f8bab2e6\") " pod="openshift-monitoring/node-exporter-vq7cc"
Jul 13 03:01:24.402561 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:24.402430    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/66a2170d-cced-4865-9429-6285f8bab2e6-root\") pod \"node-exporter-vq7cc\" (UID: \"66a2170d-cced-4865-9429-6285f8bab2e6\") " pod="openshift-monitoring/node-exporter-vq7cc"
Jul 13 03:01:24.402561 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:24.402475    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/66a2170d-cced-4865-9429-6285f8bab2e6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vq7cc\" (UID: \"66a2170d-cced-4865-9429-6285f8bab2e6\") " pod="openshift-monitoring/node-exporter-vq7cc"
Jul 13 03:01:24.402561 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:24.402493    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/66a2170d-cced-4865-9429-6285f8bab2e6-node-exporter-textfile\") pod \"node-exporter-vq7cc\" (UID: \"66a2170d-cced-4865-9429-6285f8bab2e6\") " pod="openshift-monitoring/node-exporter-vq7cc"
Jul 13 03:01:24.402561 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:24.402506    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/66a2170d-cced-4865-9429-6285f8bab2e6-node-exporter-tls\") pod \"node-exporter-vq7cc\" (UID: \"66a2170d-cced-4865-9429-6285f8bab2e6\") " pod="openshift-monitoring/node-exporter-vq7cc"
Jul 13 03:01:24.431611 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:24.431589    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v2725_a8933b47-8580-45ab-9f75-57c9a3f26842/ovn-acl-logging/0.log"
Jul 13 03:01:24.433760 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:24.433738    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v2725_a8933b47-8580-45ab-9f75-57c9a3f26842/ovn-acl-logging/0.log"
Jul 13 03:01:24.435195 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:24.435165    2563 kubelet.go:1648] "Image garbage collection succeeded"
Jul 13 03:01:24.449781 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:24.449762    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:24.503314 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:24.503181    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/66a2170d-cced-4865-9429-6285f8bab2e6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vq7cc\" (UID: \"66a2170d-cced-4865-9429-6285f8bab2e6\") " pod="openshift-monitoring/node-exporter-vq7cc"
Jul 13 03:01:24.503314 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:24.503216    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/66a2170d-cced-4865-9429-6285f8bab2e6-node-exporter-textfile\") pod \"node-exporter-vq7cc\" (UID: \"66a2170d-cced-4865-9429-6285f8bab2e6\") " pod="openshift-monitoring/node-exporter-vq7cc"
Jul 13 03:01:24.503314 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:24.503233    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/66a2170d-cced-4865-9429-6285f8bab2e6-node-exporter-tls\") pod \"node-exporter-vq7cc\" (UID: \"66a2170d-cced-4865-9429-6285f8bab2e6\") " pod="openshift-monitoring/node-exporter-vq7cc"
Jul 13 03:01:24.503314 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:24.503256    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/66a2170d-cced-4865-9429-6285f8bab2e6-node-exporter-wtmp\") pod \"node-exporter-vq7cc\" (UID: \"66a2170d-cced-4865-9429-6285f8bab2e6\") " pod="openshift-monitoring/node-exporter-vq7cc"
Jul 13 03:01:24.503314 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:24.503271    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvttp\" (UniqueName: \"kubernetes.io/projected/66a2170d-cced-4865-9429-6285f8bab2e6-kube-api-access-zvttp\") pod \"node-exporter-vq7cc\" (UID: \"66a2170d-cced-4865-9429-6285f8bab2e6\") " pod="openshift-monitoring/node-exporter-vq7cc"
Jul 13 03:01:24.503314 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:24.503292    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/66a2170d-cced-4865-9429-6285f8bab2e6-metrics-client-ca\") pod \"node-exporter-vq7cc\" (UID: \"66a2170d-cced-4865-9429-6285f8bab2e6\") " pod="openshift-monitoring/node-exporter-vq7cc"
Jul 13 03:01:24.526334 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:24.503319    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/66a2170d-cced-4865-9429-6285f8bab2e6-node-exporter-accelerators-collector-config\") pod \"node-exporter-vq7cc\" (UID: \"66a2170d-cced-4865-9429-6285f8bab2e6\") " pod="openshift-monitoring/node-exporter-vq7cc"
Jul 13 03:01:24.526334 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:24.503397    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/66a2170d-cced-4865-9429-6285f8bab2e6-node-exporter-wtmp\") pod \"node-exporter-vq7cc\" (UID: \"66a2170d-cced-4865-9429-6285f8bab2e6\") " pod="openshift-monitoring/node-exporter-vq7cc"
Jul 13 03:01:24.526334 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:24.503420    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/66a2170d-cced-4865-9429-6285f8bab2e6-sys\") pod \"node-exporter-vq7cc\" (UID: \"66a2170d-cced-4865-9429-6285f8bab2e6\") " pod="openshift-monitoring/node-exporter-vq7cc"
Jul 13 03:01:24.526334 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:24.503463    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/66a2170d-cced-4865-9429-6285f8bab2e6-root\") pod \"node-exporter-vq7cc\" (UID: \"66a2170d-cced-4865-9429-6285f8bab2e6\") " pod="openshift-monitoring/node-exporter-vq7cc"
Jul 13 03:01:24.526334 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:24.503493    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/66a2170d-cced-4865-9429-6285f8bab2e6-sys\") pod \"node-exporter-vq7cc\" (UID: \"66a2170d-cced-4865-9429-6285f8bab2e6\") " pod="openshift-monitoring/node-exporter-vq7cc"
Jul 13 03:01:24.526334 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:24.503539    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/66a2170d-cced-4865-9429-6285f8bab2e6-node-exporter-textfile\") pod \"node-exporter-vq7cc\" (UID: \"66a2170d-cced-4865-9429-6285f8bab2e6\") " pod="openshift-monitoring/node-exporter-vq7cc"
Jul 13 03:01:24.526334 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:24.503543    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/66a2170d-cced-4865-9429-6285f8bab2e6-root\") pod \"node-exporter-vq7cc\" (UID: \"66a2170d-cced-4865-9429-6285f8bab2e6\") " pod="openshift-monitoring/node-exporter-vq7cc"
Jul 13 03:01:24.526334 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:24.505650    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 13 03:01:24.526334 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:24.505849    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 13 03:01:24.526334 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:24.505923    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 13 03:01:24.526334 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:24.505954    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 13 03:01:24.526334 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:24.510605    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 13 03:01:24.526334 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:24.514141    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/66a2170d-cced-4865-9429-6285f8bab2e6-node-exporter-accelerators-collector-config\") pod \"node-exporter-vq7cc\" (UID: \"66a2170d-cced-4865-9429-6285f8bab2e6\") " pod="openshift-monitoring/node-exporter-vq7cc"
Jul 13 03:01:24.526334 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:24.514145    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/66a2170d-cced-4865-9429-6285f8bab2e6-metrics-client-ca\") pod \"node-exporter-vq7cc\" (UID: \"66a2170d-cced-4865-9429-6285f8bab2e6\") " pod="openshift-monitoring/node-exporter-vq7cc"
Jul 13 03:01:24.526334 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:24.515728    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/66a2170d-cced-4865-9429-6285f8bab2e6-node-exporter-tls\") pod \"node-exporter-vq7cc\" (UID: \"66a2170d-cced-4865-9429-6285f8bab2e6\") " pod="openshift-monitoring/node-exporter-vq7cc"
Jul 13 03:01:24.526334 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:24.516200    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/66a2170d-cced-4865-9429-6285f8bab2e6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vq7cc\" (UID: \"66a2170d-cced-4865-9429-6285f8bab2e6\") " pod="openshift-monitoring/node-exporter-vq7cc"
Jul 13 03:01:24.526334 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:24.521162    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 13 03:01:24.531322 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:24.531301    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvttp\" (UniqueName: \"kubernetes.io/projected/66a2170d-cced-4865-9429-6285f8bab2e6-kube-api-access-zvttp\") pod \"node-exporter-vq7cc\" (UID: \"66a2170d-cced-4865-9429-6285f8bab2e6\") " pod="openshift-monitoring/node-exporter-vq7cc"
Jul 13 03:01:24.612678 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:24.612605    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-9w62j\""
Jul 13 03:01:24.620598 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:24.620575    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vq7cc"
Jul 13 03:01:24.630140 ip-10-0-142-39 kubenswrapper[2563]: W0713 03:01:24.630114    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66a2170d_cced_4865_9429_6285f8bab2e6.slice/crio-e2177b3254eb51b0156efb14076fa8a5c380af76c1a4ccbaea0ab73fd3b49209 WatchSource:0}: Error finding container e2177b3254eb51b0156efb14076fa8a5c380af76c1a4ccbaea0ab73fd3b49209: Status 404 returned error can't find the container with id e2177b3254eb51b0156efb14076fa8a5c380af76c1a4ccbaea0ab73fd3b49209
Jul 13 03:01:24.638772 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:24.638751    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:24.702945 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:24.702900    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vq7cc" event={"ID":"66a2170d-cced-4865-9429-6285f8bab2e6","Type":"ContainerStarted","Data":"e2177b3254eb51b0156efb14076fa8a5c380af76c1a4ccbaea0ab73fd3b49209"}
Jul 13 03:01:24.736029 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:24.736006    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:24.841051 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:24.841021    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:24.936730 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:24.936665    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:25.043159 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:25.043127    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:25.245630 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:25.245541    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:25.318135 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:25.318107    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:25.675249 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:25.675224    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-5tx4z"
Jul 13 03:01:25.708464 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:25.708418    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vq7cc" event={"ID":"66a2170d-cced-4865-9429-6285f8bab2e6","Type":"ContainerStarted","Data":"619eef1cdc041f7bb790355cb7225ae98ab777a780cd58f579f8fcff45883774"}
Jul 13 03:01:25.873314 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:25.873233    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:26.530005 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:26.529980    2563 scope.go:117] "RemoveContainer" containerID="da64c28672531f4d1a01244876371c5e66ed55049c636a722929f34c37764ddc"
Jul 13 03:01:26.714154 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:26.714118    2563 generic.go:356] "Generic (PLEG): container finished" podID="66a2170d-cced-4865-9429-6285f8bab2e6" containerID="619eef1cdc041f7bb790355cb7225ae98ab777a780cd58f579f8fcff45883774" exitCode=0
Jul 13 03:01:26.714326 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:26.714213    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vq7cc" event={"ID":"66a2170d-cced-4865-9429-6285f8bab2e6","Type":"ContainerDied","Data":"619eef1cdc041f7bb790355cb7225ae98ab777a780cd58f579f8fcff45883774"}
Jul 13 03:01:26.716119 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:26.716097    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c856c9c8-pdqzk" event={"ID":"3c83f9f2-ef52-44de-888a-6273032827fe","Type":"ContainerStarted","Data":"9631af35f33b5c32f5fce93d8bcf5d275bf71e2ed2d409a953c845055d5441c5"}
Jul 13 03:01:26.716390 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:26.716374    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c856c9c8-pdqzk"
Jul 13 03:01:26.717732 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:26.717702    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c856c9c8-pdqzk"
Jul 13 03:01:27.213169 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:27.213140    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:27.721416 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:27.721376    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vq7cc" event={"ID":"66a2170d-cced-4865-9429-6285f8bab2e6","Type":"ContainerStarted","Data":"a9794dd6f1917b940209ad6d560449a4ea1eb33d0efa67470458bff0b986478f"}
Jul 13 03:01:27.721787 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:27.721436    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vq7cc" event={"ID":"66a2170d-cced-4865-9429-6285f8bab2e6","Type":"ContainerStarted","Data":"549383056b5b586fdceb656ff818771912fcd0a89fc81abf81f93bac0ce98f8e"}
Jul 13 03:01:27.741329 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:27.741289    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-vq7cc" podStartSLOduration=2.708605079 podStartE2EDuration="3.741275472s" totalImagesPullingTime="962.005394ms" totalInitContainerRuntime="70.664999ms" isStatefulPod=true podCreationTimestamp="2026-07-13 03:01:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:01:27.740231837 +0000 UTC m=+303.723021945" watchObservedRunningTime="2026-07-13 03:01:27.741275472 +0000 UTC m=+303.724065644"
Jul 13 03:01:28.616208 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:28.616179    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:29.029606 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:29.029539    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:29.128413 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:29.128386    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:29.228636 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:29.228615    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:30.602427 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:30.602396    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:30.626992 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:30.626964    2563 patch_prober.go:28] interesting pod/image-registry-654597fc58-2jqwg container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 13 03:01:30.627114 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:30.627009    2563 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-654597fc58-2jqwg" podUID="8a77feae-62c9-449c-a6ee-c896d674943d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 03:01:30.720699 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:30.720670    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:30.850045 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:30.850014    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:32.525740 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:32.525711    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p44kl"
Jul 13 03:01:32.653698 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:32.653670    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-654597fc58-2jqwg"
Jul 13 03:01:32.944454 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:32.944424    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:33.011282 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:33.011249    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:33.289629 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:33.289550    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:33.354626 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:33.354596    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:34.422993 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:34.422967    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:34.525257 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:34.525230    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:34.811320 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:34.811292    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:34.893754 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:34.893730    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:35.134140 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:35.134057    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:35.193404 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:35.193371    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:37.525906 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:37.525878    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-654597fc58-2jqwg"]
Jul 13 03:01:37.602144 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:37.602118    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:37.700961 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:37.700917    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:37.822645 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:37.822614    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:37.919330 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:37.919297    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:39.879539 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:39.879506    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:39.979988 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:39.979959    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:40.082073 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:40.082042    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:44.473956 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:44.473904    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:44.572605 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:44.572575    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:48.281229 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:48.281199    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:48.382611 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:48.382578    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:49.332440 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:49.332415    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:49.432506 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:49.432484    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:01:49.532322 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:01:49.532301    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:02:02.545714 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:02:02.545673    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-654597fc58-2jqwg" podUID="8a77feae-62c9-449c-a6ee-c896d674943d" containerName="registry" containerID="cri-o://cea06a8d2c2e2c9bf602ed5bcffe8ae1d2b29bda32a3adf1fb766bee0c565586" gracePeriod=30
Jul 13 03:02:02.649680 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:02:02.649650    2563 patch_prober.go:28] interesting pod/image-registry-654597fc58-2jqwg container/registry namespace/openshift-image-registry: Readiness probe status=failure output="Get \"https://10.132.0.6:5000/healthz\": dial tcp 10.132.0.6:5000: connect: connection refused" start-of-body=
Jul 13 03:02:02.649855 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:02:02.649692    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-654597fc58-2jqwg" podUID="8a77feae-62c9-449c-a6ee-c896d674943d" containerName="registry" probeResult="failure" output="Get \"https://10.132.0.6:5000/healthz\": dial tcp 10.132.0.6:5000: connect: connection refused"
Jul 13 03:02:02.792681 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:02:02.792653    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-654597fc58-2jqwg"
Jul 13 03:02:02.836271 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:02:02.836197    2563 generic.go:356] "Generic (PLEG): container finished" podID="8a77feae-62c9-449c-a6ee-c896d674943d" containerID="cea06a8d2c2e2c9bf602ed5bcffe8ae1d2b29bda32a3adf1fb766bee0c565586" exitCode=0
Jul 13 03:02:02.836271 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:02:02.836242    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-654597fc58-2jqwg"
Jul 13 03:02:02.836271 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:02:02.836265    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-654597fc58-2jqwg" event={"ID":"8a77feae-62c9-449c-a6ee-c896d674943d","Type":"ContainerDied","Data":"cea06a8d2c2e2c9bf602ed5bcffe8ae1d2b29bda32a3adf1fb766bee0c565586"}
Jul 13 03:02:02.836521 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:02:02.836315    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-654597fc58-2jqwg" event={"ID":"8a77feae-62c9-449c-a6ee-c896d674943d","Type":"ContainerDied","Data":"2bda2d08ed45409deda1ba6673c65d54f031325b4fb63aa3b1bdd61bf9558ddf"}
Jul 13 03:02:02.836521 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:02:02.836340    2563 scope.go:117] "RemoveContainer" containerID="cea06a8d2c2e2c9bf602ed5bcffe8ae1d2b29bda32a3adf1fb766bee0c565586"
Jul 13 03:02:02.843848 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:02:02.843831    2563 scope.go:117] "RemoveContainer" containerID="cea06a8d2c2e2c9bf602ed5bcffe8ae1d2b29bda32a3adf1fb766bee0c565586"
Jul 13 03:02:02.844105 ip-10-0-142-39 kubenswrapper[2563]: E0713 03:02:02.844086    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cea06a8d2c2e2c9bf602ed5bcffe8ae1d2b29bda32a3adf1fb766bee0c565586\": container with ID starting with cea06a8d2c2e2c9bf602ed5bcffe8ae1d2b29bda32a3adf1fb766bee0c565586 not found: ID does not exist" containerID="cea06a8d2c2e2c9bf602ed5bcffe8ae1d2b29bda32a3adf1fb766bee0c565586"
Jul 13 03:02:02.844180 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:02:02.844125    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cea06a8d2c2e2c9bf602ed5bcffe8ae1d2b29bda32a3adf1fb766bee0c565586"} err="failed to get container status \"cea06a8d2c2e2c9bf602ed5bcffe8ae1d2b29bda32a3adf1fb766bee0c565586\": rpc error: code = NotFound desc = could not find container \"cea06a8d2c2e2c9bf602ed5bcffe8ae1d2b29bda32a3adf1fb766bee0c565586\": container with ID starting with cea06a8d2c2e2c9bf602ed5bcffe8ae1d2b29bda32a3adf1fb766bee0c565586 not found: ID does not exist"
Jul 13 03:02:02.879617 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:02:02.879594    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8a77feae-62c9-449c-a6ee-c896d674943d-installation-pull-secrets\") pod \"8a77feae-62c9-449c-a6ee-c896d674943d\" (UID: \"8a77feae-62c9-449c-a6ee-c896d674943d\") "
Jul 13 03:02:02.879724 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:02:02.879638    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8a77feae-62c9-449c-a6ee-c896d674943d-registry-certificates\") pod \"8a77feae-62c9-449c-a6ee-c896d674943d\" (UID: \"8a77feae-62c9-449c-a6ee-c896d674943d\") "
Jul 13 03:02:02.879724 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:02:02.879667    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8a77feae-62c9-449c-a6ee-c896d674943d-bound-sa-token\") pod \"8a77feae-62c9-449c-a6ee-c896d674943d\" (UID: \"8a77feae-62c9-449c-a6ee-c896d674943d\") "
Jul 13 03:02:02.879724 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:02:02.879701    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8a77feae-62c9-449c-a6ee-c896d674943d-trusted-ca\") pod \"8a77feae-62c9-449c-a6ee-c896d674943d\" (UID: \"8a77feae-62c9-449c-a6ee-c896d674943d\") "
Jul 13 03:02:02.879875 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:02:02.879735    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8a77feae-62c9-449c-a6ee-c896d674943d-image-registry-private-configuration\") pod \"8a77feae-62c9-449c-a6ee-c896d674943d\" (UID: \"8a77feae-62c9-449c-a6ee-c896d674943d\") "
Jul 13 03:02:02.879875 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:02:02.879769    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8a77feae-62c9-449c-a6ee-c896d674943d-registry-tls\") pod \"8a77feae-62c9-449c-a6ee-c896d674943d\" (UID: \"8a77feae-62c9-449c-a6ee-c896d674943d\") "
Jul 13 03:02:02.879875 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:02:02.879804    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8a77feae-62c9-449c-a6ee-c896d674943d-ca-trust-extracted\") pod \"8a77feae-62c9-449c-a6ee-c896d674943d\" (UID: \"8a77feae-62c9-449c-a6ee-c896d674943d\") "
Jul 13 03:02:02.879875 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:02:02.879834    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-skghx\" (UniqueName: \"kubernetes.io/projected/8a77feae-62c9-449c-a6ee-c896d674943d-kube-api-access-skghx\") pod \"8a77feae-62c9-449c-a6ee-c896d674943d\" (UID: \"8a77feae-62c9-449c-a6ee-c896d674943d\") "
Jul 13 03:02:02.880132 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:02:02.880063    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a77feae-62c9-449c-a6ee-c896d674943d-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "8a77feae-62c9-449c-a6ee-c896d674943d" (UID: "8a77feae-62c9-449c-a6ee-c896d674943d"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 03:02:02.880865 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:02:02.880823    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a77feae-62c9-449c-a6ee-c896d674943d-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "8a77feae-62c9-449c-a6ee-c896d674943d" (UID: "8a77feae-62c9-449c-a6ee-c896d674943d"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 03:02:02.882301 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:02:02.882281    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a77feae-62c9-449c-a6ee-c896d674943d-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "8a77feae-62c9-449c-a6ee-c896d674943d" (UID: "8a77feae-62c9-449c-a6ee-c896d674943d"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 03:02:02.882401 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:02:02.882294    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a77feae-62c9-449c-a6ee-c896d674943d-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "8a77feae-62c9-449c-a6ee-c896d674943d" (UID: "8a77feae-62c9-449c-a6ee-c896d674943d"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 03:02:02.882509 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:02:02.882483    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a77feae-62c9-449c-a6ee-c896d674943d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "8a77feae-62c9-449c-a6ee-c896d674943d" (UID: "8a77feae-62c9-449c-a6ee-c896d674943d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 03:02:02.882556 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:02:02.882492    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a77feae-62c9-449c-a6ee-c896d674943d-kube-api-access-skghx" (OuterVolumeSpecName: "kube-api-access-skghx") pod "8a77feae-62c9-449c-a6ee-c896d674943d" (UID: "8a77feae-62c9-449c-a6ee-c896d674943d"). InnerVolumeSpecName "kube-api-access-skghx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 03:02:02.882595 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:02:02.882551    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a77feae-62c9-449c-a6ee-c896d674943d-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "8a77feae-62c9-449c-a6ee-c896d674943d" (UID: "8a77feae-62c9-449c-a6ee-c896d674943d"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 03:02:02.888843 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:02:02.888819    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a77feae-62c9-449c-a6ee-c896d674943d-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "8a77feae-62c9-449c-a6ee-c896d674943d" (UID: "8a77feae-62c9-449c-a6ee-c896d674943d"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 03:02:02.981348 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:02:02.981323    2563 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8a77feae-62c9-449c-a6ee-c896d674943d-installation-pull-secrets\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 13 03:02:02.981348 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:02:02.981344    2563 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8a77feae-62c9-449c-a6ee-c896d674943d-registry-certificates\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 13 03:02:02.981511 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:02:02.981356    2563 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8a77feae-62c9-449c-a6ee-c896d674943d-bound-sa-token\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 13 03:02:02.981511 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:02:02.981364    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8a77feae-62c9-449c-a6ee-c896d674943d-trusted-ca\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 13 03:02:02.981511 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:02:02.981372    2563 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8a77feae-62c9-449c-a6ee-c896d674943d-image-registry-private-configuration\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 13 03:02:02.981511 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:02:02.981381    2563 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8a77feae-62c9-449c-a6ee-c896d674943d-registry-tls\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 13 03:02:02.981511 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:02:02.981389    2563 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8a77feae-62c9-449c-a6ee-c896d674943d-ca-trust-extracted\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 13 03:02:02.981511 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:02:02.981397    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-skghx\" (UniqueName: \"kubernetes.io/projected/8a77feae-62c9-449c-a6ee-c896d674943d-kube-api-access-skghx\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 13 03:02:03.161987 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:02:03.160746    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-654597fc58-2jqwg"]
Jul 13 03:02:03.164049 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:02:03.164026    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-654597fc58-2jqwg"]
Jul 13 03:02:04.529838 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:02:04.529811    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a77feae-62c9-449c-a6ee-c896d674943d" path="/var/lib/kubelet/pods/8a77feae-62c9-449c-a6ee-c896d674943d/volumes"
Jul 13 03:02:07.250121 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:02:07.250090    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:02:10.740693 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:02:10.740657    2563 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66c9ddcf4c-zjjkf" podUID="e7b90bb5-05ef-4ae5-af93-553c55d28775" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 13 03:02:20.741349 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:02:20.741259    2563 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66c9ddcf4c-zjjkf" podUID="e7b90bb5-05ef-4ae5-af93-553c55d28775" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 13 03:02:30.740622 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:02:30.740581    2563 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66c9ddcf4c-zjjkf" podUID="e7b90bb5-05ef-4ae5-af93-553c55d28775" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 13 03:02:30.740999 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:02:30.740651    2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66c9ddcf4c-zjjkf"
Jul 13 03:02:30.741070 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:02:30.741049    2563 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"b5c7e8be892404a01bde97828b1ca538900818fa517ef145740669846422e6da"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66c9ddcf4c-zjjkf" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Jul 13 03:02:30.741108 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:02:30.741091    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66c9ddcf4c-zjjkf" podUID="e7b90bb5-05ef-4ae5-af93-553c55d28775" containerName="service-proxy" containerID="cri-o://b5c7e8be892404a01bde97828b1ca538900818fa517ef145740669846422e6da" gracePeriod=30
Jul 13 03:02:30.930964 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:02:30.930919    2563 generic.go:356] "Generic (PLEG): container finished" podID="e7b90bb5-05ef-4ae5-af93-553c55d28775" containerID="b5c7e8be892404a01bde97828b1ca538900818fa517ef145740669846422e6da" exitCode=2
Jul 13 03:02:30.931113 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:02:30.930975    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66c9ddcf4c-zjjkf" event={"ID":"e7b90bb5-05ef-4ae5-af93-553c55d28775","Type":"ContainerDied","Data":"b5c7e8be892404a01bde97828b1ca538900818fa517ef145740669846422e6da"}
Jul 13 03:02:30.931113 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:02:30.931030    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66c9ddcf4c-zjjkf" event={"ID":"e7b90bb5-05ef-4ae5-af93-553c55d28775","Type":"ContainerStarted","Data":"257da0569003a77c37e9015ba4f21dca8d6ed4e30e9b3c28919eac3414d00a56"}
Jul 13 03:02:38.415703 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:02:38.415674    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd0ac0dd-db5b-41c3-b69d-bcf3af528e20-metrics-certs\") pod \"network-metrics-daemon-p44kl\" (UID: \"cd0ac0dd-db5b-41c3-b69d-bcf3af528e20\") " pod="openshift-multus/network-metrics-daemon-p44kl"
Jul 13 03:02:38.418069 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:02:38.418048    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd0ac0dd-db5b-41c3-b69d-bcf3af528e20-metrics-certs\") pod \"network-metrics-daemon-p44kl\" (UID: \"cd0ac0dd-db5b-41c3-b69d-bcf3af528e20\") " pod="openshift-multus/network-metrics-daemon-p44kl"
Jul 13 03:02:38.529965 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:02:38.529920    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8nlv8\""
Jul 13 03:02:38.536982 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:02:38.536964    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p44kl"
Jul 13 03:02:38.655517 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:02:38.655438    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-p44kl"]
Jul 13 03:02:38.659123 ip-10-0-142-39 kubenswrapper[2563]: W0713 03:02:38.659097    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd0ac0dd_db5b_41c3_b69d_bcf3af528e20.slice/crio-5764dd3c26367858c0eed35239751367ca99b60b6f46dc41d130e90b590fb7ff WatchSource:0}: Error finding container 5764dd3c26367858c0eed35239751367ca99b60b6f46dc41d130e90b590fb7ff: Status 404 returned error can't find the container with id 5764dd3c26367858c0eed35239751367ca99b60b6f46dc41d130e90b590fb7ff
Jul 13 03:02:38.661055 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:02:38.661040    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 03:02:38.959008 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:02:38.958976    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-p44kl" event={"ID":"cd0ac0dd-db5b-41c3-b69d-bcf3af528e20","Type":"ContainerStarted","Data":"5764dd3c26367858c0eed35239751367ca99b60b6f46dc41d130e90b590fb7ff"}
Jul 13 03:02:39.964345 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:02:39.964254    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-p44kl" event={"ID":"cd0ac0dd-db5b-41c3-b69d-bcf3af528e20","Type":"ContainerStarted","Data":"a973f992ba84d9fa9fd369bf6dc934c672959ba48766c7f0792bded01b3c27f3"}
Jul 13 03:02:39.964345 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:02:39.964303    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-p44kl" event={"ID":"cd0ac0dd-db5b-41c3-b69d-bcf3af528e20","Type":"ContainerStarted","Data":"e14f614145502f1539d9a05b2421dc76e563e01e20385eba24b734feaf860672"}
Jul 13 03:02:39.980331 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:02:39.980287    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-p44kl" podStartSLOduration=373.932747964 podStartE2EDuration="6m14.980270248s" totalImagesPullingTime="1.047522284s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 02:56:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:02:39.979202084 +0000 UTC m=+375.961992195" watchObservedRunningTime="2026-07-13 03:02:39.980270248 +0000 UTC m=+375.963060356"
Jul 13 03:02:40.068146 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:02:40.068116    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:02:40.126406 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:02:40.126376    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:02:40.382458 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:02:40.382431    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:02:40.441651 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:02:40.441619    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:02:52.281107 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:02:52.281075    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:02:52.381143 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:02:52.381114    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:02:53.651346 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:02:53.651312    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:02:53.727396 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:02:53.727351    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:03:03.287530 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:03:03.287492    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:03:03.387431 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:03:03.387394    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:03:04.576184 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:03:04.576155    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:03:04.685792 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:03:04.685756    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:03:04.783960 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:03:04.783913    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:03:44.950057 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:03:44.950020    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:03:45.005373 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:03:45.005347    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:03:45.174632 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:03:45.174607    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:03:45.538915 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:03:45.538873    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:03:45.641887 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:03:45.641836    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:04:12.199279 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:04:12.199243    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:04:12.445852 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:04:12.445820    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:04:13.022988 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:04:13.022955    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:04:15.810339 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:04:15.810300    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:04:15.912851 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:04:15.912815    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:04:16.837894 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:04:16.837862    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:04:16.940771 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:04:16.940745    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:04:17.146479 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:04:17.146398    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:04:17.267220 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:04:17.267186    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:04:19.241238 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:04:19.241209    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:04:19.471314 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:04:19.471287    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:04:22.397583 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:04:22.397545    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:04:22.458404 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:04:22.458375    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:04:27.062985 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:04:27.062951    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:04:29.680222 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:04:29.680171    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:04:29.775974 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:04:29.775924    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:04:31.456285 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:04:31.456250    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h4gqd"]
Jul 13 03:04:31.456691 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:04:31.456471    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a77feae-62c9-449c-a6ee-c896d674943d" containerName="registry"
Jul 13 03:04:31.456691 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:04:31.456492    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a77feae-62c9-449c-a6ee-c896d674943d" containerName="registry"
Jul 13 03:04:31.456691 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:04:31.456534    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a77feae-62c9-449c-a6ee-c896d674943d" containerName="registry"
Jul 13 03:04:31.459115 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:04:31.459100    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h4gqd"
Jul 13 03:04:31.461487 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:04:31.461465    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 13 03:04:31.461620 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:04:31.461553    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-nqmhp\""
Jul 13 03:04:31.462239 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:04:31.462223    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 13 03:04:31.466571 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:04:31.466548    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h4gqd"]
Jul 13 03:04:31.552963 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:04:31.552916    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vbj9\" (UniqueName: \"kubernetes.io/projected/368d5c78-3bd8-4c0d-a975-cb82145c2147-kube-api-access-6vbj9\") pod \"openshift-lws-operator-fd8ccff4c-h4gqd\" (UID: \"368d5c78-3bd8-4c0d-a975-cb82145c2147\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h4gqd"
Jul 13 03:04:31.553099 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:04:31.552968    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/368d5c78-3bd8-4c0d-a975-cb82145c2147-tmp\") pod \"openshift-lws-operator-fd8ccff4c-h4gqd\" (UID: \"368d5c78-3bd8-4c0d-a975-cb82145c2147\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h4gqd"
Jul 13 03:04:31.653723 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:04:31.653682    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vbj9\" (UniqueName: \"kubernetes.io/projected/368d5c78-3bd8-4c0d-a975-cb82145c2147-kube-api-access-6vbj9\") pod \"openshift-lws-operator-fd8ccff4c-h4gqd\" (UID: \"368d5c78-3bd8-4c0d-a975-cb82145c2147\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h4gqd"
Jul 13 03:04:31.653723 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:04:31.653729    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/368d5c78-3bd8-4c0d-a975-cb82145c2147-tmp\") pod \"openshift-lws-operator-fd8ccff4c-h4gqd\" (UID: \"368d5c78-3bd8-4c0d-a975-cb82145c2147\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h4gqd"
Jul 13 03:04:31.654059 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:04:31.654044    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/368d5c78-3bd8-4c0d-a975-cb82145c2147-tmp\") pod \"openshift-lws-operator-fd8ccff4c-h4gqd\" (UID: \"368d5c78-3bd8-4c0d-a975-cb82145c2147\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h4gqd"
Jul 13 03:04:31.662203 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:04:31.662183    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vbj9\" (UniqueName: \"kubernetes.io/projected/368d5c78-3bd8-4c0d-a975-cb82145c2147-kube-api-access-6vbj9\") pod \"openshift-lws-operator-fd8ccff4c-h4gqd\" (UID: \"368d5c78-3bd8-4c0d-a975-cb82145c2147\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h4gqd"
Jul 13 03:04:31.768258 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:04:31.768168    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h4gqd"
Jul 13 03:04:31.890118 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:04:31.890085    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h4gqd"]
Jul 13 03:04:31.893770 ip-10-0-142-39 kubenswrapper[2563]: W0713 03:04:31.893747    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod368d5c78_3bd8_4c0d_a975_cb82145c2147.slice/crio-9d50b1de283a3f35ccf8b0020aa760f0e8d16c6ac5276f390b562d0e1182a6a6 WatchSource:0}: Error finding container 9d50b1de283a3f35ccf8b0020aa760f0e8d16c6ac5276f390b562d0e1182a6a6: Status 404 returned error can't find the container with id 9d50b1de283a3f35ccf8b0020aa760f0e8d16c6ac5276f390b562d0e1182a6a6
Jul 13 03:04:32.324845 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:04:32.324810    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h4gqd" event={"ID":"368d5c78-3bd8-4c0d-a975-cb82145c2147","Type":"ContainerStarted","Data":"9d50b1de283a3f35ccf8b0020aa760f0e8d16c6ac5276f390b562d0e1182a6a6"}
Jul 13 03:04:43.363252 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:04:43.363214    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h4gqd" event={"ID":"368d5c78-3bd8-4c0d-a975-cb82145c2147","Type":"ContainerStarted","Data":"d372be9599e432398e581bc1438e5846cb038c899ff2e18ab011b5c2eae8a7ee"}
Jul 13 03:04:43.378753 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:04:43.378700    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h4gqd" podStartSLOduration=1.734463506 podStartE2EDuration="12.378678584s" totalImagesPullingTime="10.644215078s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:04:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:04:43.377609515 +0000 UTC m=+499.360399627" watchObservedRunningTime="2026-07-13 03:04:43.378678584 +0000 UTC m=+499.361468693"
Jul 13 03:04:44.179767 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:04:44.179712    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:04:44.232401 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:04:44.232365    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:04:46.280580 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:04:46.280540    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:04:53.674326 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:04:53.674290    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:04:53.733902 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:04:53.733877    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:05:00.594326 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:00.594294    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:05:00.689493 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:00.689464    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:05:01.040712 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:01.040633    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:05:01.316034 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:01.316006    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:05:01.417156 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:01.417131    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:05:01.430425 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:01.430401    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7dcb9ff95f-9xp5r"]
Jul 13 03:05:01.436438 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:01.436416    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7dcb9ff95f-9xp5r"
Jul 13 03:05:01.439632 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:01.439610    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 13 03:05:01.439746 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:01.439706    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 13 03:05:01.439816 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:01.439805    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 13 03:05:01.440002 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:01.439987    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 13 03:05:01.440083 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:01.440007    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-4gp7m\""
Jul 13 03:05:01.446644 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:01.446625    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7dcb9ff95f-9xp5r"]
Jul 13 03:05:01.551941 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:01.551913    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/701e0cbb-36f3-4c1f-861d-580c18b3fd4b-tmp\") pod \"opendatahub-operator-controller-manager-7dcb9ff95f-9xp5r\" (UID: \"701e0cbb-36f3-4c1f-861d-580c18b3fd4b\") " pod="opendatahub/opendatahub-operator-controller-manager-7dcb9ff95f-9xp5r"
Jul 13 03:05:01.552056 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:01.551965    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbl7s\" (UniqueName: \"kubernetes.io/projected/701e0cbb-36f3-4c1f-861d-580c18b3fd4b-kube-api-access-vbl7s\") pod \"opendatahub-operator-controller-manager-7dcb9ff95f-9xp5r\" (UID: \"701e0cbb-36f3-4c1f-861d-580c18b3fd4b\") " pod="opendatahub/opendatahub-operator-controller-manager-7dcb9ff95f-9xp5r"
Jul 13 03:05:01.552056 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:01.552002    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/701e0cbb-36f3-4c1f-861d-580c18b3fd4b-webhook-cert\") pod \"opendatahub-operator-controller-manager-7dcb9ff95f-9xp5r\" (UID: \"701e0cbb-36f3-4c1f-861d-580c18b3fd4b\") " pod="opendatahub/opendatahub-operator-controller-manager-7dcb9ff95f-9xp5r"
Jul 13 03:05:01.552056 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:01.552039    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/701e0cbb-36f3-4c1f-861d-580c18b3fd4b-manifests\") pod \"opendatahub-operator-controller-manager-7dcb9ff95f-9xp5r\" (UID: \"701e0cbb-36f3-4c1f-861d-580c18b3fd4b\") " pod="opendatahub/opendatahub-operator-controller-manager-7dcb9ff95f-9xp5r"
Jul 13 03:05:01.552185 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:01.552107    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/701e0cbb-36f3-4c1f-861d-580c18b3fd4b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7dcb9ff95f-9xp5r\" (UID: \"701e0cbb-36f3-4c1f-861d-580c18b3fd4b\") " pod="opendatahub/opendatahub-operator-controller-manager-7dcb9ff95f-9xp5r"
Jul 13 03:05:01.569230 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:01.569179    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:05:01.652948 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:01.652904    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbl7s\" (UniqueName: \"kubernetes.io/projected/701e0cbb-36f3-4c1f-861d-580c18b3fd4b-kube-api-access-vbl7s\") pod \"opendatahub-operator-controller-manager-7dcb9ff95f-9xp5r\" (UID: \"701e0cbb-36f3-4c1f-861d-580c18b3fd4b\") " pod="opendatahub/opendatahub-operator-controller-manager-7dcb9ff95f-9xp5r"
Jul 13 03:05:01.653319 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:01.652961    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/701e0cbb-36f3-4c1f-861d-580c18b3fd4b-webhook-cert\") pod \"opendatahub-operator-controller-manager-7dcb9ff95f-9xp5r\" (UID: \"701e0cbb-36f3-4c1f-861d-580c18b3fd4b\") " pod="opendatahub/opendatahub-operator-controller-manager-7dcb9ff95f-9xp5r"
Jul 13 03:05:01.653319 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:01.652995    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/701e0cbb-36f3-4c1f-861d-580c18b3fd4b-manifests\") pod \"opendatahub-operator-controller-manager-7dcb9ff95f-9xp5r\" (UID: \"701e0cbb-36f3-4c1f-861d-580c18b3fd4b\") " pod="opendatahub/opendatahub-operator-controller-manager-7dcb9ff95f-9xp5r"
Jul 13 03:05:01.653319 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:01.653027    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/701e0cbb-36f3-4c1f-861d-580c18b3fd4b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7dcb9ff95f-9xp5r\" (UID: \"701e0cbb-36f3-4c1f-861d-580c18b3fd4b\") " pod="opendatahub/opendatahub-operator-controller-manager-7dcb9ff95f-9xp5r"
Jul 13 03:05:01.653319 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:01.653048    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/701e0cbb-36f3-4c1f-861d-580c18b3fd4b-tmp\") pod \"opendatahub-operator-controller-manager-7dcb9ff95f-9xp5r\" (UID: \"701e0cbb-36f3-4c1f-861d-580c18b3fd4b\") " pod="opendatahub/opendatahub-operator-controller-manager-7dcb9ff95f-9xp5r"
Jul 13 03:05:01.653510 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:01.653426    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/701e0cbb-36f3-4c1f-861d-580c18b3fd4b-manifests\") pod \"opendatahub-operator-controller-manager-7dcb9ff95f-9xp5r\" (UID: \"701e0cbb-36f3-4c1f-861d-580c18b3fd4b\") " pod="opendatahub/opendatahub-operator-controller-manager-7dcb9ff95f-9xp5r"
Jul 13 03:05:01.655423 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:01.655398    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/701e0cbb-36f3-4c1f-861d-580c18b3fd4b-tmp\") pod \"opendatahub-operator-controller-manager-7dcb9ff95f-9xp5r\" (UID: \"701e0cbb-36f3-4c1f-861d-580c18b3fd4b\") " pod="opendatahub/opendatahub-operator-controller-manager-7dcb9ff95f-9xp5r"
Jul 13 03:05:01.655626 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:01.655609    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/701e0cbb-36f3-4c1f-861d-580c18b3fd4b-webhook-cert\") pod \"opendatahub-operator-controller-manager-7dcb9ff95f-9xp5r\" (UID: \"701e0cbb-36f3-4c1f-861d-580c18b3fd4b\") " pod="opendatahub/opendatahub-operator-controller-manager-7dcb9ff95f-9xp5r"
Jul 13 03:05:01.655690 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:01.655674    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/701e0cbb-36f3-4c1f-861d-580c18b3fd4b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7dcb9ff95f-9xp5r\" (UID: \"701e0cbb-36f3-4c1f-861d-580c18b3fd4b\") " pod="opendatahub/opendatahub-operator-controller-manager-7dcb9ff95f-9xp5r"
Jul 13 03:05:01.663513 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:01.663493    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbl7s\" (UniqueName: \"kubernetes.io/projected/701e0cbb-36f3-4c1f-861d-580c18b3fd4b-kube-api-access-vbl7s\") pod \"opendatahub-operator-controller-manager-7dcb9ff95f-9xp5r\" (UID: \"701e0cbb-36f3-4c1f-861d-580c18b3fd4b\") " pod="opendatahub/opendatahub-operator-controller-manager-7dcb9ff95f-9xp5r"
Jul 13 03:05:01.669453 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:01.669435    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:05:01.747656 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:01.747631    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7dcb9ff95f-9xp5r"
Jul 13 03:05:01.770391 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:01.770365    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:05:01.873808 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:01.873783    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:05:01.880602 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:01.880581    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7dcb9ff95f-9xp5r"]
Jul 13 03:05:01.883275 ip-10-0-142-39 kubenswrapper[2563]: W0713 03:05:01.883243    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod701e0cbb_36f3_4c1f_861d_580c18b3fd4b.slice/crio-ee2cb143a0de3083e28733c8dd4b0f3544bc3e0301a59c31792f45425507732b WatchSource:0}: Error finding container ee2cb143a0de3083e28733c8dd4b0f3544bc3e0301a59c31792f45425507732b: Status 404 returned error can't find the container with id ee2cb143a0de3083e28733c8dd4b0f3544bc3e0301a59c31792f45425507732b
Jul 13 03:05:01.970546 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:01.970515    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:05:02.430975 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:02.430925    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7dcb9ff95f-9xp5r" event={"ID":"701e0cbb-36f3-4c1f-861d-580c18b3fd4b","Type":"ContainerStarted","Data":"ee2cb143a0de3083e28733c8dd4b0f3544bc3e0301a59c31792f45425507732b"}
Jul 13 03:05:05.443500 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:05.443465    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7dcb9ff95f-9xp5r" event={"ID":"701e0cbb-36f3-4c1f-861d-580c18b3fd4b","Type":"ContainerStarted","Data":"cb15d95d7c760a87afa0676c519d46d3947b1107baa6cb64996ee38a86d56ff6"}
Jul 13 03:05:06.448703 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:06.448663    2563 generic.go:356] "Generic (PLEG): container finished" podID="701e0cbb-36f3-4c1f-861d-580c18b3fd4b" containerID="cb15d95d7c760a87afa0676c519d46d3947b1107baa6cb64996ee38a86d56ff6" exitCode=0
Jul 13 03:05:06.449114 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:06.448753    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7dcb9ff95f-9xp5r" event={"ID":"701e0cbb-36f3-4c1f-861d-580c18b3fd4b","Type":"ContainerDied","Data":"cb15d95d7c760a87afa0676c519d46d3947b1107baa6cb64996ee38a86d56ff6"}
Jul 13 03:05:06.563484 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:06.563453    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:05:06.629099 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:06.629069    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:05:07.454082 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:07.454047    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7dcb9ff95f-9xp5r" event={"ID":"701e0cbb-36f3-4c1f-861d-580c18b3fd4b","Type":"ContainerStarted","Data":"5fbedb134bbe9b7f4d7ba976101da7856edec7defc8ab12e39566748230fe1ac"}
Jul 13 03:05:07.454487 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:07.454184    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7dcb9ff95f-9xp5r"
Jul 13 03:05:07.479444 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:07.479393    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7dcb9ff95f-9xp5r" podStartSLOduration=2.07177163 podStartE2EDuration="6.479376516s" totalImagesPullingTime="3.383291548s" totalInitContainerRuntime="1.024313338s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:05:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:05:07.476924173 +0000 UTC m=+523.459714283" watchObservedRunningTime="2026-07-13 03:05:07.479376516 +0000 UTC m=+523.462166624"
Jul 13 03:05:18.460041 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:18.459972    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7dcb9ff95f-9xp5r"
Jul 13 03:05:20.542487 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:20.542455    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:05:20.661173 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:20.661110    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:05:21.182295 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:21.182255    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-mfvhq"]
Jul 13 03:05:21.186094 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:21.186071    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-mfvhq"
Jul 13 03:05:21.189719 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:21.189682    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 13 03:05:21.189719 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:21.189692    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-vcfnc\""
Jul 13 03:05:21.197611 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:21.197584    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-mfvhq"]
Jul 13 03:05:21.221947 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:21.221898    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:05:21.284186 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:21.284144    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:05:21.297110 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:21.297066    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvxjh\" (UniqueName: \"kubernetes.io/projected/0703ea47-f1a2-4858-9556-b85e5e159a23-kube-api-access-hvxjh\") pod \"odh-model-controller-7998c67dc4-mfvhq\" (UID: \"0703ea47-f1a2-4858-9556-b85e5e159a23\") " pod="opendatahub/odh-model-controller-7998c67dc4-mfvhq"
Jul 13 03:05:21.297110 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:21.297110    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0703ea47-f1a2-4858-9556-b85e5e159a23-cert\") pod \"odh-model-controller-7998c67dc4-mfvhq\" (UID: \"0703ea47-f1a2-4858-9556-b85e5e159a23\") " pod="opendatahub/odh-model-controller-7998c67dc4-mfvhq"
Jul 13 03:05:21.386804 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:21.386772    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:05:21.398157 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:21.398123    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvxjh\" (UniqueName: \"kubernetes.io/projected/0703ea47-f1a2-4858-9556-b85e5e159a23-kube-api-access-hvxjh\") pod \"odh-model-controller-7998c67dc4-mfvhq\" (UID: \"0703ea47-f1a2-4858-9556-b85e5e159a23\") " pod="opendatahub/odh-model-controller-7998c67dc4-mfvhq"
Jul 13 03:05:21.398313 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:21.398172    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0703ea47-f1a2-4858-9556-b85e5e159a23-cert\") pod \"odh-model-controller-7998c67dc4-mfvhq\" (UID: \"0703ea47-f1a2-4858-9556-b85e5e159a23\") " pod="opendatahub/odh-model-controller-7998c67dc4-mfvhq"
Jul 13 03:05:21.398380 ip-10-0-142-39 kubenswrapper[2563]: E0713 03:05:21.398312    2563 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 13 03:05:21.398380 ip-10-0-142-39 kubenswrapper[2563]: E0713 03:05:21.398379    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0703ea47-f1a2-4858-9556-b85e5e159a23-cert podName:0703ea47-f1a2-4858-9556-b85e5e159a23 nodeName:}" failed. No retries permitted until 2026-07-13 03:05:21.898363496 +0000 UTC m=+537.881153586 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0703ea47-f1a2-4858-9556-b85e5e159a23-cert") pod "odh-model-controller-7998c67dc4-mfvhq" (UID: "0703ea47-f1a2-4858-9556-b85e5e159a23") : secret "odh-model-controller-webhook-cert" not found
Jul 13 03:05:21.407351 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:21.407320    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvxjh\" (UniqueName: \"kubernetes.io/projected/0703ea47-f1a2-4858-9556-b85e5e159a23-kube-api-access-hvxjh\") pod \"odh-model-controller-7998c67dc4-mfvhq\" (UID: \"0703ea47-f1a2-4858-9556-b85e5e159a23\") " pod="opendatahub/odh-model-controller-7998c67dc4-mfvhq"
Jul 13 03:05:21.486086 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:21.486011    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:05:21.607495 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:21.607465    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:05:21.823420 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:21.823393    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:05:21.903671 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:21.903638    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0703ea47-f1a2-4858-9556-b85e5e159a23-cert\") pod \"odh-model-controller-7998c67dc4-mfvhq\" (UID: \"0703ea47-f1a2-4858-9556-b85e5e159a23\") " pod="opendatahub/odh-model-controller-7998c67dc4-mfvhq"
Jul 13 03:05:21.906459 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:21.906434    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0703ea47-f1a2-4858-9556-b85e5e159a23-cert\") pod \"odh-model-controller-7998c67dc4-mfvhq\" (UID: \"0703ea47-f1a2-4858-9556-b85e5e159a23\") " pod="opendatahub/odh-model-controller-7998c67dc4-mfvhq"
Jul 13 03:05:21.927611 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:21.927585    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:05:22.096649 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:22.096562    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-mfvhq"
Jul 13 03:05:22.232633 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:22.232607    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-mfvhq"]
Jul 13 03:05:22.234797 ip-10-0-142-39 kubenswrapper[2563]: W0713 03:05:22.234772    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0703ea47_f1a2_4858_9556_b85e5e159a23.slice/crio-b627fab830555e88755fe5cea41a63fc853fb4e5426bd1f090479d0e6e10ad5e WatchSource:0}: Error finding container b627fab830555e88755fe5cea41a63fc853fb4e5426bd1f090479d0e6e10ad5e: Status 404 returned error can't find the container with id b627fab830555e88755fe5cea41a63fc853fb4e5426bd1f090479d0e6e10ad5e
Jul 13 03:05:22.426623 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:22.426550    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:05:22.509777 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:22.509743    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-mfvhq" event={"ID":"0703ea47-f1a2-4858-9556-b85e5e159a23","Type":"ContainerStarted","Data":"b627fab830555e88755fe5cea41a63fc853fb4e5426bd1f090479d0e6e10ad5e"}
Jul 13 03:05:26.529977 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:26.529945    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-mfvhq"
Jul 13 03:05:26.530335 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:26.529992    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-mfvhq" event={"ID":"0703ea47-f1a2-4858-9556-b85e5e159a23","Type":"ContainerStarted","Data":"57f0fb3314df292a7656c30d4bf0edf58f12e5624fb7e396abb0c646053bfdc8"}
Jul 13 03:05:26.545073 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:26.545007    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-mfvhq" podStartSLOduration=2.125991165 podStartE2EDuration="5.544993027s" totalImagesPullingTime="3.419001862s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:05:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:05:26.544630791 +0000 UTC m=+542.527420901" watchObservedRunningTime="2026-07-13 03:05:26.544993027 +0000 UTC m=+542.527783138"
Jul 13 03:05:30.529172 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:30.529127    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:05:30.578180 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:30.578149    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-kkrxv"]
Jul 13 03:05:30.581200 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:30.581178    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-kkrxv"
Jul 13 03:05:30.583578 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:30.583537    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 13 03:05:30.583820 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:30.583806    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-n2pt7\""
Jul 13 03:05:30.591364 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:30.589043    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-9pzfx"]
Jul 13 03:05:30.592947 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:30.592914    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9pzfx"
Jul 13 03:05:30.595119 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:30.595098    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 13 03:05:30.595201 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:30.595135    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-95r9l\""
Jul 13 03:05:30.598113 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:30.598068    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-kkrxv"]
Jul 13 03:05:30.602835 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:30.602794    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-9pzfx"]
Jul 13 03:05:30.608186 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:30.608147    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:05:30.675174 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:30.675142    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fa6b54a5-7538-423a-9b0a-79e12ee939a2-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-9pzfx\" (UID: \"fa6b54a5-7538-423a-9b0a-79e12ee939a2\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9pzfx"
Jul 13 03:05:30.675174 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:30.675176    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/22e90bdc-3021-475c-ad1d-b6e7b47e8131-cert\") pod \"kserve-controller-manager-d6f4b65b8-kkrxv\" (UID: \"22e90bdc-3021-475c-ad1d-b6e7b47e8131\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-kkrxv"
Jul 13 03:05:30.675381 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:30.675257    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdphj\" (UniqueName: \"kubernetes.io/projected/22e90bdc-3021-475c-ad1d-b6e7b47e8131-kube-api-access-wdphj\") pod \"kserve-controller-manager-d6f4b65b8-kkrxv\" (UID: \"22e90bdc-3021-475c-ad1d-b6e7b47e8131\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-kkrxv"
Jul 13 03:05:30.675381 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:30.675279    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqf8c\" (UniqueName: \"kubernetes.io/projected/fa6b54a5-7538-423a-9b0a-79e12ee939a2-kube-api-access-zqf8c\") pod \"llmisvc-controller-manager-777c6bd7d5-9pzfx\" (UID: \"fa6b54a5-7538-423a-9b0a-79e12ee939a2\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9pzfx"
Jul 13 03:05:30.776620 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:30.776580    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fa6b54a5-7538-423a-9b0a-79e12ee939a2-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-9pzfx\" (UID: \"fa6b54a5-7538-423a-9b0a-79e12ee939a2\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9pzfx"
Jul 13 03:05:30.776620 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:30.776612    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/22e90bdc-3021-475c-ad1d-b6e7b47e8131-cert\") pod \"kserve-controller-manager-d6f4b65b8-kkrxv\" (UID: \"22e90bdc-3021-475c-ad1d-b6e7b47e8131\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-kkrxv"
Jul 13 03:05:30.776865 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:30.776650    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdphj\" (UniqueName: \"kubernetes.io/projected/22e90bdc-3021-475c-ad1d-b6e7b47e8131-kube-api-access-wdphj\") pod \"kserve-controller-manager-d6f4b65b8-kkrxv\" (UID: \"22e90bdc-3021-475c-ad1d-b6e7b47e8131\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-kkrxv"
Jul 13 03:05:30.776865 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:30.776669    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqf8c\" (UniqueName: \"kubernetes.io/projected/fa6b54a5-7538-423a-9b0a-79e12ee939a2-kube-api-access-zqf8c\") pod \"llmisvc-controller-manager-777c6bd7d5-9pzfx\" (UID: \"fa6b54a5-7538-423a-9b0a-79e12ee939a2\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9pzfx"
Jul 13 03:05:30.776865 ip-10-0-142-39 kubenswrapper[2563]: E0713 03:05:30.776768    2563 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 13 03:05:30.776865 ip-10-0-142-39 kubenswrapper[2563]: E0713 03:05:30.776773    2563 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 13 03:05:30.776865 ip-10-0-142-39 kubenswrapper[2563]: E0713 03:05:30.776841    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22e90bdc-3021-475c-ad1d-b6e7b47e8131-cert podName:22e90bdc-3021-475c-ad1d-b6e7b47e8131 nodeName:}" failed. No retries permitted until 2026-07-13 03:05:31.27682094 +0000 UTC m=+547.259611242 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/22e90bdc-3021-475c-ad1d-b6e7b47e8131-cert") pod "kserve-controller-manager-d6f4b65b8-kkrxv" (UID: "22e90bdc-3021-475c-ad1d-b6e7b47e8131") : secret "kserve-webhook-server-cert" not found
Jul 13 03:05:30.776865 ip-10-0-142-39 kubenswrapper[2563]: E0713 03:05:30.776855    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa6b54a5-7538-423a-9b0a-79e12ee939a2-cert podName:fa6b54a5-7538-423a-9b0a-79e12ee939a2 nodeName:}" failed. No retries permitted until 2026-07-13 03:05:31.276849517 +0000 UTC m=+547.259639603 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fa6b54a5-7538-423a-9b0a-79e12ee939a2-cert") pod "llmisvc-controller-manager-777c6bd7d5-9pzfx" (UID: "fa6b54a5-7538-423a-9b0a-79e12ee939a2") : secret "llmisvc-webhook-server-cert" not found
Jul 13 03:05:30.791390 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:30.791312    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqf8c\" (UniqueName: \"kubernetes.io/projected/fa6b54a5-7538-423a-9b0a-79e12ee939a2-kube-api-access-zqf8c\") pod \"llmisvc-controller-manager-777c6bd7d5-9pzfx\" (UID: \"fa6b54a5-7538-423a-9b0a-79e12ee939a2\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9pzfx"
Jul 13 03:05:30.791969 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:30.791917    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdphj\" (UniqueName: \"kubernetes.io/projected/22e90bdc-3021-475c-ad1d-b6e7b47e8131-kube-api-access-wdphj\") pod \"kserve-controller-manager-d6f4b65b8-kkrxv\" (UID: \"22e90bdc-3021-475c-ad1d-b6e7b47e8131\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-kkrxv"
Jul 13 03:05:31.016861 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:31.016823    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:05:31.117484 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:31.117453    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:05:31.279818 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:31.279780    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/22e90bdc-3021-475c-ad1d-b6e7b47e8131-cert\") pod \"kserve-controller-manager-d6f4b65b8-kkrxv\" (UID: \"22e90bdc-3021-475c-ad1d-b6e7b47e8131\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-kkrxv"
Jul 13 03:05:31.280002 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:31.279860    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fa6b54a5-7538-423a-9b0a-79e12ee939a2-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-9pzfx\" (UID: \"fa6b54a5-7538-423a-9b0a-79e12ee939a2\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9pzfx"
Jul 13 03:05:31.282270 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:31.282241    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/22e90bdc-3021-475c-ad1d-b6e7b47e8131-cert\") pod \"kserve-controller-manager-d6f4b65b8-kkrxv\" (UID: \"22e90bdc-3021-475c-ad1d-b6e7b47e8131\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-kkrxv"
Jul 13 03:05:31.282395 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:31.282370    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fa6b54a5-7538-423a-9b0a-79e12ee939a2-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-9pzfx\" (UID: \"fa6b54a5-7538-423a-9b0a-79e12ee939a2\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9pzfx"
Jul 13 03:05:31.495130 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:31.495053    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-kkrxv"
Jul 13 03:05:31.504846 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:31.504792    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9pzfx"
Jul 13 03:05:31.517917 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:31.517878    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:05:31.545454 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:31.545420    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7d889b4b4f-8rcx2"]
Jul 13 03:05:31.549842 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:31.549815    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7d889b4b4f-8rcx2"
Jul 13 03:05:31.553401 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:31.553039    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 13 03:05:31.553555 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:31.553436    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 13 03:05:31.553713 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:31.553677    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 13 03:05:31.557142 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:31.557116    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 13 03:05:31.571257 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:31.569245    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7d889b4b4f-8rcx2"]
Jul 13 03:05:31.682363 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:31.682304    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-kkrxv"]
Jul 13 03:05:31.683921 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:31.683443    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/456aa16f-c8fa-4226-a7c7-40fed0985550-tls-certs\") pod \"kube-auth-proxy-7d889b4b4f-8rcx2\" (UID: \"456aa16f-c8fa-4226-a7c7-40fed0985550\") " pod="openshift-ingress/kube-auth-proxy-7d889b4b4f-8rcx2"
Jul 13 03:05:31.683921 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:31.683511    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b59wh\" (UniqueName: \"kubernetes.io/projected/456aa16f-c8fa-4226-a7c7-40fed0985550-kube-api-access-b59wh\") pod \"kube-auth-proxy-7d889b4b4f-8rcx2\" (UID: \"456aa16f-c8fa-4226-a7c7-40fed0985550\") " pod="openshift-ingress/kube-auth-proxy-7d889b4b4f-8rcx2"
Jul 13 03:05:31.683921 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:31.683563    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/456aa16f-c8fa-4226-a7c7-40fed0985550-tmp\") pod \"kube-auth-proxy-7d889b4b4f-8rcx2\" (UID: \"456aa16f-c8fa-4226-a7c7-40fed0985550\") " pod="openshift-ingress/kube-auth-proxy-7d889b4b4f-8rcx2"
Jul 13 03:05:31.683921 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:31.683890    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-9pzfx"]
Jul 13 03:05:31.685854 ip-10-0-142-39 kubenswrapper[2563]: W0713 03:05:31.685824    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22e90bdc_3021_475c_ad1d_b6e7b47e8131.slice/crio-7b287051184151507154e234b3a668f6b41f4256708f4806cf34602ec9648935 WatchSource:0}: Error finding container 7b287051184151507154e234b3a668f6b41f4256708f4806cf34602ec9648935: Status 404 returned error can't find the container with id 7b287051184151507154e234b3a668f6b41f4256708f4806cf34602ec9648935
Jul 13 03:05:31.687454 ip-10-0-142-39 kubenswrapper[2563]: W0713 03:05:31.687430    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podfa6b54a5_7538_423a_9b0a_79e12ee939a2.slice/crio-bc361704dde69a3ffc7fa658501b681623fcee427b5f10cee88f5e0234e25691 WatchSource:0}: Error finding container bc361704dde69a3ffc7fa658501b681623fcee427b5f10cee88f5e0234e25691: Status 404 returned error can't find the container with id bc361704dde69a3ffc7fa658501b681623fcee427b5f10cee88f5e0234e25691
Jul 13 03:05:31.727065 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:31.727026    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:05:31.784259 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:31.784175    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/456aa16f-c8fa-4226-a7c7-40fed0985550-tls-certs\") pod \"kube-auth-proxy-7d889b4b4f-8rcx2\" (UID: \"456aa16f-c8fa-4226-a7c7-40fed0985550\") " pod="openshift-ingress/kube-auth-proxy-7d889b4b4f-8rcx2"
Jul 13 03:05:31.784259 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:31.784217    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b59wh\" (UniqueName: \"kubernetes.io/projected/456aa16f-c8fa-4226-a7c7-40fed0985550-kube-api-access-b59wh\") pod \"kube-auth-proxy-7d889b4b4f-8rcx2\" (UID: \"456aa16f-c8fa-4226-a7c7-40fed0985550\") " pod="openshift-ingress/kube-auth-proxy-7d889b4b4f-8rcx2"
Jul 13 03:05:31.784420 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:31.784337    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/456aa16f-c8fa-4226-a7c7-40fed0985550-tmp\") pod \"kube-auth-proxy-7d889b4b4f-8rcx2\" (UID: \"456aa16f-c8fa-4226-a7c7-40fed0985550\") " pod="openshift-ingress/kube-auth-proxy-7d889b4b4f-8rcx2"
Jul 13 03:05:31.786592 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:31.786563    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/456aa16f-c8fa-4226-a7c7-40fed0985550-tmp\") pod \"kube-auth-proxy-7d889b4b4f-8rcx2\" (UID: \"456aa16f-c8fa-4226-a7c7-40fed0985550\") " pod="openshift-ingress/kube-auth-proxy-7d889b4b4f-8rcx2"
Jul 13 03:05:31.786719 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:31.786705    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/456aa16f-c8fa-4226-a7c7-40fed0985550-tls-certs\") pod \"kube-auth-proxy-7d889b4b4f-8rcx2\" (UID: \"456aa16f-c8fa-4226-a7c7-40fed0985550\") " pod="openshift-ingress/kube-auth-proxy-7d889b4b4f-8rcx2"
Jul 13 03:05:31.793347 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:31.793327    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b59wh\" (UniqueName: \"kubernetes.io/projected/456aa16f-c8fa-4226-a7c7-40fed0985550-kube-api-access-b59wh\") pod \"kube-auth-proxy-7d889b4b4f-8rcx2\" (UID: \"456aa16f-c8fa-4226-a7c7-40fed0985550\") " pod="openshift-ingress/kube-auth-proxy-7d889b4b4f-8rcx2"
Jul 13 03:05:31.819684 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:31.819650    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:05:31.868807 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:31.868781    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7d889b4b4f-8rcx2"
Jul 13 03:05:31.920950 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:31.920912    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:05:31.998980 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:31.998951    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7d889b4b4f-8rcx2"]
Jul 13 03:05:32.001402 ip-10-0-142-39 kubenswrapper[2563]: W0713 03:05:32.001380    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod456aa16f_c8fa_4226_a7c7_40fed0985550.slice/crio-c801c7f358b7f9fb6eb997889706a6c7540560f84188a1353d4958ac9bedb3ea WatchSource:0}: Error finding container c801c7f358b7f9fb6eb997889706a6c7540560f84188a1353d4958ac9bedb3ea: Status 404 returned error can't find the container with id c801c7f358b7f9fb6eb997889706a6c7540560f84188a1353d4958ac9bedb3ea
Jul 13 03:05:32.553149 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:32.553113    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7d889b4b4f-8rcx2" event={"ID":"456aa16f-c8fa-4226-a7c7-40fed0985550","Type":"ContainerStarted","Data":"c801c7f358b7f9fb6eb997889706a6c7540560f84188a1353d4958ac9bedb3ea"}
Jul 13 03:05:32.554718 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:32.554685    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9pzfx" event={"ID":"fa6b54a5-7538-423a-9b0a-79e12ee939a2","Type":"ContainerStarted","Data":"bc361704dde69a3ffc7fa658501b681623fcee427b5f10cee88f5e0234e25691"}
Jul 13 03:05:32.556048 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:32.556018    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-kkrxv" event={"ID":"22e90bdc-3021-475c-ad1d-b6e7b47e8131","Type":"ContainerStarted","Data":"7b287051184151507154e234b3a668f6b41f4256708f4806cf34602ec9648935"}
Jul 13 03:05:33.442004 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:33.441967    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:05:33.453353 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:33.453325    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7rxv4"]
Jul 13 03:05:33.456437 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:33.456421    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7rxv4"
Jul 13 03:05:33.459100 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:33.459070    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-7d2xt\""
Jul 13 03:05:33.459213 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:33.459143    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 13 03:05:33.459213 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:33.459080    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 13 03:05:33.459541 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:33.459522    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 13 03:05:33.459811 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:33.459789    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 13 03:05:33.469116 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:33.469094    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7rxv4"]
Jul 13 03:05:33.514541 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:33.514477    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:05:33.599338 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:33.599303    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-859jb\" (UniqueName: \"kubernetes.io/projected/1e7425aa-f1d3-4112-8e6a-0b386da39c82-kube-api-access-859jb\") pod \"istiod-openshift-gateway-94bb8fbfd-7rxv4\" (UID: \"1e7425aa-f1d3-4112-8e6a-0b386da39c82\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7rxv4"
Jul 13 03:05:33.599798 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:33.599352    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e7425aa-f1d3-4112-8e6a-0b386da39c82-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-7rxv4\" (UID: \"1e7425aa-f1d3-4112-8e6a-0b386da39c82\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7rxv4"
Jul 13 03:05:33.599798 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:33.599466    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1e7425aa-f1d3-4112-8e6a-0b386da39c82-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-7rxv4\" (UID: \"1e7425aa-f1d3-4112-8e6a-0b386da39c82\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7rxv4"
Jul 13 03:05:33.599798 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:33.599507    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1e7425aa-f1d3-4112-8e6a-0b386da39c82-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-7rxv4\" (UID: \"1e7425aa-f1d3-4112-8e6a-0b386da39c82\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7rxv4"
Jul 13 03:05:33.599798 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:33.599547    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1e7425aa-f1d3-4112-8e6a-0b386da39c82-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-7rxv4\" (UID: \"1e7425aa-f1d3-4112-8e6a-0b386da39c82\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7rxv4"
Jul 13 03:05:33.599798 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:33.599597    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1e7425aa-f1d3-4112-8e6a-0b386da39c82-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-7rxv4\" (UID: \"1e7425aa-f1d3-4112-8e6a-0b386da39c82\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7rxv4"
Jul 13 03:05:33.599798 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:33.599632    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e7425aa-f1d3-4112-8e6a-0b386da39c82-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-7rxv4\" (UID: \"1e7425aa-f1d3-4112-8e6a-0b386da39c82\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7rxv4"
Jul 13 03:05:33.700852 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:33.700766    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-859jb\" (UniqueName: \"kubernetes.io/projected/1e7425aa-f1d3-4112-8e6a-0b386da39c82-kube-api-access-859jb\") pod \"istiod-openshift-gateway-94bb8fbfd-7rxv4\" (UID: \"1e7425aa-f1d3-4112-8e6a-0b386da39c82\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7rxv4"
Jul 13 03:05:33.700852 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:33.700824    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e7425aa-f1d3-4112-8e6a-0b386da39c82-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-7rxv4\" (UID: \"1e7425aa-f1d3-4112-8e6a-0b386da39c82\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7rxv4"
Jul 13 03:05:33.701104 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:33.700874    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1e7425aa-f1d3-4112-8e6a-0b386da39c82-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-7rxv4\" (UID: \"1e7425aa-f1d3-4112-8e6a-0b386da39c82\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7rxv4"
Jul 13 03:05:33.701104 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:33.700900    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1e7425aa-f1d3-4112-8e6a-0b386da39c82-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-7rxv4\" (UID: \"1e7425aa-f1d3-4112-8e6a-0b386da39c82\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7rxv4"
Jul 13 03:05:33.701373 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:33.701348    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1e7425aa-f1d3-4112-8e6a-0b386da39c82-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-7rxv4\" (UID: \"1e7425aa-f1d3-4112-8e6a-0b386da39c82\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7rxv4"
Jul 13 03:05:33.701478 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:33.701417    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1e7425aa-f1d3-4112-8e6a-0b386da39c82-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-7rxv4\" (UID: \"1e7425aa-f1d3-4112-8e6a-0b386da39c82\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7rxv4"
Jul 13 03:05:33.701478 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:33.701455    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e7425aa-f1d3-4112-8e6a-0b386da39c82-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-7rxv4\" (UID: \"1e7425aa-f1d3-4112-8e6a-0b386da39c82\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7rxv4"
Jul 13 03:05:33.702018 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:33.701997    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1e7425aa-f1d3-4112-8e6a-0b386da39c82-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-7rxv4\" (UID: \"1e7425aa-f1d3-4112-8e6a-0b386da39c82\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7rxv4"
Jul 13 03:05:33.704233 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:33.703912    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e7425aa-f1d3-4112-8e6a-0b386da39c82-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-7rxv4\" (UID: \"1e7425aa-f1d3-4112-8e6a-0b386da39c82\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7rxv4"
Jul 13 03:05:33.704381 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:33.704359    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1e7425aa-f1d3-4112-8e6a-0b386da39c82-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-7rxv4\" (UID: \"1e7425aa-f1d3-4112-8e6a-0b386da39c82\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7rxv4"
Jul 13 03:05:33.704575 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:33.704552    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1e7425aa-f1d3-4112-8e6a-0b386da39c82-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-7rxv4\" (UID: \"1e7425aa-f1d3-4112-8e6a-0b386da39c82\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7rxv4"
Jul 13 03:05:33.704756 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:33.704735    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1e7425aa-f1d3-4112-8e6a-0b386da39c82-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-7rxv4\" (UID: \"1e7425aa-f1d3-4112-8e6a-0b386da39c82\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7rxv4"
Jul 13 03:05:33.712088 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:33.712065    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e7425aa-f1d3-4112-8e6a-0b386da39c82-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-7rxv4\" (UID: \"1e7425aa-f1d3-4112-8e6a-0b386da39c82\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7rxv4"
Jul 13 03:05:33.712180 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:33.712155    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-859jb\" (UniqueName: \"kubernetes.io/projected/1e7425aa-f1d3-4112-8e6a-0b386da39c82-kube-api-access-859jb\") pod \"istiod-openshift-gateway-94bb8fbfd-7rxv4\" (UID: \"1e7425aa-f1d3-4112-8e6a-0b386da39c82\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7rxv4"
Jul 13 03:05:33.768017 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:33.767832    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7rxv4"
Jul 13 03:05:34.455290 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:34.455228    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:05:35.710286 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:35.710255    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7rxv4"]
Jul 13 03:05:35.712670 ip-10-0-142-39 kubenswrapper[2563]: W0713 03:05:35.712633    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e7425aa_f1d3_4112_8e6a_0b386da39c82.slice/crio-b560d878db8e233f67b28931f6eb9c86bddfbb88185db0a60d91fc5d2a56209f WatchSource:0}: Error finding container b560d878db8e233f67b28931f6eb9c86bddfbb88185db0a60d91fc5d2a56209f: Status 404 returned error can't find the container with id b560d878db8e233f67b28931f6eb9c86bddfbb88185db0a60d91fc5d2a56209f
Jul 13 03:05:36.578031 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:36.577539    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7d889b4b4f-8rcx2" event={"ID":"456aa16f-c8fa-4226-a7c7-40fed0985550","Type":"ContainerStarted","Data":"0de2c8c28379318bd8af3c37312494e8a4cdf26efec74d99554764c63ac01890"}
Jul 13 03:05:36.580141 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:36.580057    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9pzfx" event={"ID":"fa6b54a5-7538-423a-9b0a-79e12ee939a2","Type":"ContainerStarted","Data":"546f59c28b2061b257f551aab678ff8cec1e81eab76e9348e980650baf08e31d"}
Jul 13 03:05:36.580504 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:36.580477    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9pzfx"
Jul 13 03:05:36.581926 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:36.581890    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7rxv4" event={"ID":"1e7425aa-f1d3-4112-8e6a-0b386da39c82","Type":"ContainerStarted","Data":"b560d878db8e233f67b28931f6eb9c86bddfbb88185db0a60d91fc5d2a56209f"}
Jul 13 03:05:36.583909 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:36.583886    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-kkrxv" event={"ID":"22e90bdc-3021-475c-ad1d-b6e7b47e8131","Type":"ContainerStarted","Data":"95b1d38d43e61137367b337e4413919395bfa735b5f82cbbd2165bf7e7f0b662"}
Jul 13 03:05:36.584381 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:36.584341    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-kkrxv"
Jul 13 03:05:36.596306 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:36.596158    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7d889b4b4f-8rcx2" podStartSLOduration=2.023868805 podStartE2EDuration="5.596141304s" totalImagesPullingTime="3.572272499s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:05:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:05:36.594484712 +0000 UTC m=+552.577274818" watchObservedRunningTime="2026-07-13 03:05:36.596141304 +0000 UTC m=+552.578931424"
Jul 13 03:05:36.610692 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:36.610627    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-kkrxv" podStartSLOduration=2.725547804 podStartE2EDuration="6.610610129s" totalImagesPullingTime="3.885062325s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:05:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:05:36.609310432 +0000 UTC m=+552.592100544" watchObservedRunningTime="2026-07-13 03:05:36.610610129 +0000 UTC m=+552.593400239"
Jul 13 03:05:36.626878 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:36.626321    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9pzfx" podStartSLOduration=2.735689199 podStartE2EDuration="6.626305984s" totalImagesPullingTime="3.890616785s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:05:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:05:36.62549032 +0000 UTC m=+552.608280430" watchObservedRunningTime="2026-07-13 03:05:36.626305984 +0000 UTC m=+552.609096096"
Jul 13 03:05:37.575845 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:37.575714    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-mfvhq"
Jul 13 03:05:38.881309 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:38.881261    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 13 03:05:38.881651 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:38.881348    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 13 03:05:39.598613 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:39.598580    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7rxv4" event={"ID":"1e7425aa-f1d3-4112-8e6a-0b386da39c82","Type":"ContainerStarted","Data":"2f956ae8080384bfecbabac760f85ac42cfa6c2f8502bb42af373a1c85e03ccb"}
Jul 13 03:05:39.598981 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:39.598838    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7rxv4"
Jul 13 03:05:39.600261 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:39.600232    2563 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-7rxv4 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 13 03:05:39.600351 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:39.600283    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7rxv4" podUID="1e7425aa-f1d3-4112-8e6a-0b386da39c82" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 03:05:39.619074 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:39.619025    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7rxv4" podStartSLOduration=3.453155577 podStartE2EDuration="6.619012022s" totalImagesPullingTime="3.165856445s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:05:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:05:39.616962325 +0000 UTC m=+555.599752433" watchObservedRunningTime="2026-07-13 03:05:39.619012022 +0000 UTC m=+555.601802131"
Jul 13 03:05:40.173290 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:40.173258    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:05:40.273240 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:40.273213    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:05:40.517358 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:40.517278    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:05:40.603366 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:40.603341    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-7rxv4"
Jul 13 03:05:40.726193 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:40.726158    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:05:40.838148 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:05:40.838117    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:06:07.797280 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:06:07.797247    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:06:08.594573 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:06:08.594545    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9pzfx"
Jul 13 03:06:08.597461 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:06:08.597441    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-kkrxv"
Jul 13 03:06:16.337496 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:06:16.337466    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:06:19.624364 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:06:19.624331    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:06:19.681253 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:06:19.681228    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:06:21.566143 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:06:21.566108    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:06:21.622071 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:06:21.622043    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:06:21.931770 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:06:21.931655    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:06:22.032950 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:06:22.032910    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:06:22.130332 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:06:22.130301    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:06:22.857144 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:06:22.857115    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:06:23.054665 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:06:23.054629    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:06:24.455679 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:06:24.455652    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v2725_a8933b47-8580-45ab-9f75-57c9a3f26842/ovn-acl-logging/0.log"
Jul 13 03:06:24.456951 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:06:24.456916    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v2725_a8933b47-8580-45ab-9f75-57c9a3f26842/ovn-acl-logging/0.log"
Jul 13 03:06:39.527113 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:06:39.527082    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:06:40.831459 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:06:40.831426    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:06:50.723314 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:06:50.723237    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:06:50.822467 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:06:50.822427    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:06:50.922238 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:06:50.922196    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:06:51.023764 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:06:51.023673    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:06:54.829841 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:06:54.829815    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:06:56.586218 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:06:56.586190    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:06:57.847468 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:06:57.847437    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-x9nf2"]
Jul 13 03:06:57.850588 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:06:57.850573    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-x9nf2"
Jul 13 03:06:57.853485 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:06:57.853461    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 13 03:06:57.853612 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:06:57.853518    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-mnkg8\""
Jul 13 03:06:57.854195 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:06:57.854176    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 13 03:06:57.854342 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:06:57.854321    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 13 03:06:57.864869 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:06:57.864848    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-x9nf2"]
Jul 13 03:06:58.004356 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:06:58.004329    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5ltn\" (UniqueName: \"kubernetes.io/projected/35b056f6-3ec0-4b4b-9b5b-230ab4c799ce-kube-api-access-l5ltn\") pod \"dns-operator-controller-manager-864dd78c4c-x9nf2\" (UID: \"35b056f6-3ec0-4b4b-9b5b-230ab4c799ce\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-x9nf2"
Jul 13 03:06:58.104834 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:06:58.104776    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5ltn\" (UniqueName: \"kubernetes.io/projected/35b056f6-3ec0-4b4b-9b5b-230ab4c799ce-kube-api-access-l5ltn\") pod \"dns-operator-controller-manager-864dd78c4c-x9nf2\" (UID: \"35b056f6-3ec0-4b4b-9b5b-230ab4c799ce\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-x9nf2"
Jul 13 03:06:58.119313 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:06:58.119287    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5ltn\" (UniqueName: \"kubernetes.io/projected/35b056f6-3ec0-4b4b-9b5b-230ab4c799ce-kube-api-access-l5ltn\") pod \"dns-operator-controller-manager-864dd78c4c-x9nf2\" (UID: \"35b056f6-3ec0-4b4b-9b5b-230ab4c799ce\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-x9nf2"
Jul 13 03:06:58.161499 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:06:58.161477    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-x9nf2"
Jul 13 03:06:58.287549 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:06:58.287518    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-x9nf2"]
Jul 13 03:06:58.290804 ip-10-0-142-39 kubenswrapper[2563]: W0713 03:06:58.290778    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35b056f6_3ec0_4b4b_9b5b_230ab4c799ce.slice/crio-d7853a6675db26870280020786d21cc90d150e52f9489f12ac51215b2cead994 WatchSource:0}: Error finding container d7853a6675db26870280020786d21cc90d150e52f9489f12ac51215b2cead994: Status 404 returned error can't find the container with id d7853a6675db26870280020786d21cc90d150e52f9489f12ac51215b2cead994
Jul 13 03:06:58.426596 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:06:58.426521    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:06:58.678218 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:06:58.678147    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:06:58.916651 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:06:58.916618    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-x9nf2" event={"ID":"35b056f6-3ec0-4b4b-9b5b-230ab4c799ce","Type":"ContainerStarted","Data":"d7853a6675db26870280020786d21cc90d150e52f9489f12ac51215b2cead994"}
Jul 13 03:07:00.825267 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:00.825232    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jhmd5"]
Jul 13 03:07:00.828394 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:00.828374    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jhmd5"
Jul 13 03:07:00.830699 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:00.830646    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:07:00.830699 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:00.830685    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-m7vxv\""
Jul 13 03:07:00.837996 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:00.837974    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jhmd5"]
Jul 13 03:07:00.926345 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:00.926318    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-x9nf2" event={"ID":"35b056f6-3ec0-4b4b-9b5b-230ab4c799ce","Type":"ContainerStarted","Data":"45dd3b56c967f2b3c4d5743a4847e8b2f1163007306a09bc08bbc4bc7dba77c6"}
Jul 13 03:07:00.926489 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:00.926431    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-x9nf2"
Jul 13 03:07:00.929808 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:00.929785    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77tdn\" (UniqueName: \"kubernetes.io/projected/dc431782-77d2-4eb3-b67c-10abfca36695-kube-api-access-77tdn\") pod \"limitador-operator-controller-manager-859d7b78bd-jhmd5\" (UID: \"dc431782-77d2-4eb3-b67c-10abfca36695\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jhmd5"
Jul 13 03:07:00.949353 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:00.949303    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-x9nf2" podStartSLOduration=2.237451447 podStartE2EDuration="3.949285298s" totalImagesPullingTime="1.711833851s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:06:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:07:00.948919576 +0000 UTC m=+636.931709685" watchObservedRunningTime="2026-07-13 03:07:00.949285298 +0000 UTC m=+636.932075408"
Jul 13 03:07:00.990488 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:00.990463    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:07:01.030587 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:01.030560    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77tdn\" (UniqueName: \"kubernetes.io/projected/dc431782-77d2-4eb3-b67c-10abfca36695-kube-api-access-77tdn\") pod \"limitador-operator-controller-manager-859d7b78bd-jhmd5\" (UID: \"dc431782-77d2-4eb3-b67c-10abfca36695\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jhmd5"
Jul 13 03:07:01.041901 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:01.041874    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-77tdn\" (UniqueName: \"kubernetes.io/projected/dc431782-77d2-4eb3-b67c-10abfca36695-kube-api-access-77tdn\") pod \"limitador-operator-controller-manager-859d7b78bd-jhmd5\" (UID: \"dc431782-77d2-4eb3-b67c-10abfca36695\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jhmd5"
Jul 13 03:07:01.138955 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:01.138865    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jhmd5"
Jul 13 03:07:01.266582 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:01.266557    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jhmd5"]
Jul 13 03:07:01.268835 ip-10-0-142-39 kubenswrapper[2563]: W0713 03:07:01.268812    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc431782_77d2_4eb3_b67c_10abfca36695.slice/crio-9be943402b7b296d4bd61fa4e510cee6d2d883a126cb85c57cec1bfa9c269f3e WatchSource:0}: Error finding container 9be943402b7b296d4bd61fa4e510cee6d2d883a126cb85c57cec1bfa9c269f3e: Status 404 returned error can't find the container with id 9be943402b7b296d4bd61fa4e510cee6d2d883a126cb85c57cec1bfa9c269f3e
Jul 13 03:07:01.784466 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:01.784434    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:07:01.931405 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:01.931369    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jhmd5" event={"ID":"dc431782-77d2-4eb3-b67c-10abfca36695","Type":"ContainerStarted","Data":"9be943402b7b296d4bd61fa4e510cee6d2d883a126cb85c57cec1bfa9c269f3e"}
Jul 13 03:07:03.231109 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:03.231081    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:07:03.947437 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:03.947395    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jhmd5" event={"ID":"dc431782-77d2-4eb3-b67c-10abfca36695","Type":"ContainerStarted","Data":"1e147d2ee48258716fa49725f6e3c6ea81c7342d219f9240289fabbf2dce163a"}
Jul 13 03:07:03.947642 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:03.947548    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jhmd5"
Jul 13 03:07:03.973058 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:03.973008    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jhmd5" podStartSLOduration=2.17979997 podStartE2EDuration="3.972994144s" totalImagesPullingTime="1.793194174s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:07:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:07:03.971041904 +0000 UTC m=+639.953832016" watchObservedRunningTime="2026-07-13 03:07:03.972994144 +0000 UTC m=+639.955784254"
Jul 13 03:07:05.441650 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:05.441620    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:07:05.510971 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:05.510921    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:07:06.200053 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:06.200020    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:07:06.253859 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:06.253835    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:07:11.933757 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:11.933726    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-x9nf2"
Jul 13 03:07:13.874461 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:13.874429    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:07:13.968753 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:13.968728    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:07:14.953433 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:14.953403    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jhmd5"
Jul 13 03:07:15.357113 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:15.357084    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:07:15.461563 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:15.461531    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:07:16.207991 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:16.207958    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-v79wt"]
Jul 13 03:07:16.211201 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:16.211185    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-v79wt"
Jul 13 03:07:16.213766 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:16.213743    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-kjmrl\""
Jul 13 03:07:16.222006 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:16.221983    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-v79wt"]
Jul 13 03:07:16.287648 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:16.287619    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-v79wt"]
Jul 13 03:07:16.287823 ip-10-0-142-39 kubenswrapper[2563]: E0713 03:07:16.287806    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-f4s42], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-v79wt" podUID="8688ea34-8baf-40a9-9dc2-844554793227"
Jul 13 03:07:16.293960 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:16.293908    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-v79wt"]
Jul 13 03:07:16.328276 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:16.328241    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-67n46"]
Jul 13 03:07:16.331714 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:16.331690    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-67n46"
Jul 13 03:07:16.335642 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:16.335621    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jhmd5"]
Jul 13 03:07:16.335804 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:16.335784    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jhmd5" podUID="dc431782-77d2-4eb3-b67c-10abfca36695" containerName="manager" containerID="cri-o://1e147d2ee48258716fa49725f6e3c6ea81c7342d219f9240289fabbf2dce163a" gracePeriod=2
Jul 13 03:07:16.347148 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:16.347120    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8688ea34-8baf-40a9-9dc2-844554793227-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-v79wt\" (UID: \"8688ea34-8baf-40a9-9dc2-844554793227\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-v79wt"
Jul 13 03:07:16.347394 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:16.347365    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4s42\" (UniqueName: \"kubernetes.io/projected/8688ea34-8baf-40a9-9dc2-844554793227-kube-api-access-f4s42\") pod \"kuadrant-operator-controller-manager-55467d9f7-v79wt\" (UID: \"8688ea34-8baf-40a9-9dc2-844554793227\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-v79wt"
Jul 13 03:07:16.348652 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:16.348631    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-67n46"]
Jul 13 03:07:16.352360 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:16.352313    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jhmd5"]
Jul 13 03:07:16.364509 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:16.364486    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4kkfg"]
Jul 13 03:07:16.364763 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:16.364751    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc431782-77d2-4eb3-b67c-10abfca36695" containerName="manager"
Jul 13 03:07:16.364763 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:16.364764    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc431782-77d2-4eb3-b67c-10abfca36695" containerName="manager"
Jul 13 03:07:16.364847 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:16.364818    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc431782-77d2-4eb3-b67c-10abfca36695" containerName="manager"
Jul 13 03:07:16.367733 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:16.367715    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4kkfg"
Jul 13 03:07:16.368462 ip-10-0-142-39 kubenswrapper[2563]: E0713 03:07:16.368433    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-jhmd5\" is forbidden: User \"system:node:ip-10-0-142-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-39.ec2.internal' and this object" podUID="dc431782-77d2-4eb3-b67c-10abfca36695" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jhmd5"
Jul 13 03:07:16.370421 ip-10-0-142-39 kubenswrapper[2563]: E0713 03:07:16.370396    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-jhmd5\" is forbidden: User \"system:node:ip-10-0-142-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-39.ec2.internal' and this object" podUID="dc431782-77d2-4eb3-b67c-10abfca36695" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jhmd5"
Jul 13 03:07:16.381926 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:16.381900    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4kkfg"]
Jul 13 03:07:16.437663 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:16.437631    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-67n46"]
Jul 13 03:07:16.437865 ip-10-0-142-39 kubenswrapper[2563]: E0713 03:07:16.437848    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-vcr6q], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-67n46" podUID="1524f252-6188-4050-92d7-a018170cbf50"
Jul 13 03:07:16.448438 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:16.448411    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcr6q\" (UniqueName: \"kubernetes.io/projected/1524f252-6188-4050-92d7-a018170cbf50-kube-api-access-vcr6q\") pod \"kuadrant-operator-controller-manager-8684c9ff49-67n46\" (UID: \"1524f252-6188-4050-92d7-a018170cbf50\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-67n46"
Jul 13 03:07:16.448569 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:16.448448    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1524f252-6188-4050-92d7-a018170cbf50-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-67n46\" (UID: \"1524f252-6188-4050-92d7-a018170cbf50\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-67n46"
Jul 13 03:07:16.448569 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:16.448477    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4s42\" (UniqueName: \"kubernetes.io/projected/8688ea34-8baf-40a9-9dc2-844554793227-kube-api-access-f4s42\") pod \"kuadrant-operator-controller-manager-55467d9f7-v79wt\" (UID: \"8688ea34-8baf-40a9-9dc2-844554793227\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-v79wt"
Jul 13 03:07:16.448675 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:16.448569    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8688ea34-8baf-40a9-9dc2-844554793227-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-v79wt\" (UID: \"8688ea34-8baf-40a9-9dc2-844554793227\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-v79wt"
Jul 13 03:07:16.448910 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:16.448889    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8688ea34-8baf-40a9-9dc2-844554793227-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-v79wt\" (UID: \"8688ea34-8baf-40a9-9dc2-844554793227\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-v79wt"
Jul 13 03:07:16.453346 ip-10-0-142-39 kubenswrapper[2563]: E0713 03:07:16.453326    2563 projected.go:196] Error preparing data for projected volume kube-api-access-f4s42 for pod kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-v79wt: failed to fetch token: pod "kuadrant-operator-controller-manager-55467d9f7-v79wt" not found
Jul 13 03:07:16.453451 ip-10-0-142-39 kubenswrapper[2563]: E0713 03:07:16.453406    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8688ea34-8baf-40a9-9dc2-844554793227-kube-api-access-f4s42 podName:8688ea34-8baf-40a9-9dc2-844554793227 nodeName:}" failed. No retries permitted until 2026-07-13 03:07:16.95338634 +0000 UTC m=+652.936176427 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-f4s42" (UniqueName: "kubernetes.io/projected/8688ea34-8baf-40a9-9dc2-844554793227-kube-api-access-f4s42") pod "kuadrant-operator-controller-manager-55467d9f7-v79wt" (UID: "8688ea34-8baf-40a9-9dc2-844554793227") : failed to fetch token: pod "kuadrant-operator-controller-manager-55467d9f7-v79wt" not found
Jul 13 03:07:16.549749 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:16.549722    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1524f252-6188-4050-92d7-a018170cbf50-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-67n46\" (UID: \"1524f252-6188-4050-92d7-a018170cbf50\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-67n46"
Jul 13 03:07:16.549891 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:16.549803    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlvmx\" (UniqueName: \"kubernetes.io/projected/b466c987-e2f4-4885-8a68-bf2d0baa466a-kube-api-access-qlvmx\") pod \"limitador-operator-controller-manager-859d7b78bd-4kkfg\" (UID: \"b466c987-e2f4-4885-8a68-bf2d0baa466a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4kkfg"
Jul 13 03:07:16.549891 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:16.549846    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcr6q\" (UniqueName: \"kubernetes.io/projected/1524f252-6188-4050-92d7-a018170cbf50-kube-api-access-vcr6q\") pod \"kuadrant-operator-controller-manager-8684c9ff49-67n46\" (UID: \"1524f252-6188-4050-92d7-a018170cbf50\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-67n46"
Jul 13 03:07:16.550118 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:16.550098    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1524f252-6188-4050-92d7-a018170cbf50-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-67n46\" (UID: \"1524f252-6188-4050-92d7-a018170cbf50\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-67n46"
Jul 13 03:07:16.560890 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:16.560870    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcr6q\" (UniqueName: \"kubernetes.io/projected/1524f252-6188-4050-92d7-a018170cbf50-kube-api-access-vcr6q\") pod \"kuadrant-operator-controller-manager-8684c9ff49-67n46\" (UID: \"1524f252-6188-4050-92d7-a018170cbf50\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-67n46"
Jul 13 03:07:16.575453 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:16.575434    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jhmd5"
Jul 13 03:07:16.650249 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:16.650223    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlvmx\" (UniqueName: \"kubernetes.io/projected/b466c987-e2f4-4885-8a68-bf2d0baa466a-kube-api-access-qlvmx\") pod \"limitador-operator-controller-manager-859d7b78bd-4kkfg\" (UID: \"b466c987-e2f4-4885-8a68-bf2d0baa466a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4kkfg"
Jul 13 03:07:16.661417 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:16.661387    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlvmx\" (UniqueName: \"kubernetes.io/projected/b466c987-e2f4-4885-8a68-bf2d0baa466a-kube-api-access-qlvmx\") pod \"limitador-operator-controller-manager-859d7b78bd-4kkfg\" (UID: \"b466c987-e2f4-4885-8a68-bf2d0baa466a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4kkfg"
Jul 13 03:07:16.709037 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:16.709012    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4kkfg"
Jul 13 03:07:16.751168 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:16.751145    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-77tdn\" (UniqueName: \"kubernetes.io/projected/dc431782-77d2-4eb3-b67c-10abfca36695-kube-api-access-77tdn\") pod \"dc431782-77d2-4eb3-b67c-10abfca36695\" (UID: \"dc431782-77d2-4eb3-b67c-10abfca36695\") "
Jul 13 03:07:16.753244 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:16.753220    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc431782-77d2-4eb3-b67c-10abfca36695-kube-api-access-77tdn" (OuterVolumeSpecName: "kube-api-access-77tdn") pod "dc431782-77d2-4eb3-b67c-10abfca36695" (UID: "dc431782-77d2-4eb3-b67c-10abfca36695"). InnerVolumeSpecName "kube-api-access-77tdn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 03:07:16.840029 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:16.839989    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4kkfg"]
Jul 13 03:07:16.844317 ip-10-0-142-39 kubenswrapper[2563]: W0713 03:07:16.844294    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb466c987_e2f4_4885_8a68_bf2d0baa466a.slice/crio-eb453814ed955a2974597a8c83dbbd6c88f796cd7b549d864b0ee8651d5ebe48 WatchSource:0}: Error finding container eb453814ed955a2974597a8c83dbbd6c88f796cd7b549d864b0ee8651d5ebe48: Status 404 returned error can't find the container with id eb453814ed955a2974597a8c83dbbd6c88f796cd7b549d864b0ee8651d5ebe48
Jul 13 03:07:16.851899 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:16.851879    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-77tdn\" (UniqueName: \"kubernetes.io/projected/dc431782-77d2-4eb3-b67c-10abfca36695-kube-api-access-77tdn\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 13 03:07:17.002312 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:17.002284    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4kkfg" event={"ID":"b466c987-e2f4-4885-8a68-bf2d0baa466a","Type":"ContainerStarted","Data":"ce6001a48321796f4a7cfd8dec94602a597617b4729ad9b58450fbd39d7f2ea9"}
Jul 13 03:07:17.002474 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:17.002333    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4kkfg" event={"ID":"b466c987-e2f4-4885-8a68-bf2d0baa466a","Type":"ContainerStarted","Data":"eb453814ed955a2974597a8c83dbbd6c88f796cd7b549d864b0ee8651d5ebe48"}
Jul 13 03:07:17.002474 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:17.002383    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4kkfg"
Jul 13 03:07:17.003691 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:17.003669    2563 generic.go:356] "Generic (PLEG): container finished" podID="dc431782-77d2-4eb3-b67c-10abfca36695" containerID="1e147d2ee48258716fa49725f6e3c6ea81c7342d219f9240289fabbf2dce163a" exitCode=0
Jul 13 03:07:17.003792 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:17.003704    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jhmd5"
Jul 13 03:07:17.003792 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:17.003762    2563 scope.go:117] "RemoveContainer" containerID="1e147d2ee48258716fa49725f6e3c6ea81c7342d219f9240289fabbf2dce163a"
Jul 13 03:07:17.003895 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:17.003826    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-67n46"
Jul 13 03:07:17.004073 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:17.004050    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-v79wt"
Jul 13 03:07:17.011584 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:17.011567    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-67n46"
Jul 13 03:07:17.012963 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:17.012945    2563 scope.go:117] "RemoveContainer" containerID="1e147d2ee48258716fa49725f6e3c6ea81c7342d219f9240289fabbf2dce163a"
Jul 13 03:07:17.013233 ip-10-0-142-39 kubenswrapper[2563]: E0713 03:07:17.013212    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e147d2ee48258716fa49725f6e3c6ea81c7342d219f9240289fabbf2dce163a\": container with ID starting with 1e147d2ee48258716fa49725f6e3c6ea81c7342d219f9240289fabbf2dce163a not found: ID does not exist" containerID="1e147d2ee48258716fa49725f6e3c6ea81c7342d219f9240289fabbf2dce163a"
Jul 13 03:07:17.013316 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:17.013245    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e147d2ee48258716fa49725f6e3c6ea81c7342d219f9240289fabbf2dce163a"} err="failed to get container status \"1e147d2ee48258716fa49725f6e3c6ea81c7342d219f9240289fabbf2dce163a\": rpc error: code = NotFound desc = could not find container \"1e147d2ee48258716fa49725f6e3c6ea81c7342d219f9240289fabbf2dce163a\": container with ID starting with 1e147d2ee48258716fa49725f6e3c6ea81c7342d219f9240289fabbf2dce163a not found: ID does not exist"
Jul 13 03:07:17.016807 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:17.016779    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-v79wt"
Jul 13 03:07:17.040890 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:17.040815    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4kkfg" podStartSLOduration=1.040803599 podStartE2EDuration="1.040803599s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:07:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:07:17.040694157 +0000 UTC m=+653.023484263" watchObservedRunningTime="2026-07-13 03:07:17.040803599 +0000 UTC m=+653.023593707"
Jul 13 03:07:17.053791 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:17.053770    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4s42\" (UniqueName: \"kubernetes.io/projected/8688ea34-8baf-40a9-9dc2-844554793227-kube-api-access-f4s42\") pod \"kuadrant-operator-controller-manager-55467d9f7-v79wt\" (UID: \"8688ea34-8baf-40a9-9dc2-844554793227\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-v79wt"
Jul 13 03:07:17.057308 ip-10-0-142-39 kubenswrapper[2563]: E0713 03:07:17.057291    2563 projected.go:196] Error preparing data for projected volume kube-api-access-f4s42 for pod kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-v79wt: failed to fetch token: pod "kuadrant-operator-controller-manager-55467d9f7-v79wt" not found
Jul 13 03:07:17.057396 ip-10-0-142-39 kubenswrapper[2563]: E0713 03:07:17.057359    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8688ea34-8baf-40a9-9dc2-844554793227-kube-api-access-f4s42 podName:8688ea34-8baf-40a9-9dc2-844554793227 nodeName:}" failed. No retries permitted until 2026-07-13 03:07:18.057342263 +0000 UTC m=+654.040132367 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-f4s42" (UniqueName: "kubernetes.io/projected/8688ea34-8baf-40a9-9dc2-844554793227-kube-api-access-f4s42") pod "kuadrant-operator-controller-manager-55467d9f7-v79wt" (UID: "8688ea34-8baf-40a9-9dc2-844554793227") : failed to fetch token: pod "kuadrant-operator-controller-manager-55467d9f7-v79wt" not found
Jul 13 03:07:17.083589 ip-10-0-142-39 kubenswrapper[2563]: E0713 03:07:17.083565    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-v79wt\" is forbidden: User \"system:node:ip-10-0-142-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-39.ec2.internal' and this object" podUID="8688ea34-8baf-40a9-9dc2-844554793227" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-v79wt"
Jul 13 03:07:17.154755 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:17.154728    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1524f252-6188-4050-92d7-a018170cbf50-extensions-socket-volume\") pod \"1524f252-6188-4050-92d7-a018170cbf50\" (UID: \"1524f252-6188-4050-92d7-a018170cbf50\") "
Jul 13 03:07:17.154875 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:17.154835    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8688ea34-8baf-40a9-9dc2-844554793227-extensions-socket-volume\") pod \"8688ea34-8baf-40a9-9dc2-844554793227\" (UID: \"8688ea34-8baf-40a9-9dc2-844554793227\") "
Jul 13 03:07:17.154963 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:17.154882    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vcr6q\" (UniqueName: \"kubernetes.io/projected/1524f252-6188-4050-92d7-a018170cbf50-kube-api-access-vcr6q\") pod \"1524f252-6188-4050-92d7-a018170cbf50\" (UID: \"1524f252-6188-4050-92d7-a018170cbf50\") "
Jul 13 03:07:17.155022 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:17.154994    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1524f252-6188-4050-92d7-a018170cbf50-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "1524f252-6188-4050-92d7-a018170cbf50" (UID: "1524f252-6188-4050-92d7-a018170cbf50"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 03:07:17.155103 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:17.155082    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8688ea34-8baf-40a9-9dc2-844554793227-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "8688ea34-8baf-40a9-9dc2-844554793227" (UID: "8688ea34-8baf-40a9-9dc2-844554793227"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 03:07:17.155164 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:17.155152    2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8688ea34-8baf-40a9-9dc2-844554793227-extensions-socket-volume\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 13 03:07:17.155202 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:17.155165    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f4s42\" (UniqueName: \"kubernetes.io/projected/8688ea34-8baf-40a9-9dc2-844554793227-kube-api-access-f4s42\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 13 03:07:17.155202 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:17.155175    2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1524f252-6188-4050-92d7-a018170cbf50-extensions-socket-volume\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 13 03:07:17.157097 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:17.157077    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1524f252-6188-4050-92d7-a018170cbf50-kube-api-access-vcr6q" (OuterVolumeSpecName: "kube-api-access-vcr6q") pod "1524f252-6188-4050-92d7-a018170cbf50" (UID: "1524f252-6188-4050-92d7-a018170cbf50"). InnerVolumeSpecName "kube-api-access-vcr6q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 03:07:17.255700 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:17.255672    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vcr6q\" (UniqueName: \"kubernetes.io/projected/1524f252-6188-4050-92d7-a018170cbf50-kube-api-access-vcr6q\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 13 03:07:18.012706 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:18.010146    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-67n46"
Jul 13 03:07:18.012706 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:18.010198    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-v79wt"
Jul 13 03:07:18.016518 ip-10-0-142-39 kubenswrapper[2563]: E0713 03:07:18.016482    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-v79wt\" is forbidden: User \"system:node:ip-10-0-142-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-39.ec2.internal' and this object" podUID="8688ea34-8baf-40a9-9dc2-844554793227" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-v79wt"
Jul 13 03:07:18.065420 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:18.065393    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-67n46"]
Jul 13 03:07:18.076014 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:18.075990    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-67n46"]
Jul 13 03:07:18.076804 ip-10-0-142-39 kubenswrapper[2563]: E0713 03:07:18.076779    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-v79wt\" is forbidden: User \"system:node:ip-10-0-142-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-39.ec2.internal' and this object" podUID="8688ea34-8baf-40a9-9dc2-844554793227" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-v79wt"
Jul 13 03:07:18.530722 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:18.530686    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1524f252-6188-4050-92d7-a018170cbf50" path="/var/lib/kubelet/pods/1524f252-6188-4050-92d7-a018170cbf50/volumes"
Jul 13 03:07:18.531206 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:18.531017    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8688ea34-8baf-40a9-9dc2-844554793227" path="/var/lib/kubelet/pods/8688ea34-8baf-40a9-9dc2-844554793227/volumes"
Jul 13 03:07:18.531310 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:18.531291    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc431782-77d2-4eb3-b67c-10abfca36695" path="/var/lib/kubelet/pods/dc431782-77d2-4eb3-b67c-10abfca36695/volumes"
Jul 13 03:07:19.081285 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:19.081254    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:07:19.185483 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:19.185456    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:07:24.060846 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:24.060817    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:07:24.112844 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:24.112812    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:07:24.460621 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:24.460545    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:07:24.527154 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:24.527132    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:07:27.663702 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:27.663669    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:07:27.746715 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:27.746686    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:07:28.012854 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:28.012790    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4kkfg"
Jul 13 03:07:35.263596 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:35.263561    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:07:35.316881 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:35.316851    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:07:39.278146 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:39.278113    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:07:39.379422 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:39.379387    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:07:44.069781 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:44.069747    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:07:44.170345 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:44.170316    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:07:55.198881 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:55.198837    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:07:55.444921 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:55.444887    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:07:58.011921 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:58.011890    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:07:58.017183 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:58.017161    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-pxjg4"]
Jul 13 03:07:58.020442 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:58.020423    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-pxjg4"
Jul 13 03:07:58.022541 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:58.022525    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-ph7hg\""
Jul 13 03:07:58.022648 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:58.022620    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 13 03:07:58.029651 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:58.029629    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-pxjg4"]
Jul 13 03:07:58.047313 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:58.047286    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0e9a56b5-3081-49df-916d-4384744d21a4-config-file\") pod \"limitador-limitador-64c94fd64f-pxjg4\" (UID: \"0e9a56b5-3081-49df-916d-4384744d21a4\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-pxjg4"
Jul 13 03:07:58.047400 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:58.047334    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6lvj\" (UniqueName: \"kubernetes.io/projected/0e9a56b5-3081-49df-916d-4384744d21a4-kube-api-access-f6lvj\") pod \"limitador-limitador-64c94fd64f-pxjg4\" (UID: \"0e9a56b5-3081-49df-916d-4384744d21a4\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-pxjg4"
Jul 13 03:07:58.117000 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:58.116970    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-pxjg4"]
Jul 13 03:07:58.119777 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:58.119749    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:07:58.147698 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:58.147675    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0e9a56b5-3081-49df-916d-4384744d21a4-config-file\") pod \"limitador-limitador-64c94fd64f-pxjg4\" (UID: \"0e9a56b5-3081-49df-916d-4384744d21a4\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-pxjg4"
Jul 13 03:07:58.147806 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:58.147720    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6lvj\" (UniqueName: \"kubernetes.io/projected/0e9a56b5-3081-49df-916d-4384744d21a4-kube-api-access-f6lvj\") pod \"limitador-limitador-64c94fd64f-pxjg4\" (UID: \"0e9a56b5-3081-49df-916d-4384744d21a4\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-pxjg4"
Jul 13 03:07:58.148286 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:58.148268    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0e9a56b5-3081-49df-916d-4384744d21a4-config-file\") pod \"limitador-limitador-64c94fd64f-pxjg4\" (UID: \"0e9a56b5-3081-49df-916d-4384744d21a4\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-pxjg4"
Jul 13 03:07:58.155380 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:58.155352    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6lvj\" (UniqueName: \"kubernetes.io/projected/0e9a56b5-3081-49df-916d-4384744d21a4-kube-api-access-f6lvj\") pod \"limitador-limitador-64c94fd64f-pxjg4\" (UID: \"0e9a56b5-3081-49df-916d-4384744d21a4\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-pxjg4"
Jul 13 03:07:58.179971 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:58.179950    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:07:58.331279 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:58.331246    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-pxjg4"
Jul 13 03:07:58.457679 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:58.457648    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-pxjg4"]
Jul 13 03:07:58.460953 ip-10-0-142-39 kubenswrapper[2563]: W0713 03:07:58.460912    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e9a56b5_3081_49df_916d_4384744d21a4.slice/crio-dd19875c81352c03aae97acc2f1d4a8524503a36238b6187a1d259283362b9bd WatchSource:0}: Error finding container dd19875c81352c03aae97acc2f1d4a8524503a36238b6187a1d259283362b9bd: Status 404 returned error can't find the container with id dd19875c81352c03aae97acc2f1d4a8524503a36238b6187a1d259283362b9bd
Jul 13 03:07:58.462699 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:58.462684    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 03:07:58.839642 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:58.839611    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:07:58.897095 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:58.897071    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:07:59.175060 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:07:59.174977    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-pxjg4" event={"ID":"0e9a56b5-3081-49df-916d-4384744d21a4","Type":"ContainerStarted","Data":"dd19875c81352c03aae97acc2f1d4a8524503a36238b6187a1d259283362b9bd"}
Jul 13 03:08:02.190755 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:02.190715    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-pxjg4" event={"ID":"0e9a56b5-3081-49df-916d-4384744d21a4","Type":"ContainerStarted","Data":"ed954be3d2af0870f429b3179383406ba7fe774eed6ebbec41cf5982b8c43900"}
Jul 13 03:08:02.191183 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:02.190909    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-pxjg4"
Jul 13 03:08:02.208444 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:02.208394    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-pxjg4" podStartSLOduration=1.314596213 podStartE2EDuration="4.208379174s" totalImagesPullingTime="2.893782961s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:07:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:08:02.206574346 +0000 UTC m=+698.189364454" watchObservedRunningTime="2026-07-13 03:08:02.208379174 +0000 UTC m=+698.191169283"
Jul 13 03:08:13.018233 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:13.018194    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-pxjg4"]
Jul 13 03:08:13.018654 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:13.018378    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-pxjg4" podUID="0e9a56b5-3081-49df-916d-4384744d21a4" containerName="limitador" containerID="cri-o://ed954be3d2af0870f429b3179383406ba7fe774eed6ebbec41cf5982b8c43900" gracePeriod=30
Jul 13 03:08:13.019066 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:13.019042    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-pxjg4"
Jul 13 03:08:13.960856 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:13.960828    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-pxjg4"
Jul 13 03:08:14.076371 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:14.076324    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0e9a56b5-3081-49df-916d-4384744d21a4-config-file\") pod \"0e9a56b5-3081-49df-916d-4384744d21a4\" (UID: \"0e9a56b5-3081-49df-916d-4384744d21a4\") "
Jul 13 03:08:14.076835 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:14.076407    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f6lvj\" (UniqueName: \"kubernetes.io/projected/0e9a56b5-3081-49df-916d-4384744d21a4-kube-api-access-f6lvj\") pod \"0e9a56b5-3081-49df-916d-4384744d21a4\" (UID: \"0e9a56b5-3081-49df-916d-4384744d21a4\") "
Jul 13 03:08:14.076983 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:14.076949    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e9a56b5-3081-49df-916d-4384744d21a4-config-file" (OuterVolumeSpecName: "config-file") pod "0e9a56b5-3081-49df-916d-4384744d21a4" (UID: "0e9a56b5-3081-49df-916d-4384744d21a4"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 03:08:14.078997 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:14.078975    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e9a56b5-3081-49df-916d-4384744d21a4-kube-api-access-f6lvj" (OuterVolumeSpecName: "kube-api-access-f6lvj") pod "0e9a56b5-3081-49df-916d-4384744d21a4" (UID: "0e9a56b5-3081-49df-916d-4384744d21a4"). InnerVolumeSpecName "kube-api-access-f6lvj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 03:08:14.130141 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:14.130106    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:08:14.177886 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:14.177859    2563 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0e9a56b5-3081-49df-916d-4384744d21a4-config-file\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 13 03:08:14.177886 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:14.177882    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f6lvj\" (UniqueName: \"kubernetes.io/projected/0e9a56b5-3081-49df-916d-4384744d21a4-kube-api-access-f6lvj\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 13 03:08:14.233368 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:14.233337    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:08:14.241060 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:14.241036    2563 generic.go:356] "Generic (PLEG): container finished" podID="0e9a56b5-3081-49df-916d-4384744d21a4" containerID="ed954be3d2af0870f429b3179383406ba7fe774eed6ebbec41cf5982b8c43900" exitCode=0
Jul 13 03:08:14.241168 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:14.241083    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-pxjg4"
Jul 13 03:08:14.241168 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:14.241098    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-pxjg4" event={"ID":"0e9a56b5-3081-49df-916d-4384744d21a4","Type":"ContainerDied","Data":"ed954be3d2af0870f429b3179383406ba7fe774eed6ebbec41cf5982b8c43900"}
Jul 13 03:08:14.241168 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:14.241167    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-pxjg4" event={"ID":"0e9a56b5-3081-49df-916d-4384744d21a4","Type":"ContainerDied","Data":"dd19875c81352c03aae97acc2f1d4a8524503a36238b6187a1d259283362b9bd"}
Jul 13 03:08:14.241321 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:14.241195    2563 scope.go:117] "RemoveContainer" containerID="ed954be3d2af0870f429b3179383406ba7fe774eed6ebbec41cf5982b8c43900"
Jul 13 03:08:14.249920 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:14.249901    2563 scope.go:117] "RemoveContainer" containerID="ed954be3d2af0870f429b3179383406ba7fe774eed6ebbec41cf5982b8c43900"
Jul 13 03:08:14.250188 ip-10-0-142-39 kubenswrapper[2563]: E0713 03:08:14.250167    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed954be3d2af0870f429b3179383406ba7fe774eed6ebbec41cf5982b8c43900\": container with ID starting with ed954be3d2af0870f429b3179383406ba7fe774eed6ebbec41cf5982b8c43900 not found: ID does not exist" containerID="ed954be3d2af0870f429b3179383406ba7fe774eed6ebbec41cf5982b8c43900"
Jul 13 03:08:14.250266 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:14.250196    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed954be3d2af0870f429b3179383406ba7fe774eed6ebbec41cf5982b8c43900"} err="failed to get container status \"ed954be3d2af0870f429b3179383406ba7fe774eed6ebbec41cf5982b8c43900\": rpc error: code = NotFound desc = could not find container \"ed954be3d2af0870f429b3179383406ba7fe774eed6ebbec41cf5982b8c43900\": container with ID starting with ed954be3d2af0870f429b3179383406ba7fe774eed6ebbec41cf5982b8c43900 not found: ID does not exist"
Jul 13 03:08:14.262200 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:14.262178    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-pxjg4"]
Jul 13 03:08:14.266785 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:14.266766    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-pxjg4"]
Jul 13 03:08:14.530525 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:14.530447    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e9a56b5-3081-49df-916d-4384744d21a4" path="/var/lib/kubelet/pods/0e9a56b5-3081-49df-916d-4384744d21a4/volumes"
Jul 13 03:08:14.580634 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:14.580607    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-vbzt4"]
Jul 13 03:08:14.580900 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:14.580887    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e9a56b5-3081-49df-916d-4384744d21a4" containerName="limitador"
Jul 13 03:08:14.580991 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:14.580902    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e9a56b5-3081-49df-916d-4384744d21a4" containerName="limitador"
Jul 13 03:08:14.580991 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:14.580977    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e9a56b5-3081-49df-916d-4384744d21a4" containerName="limitador"
Jul 13 03:08:14.585137 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:14.585117    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-vbzt4"
Jul 13 03:08:14.587474 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:14.587445    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 13 03:08:14.587589 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:14.587445    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-4ls8c\""
Jul 13 03:08:14.587589 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:14.587521    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 13 03:08:14.587589 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:14.587537    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 13 03:08:14.593035 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:14.593015    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-vbzt4"]
Jul 13 03:08:14.627927 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:14.627902    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:08:14.681662 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:14.681640    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ffc6049e-eb3a-4131-874a-0822a009cea2-data\") pod \"postgres-69fb4594cf-vbzt4\" (UID: \"ffc6049e-eb3a-4131-874a-0822a009cea2\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-vbzt4"
Jul 13 03:08:14.681775 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:14.681675    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjck7\" (UniqueName: \"kubernetes.io/projected/ffc6049e-eb3a-4131-874a-0822a009cea2-kube-api-access-pjck7\") pod \"postgres-69fb4594cf-vbzt4\" (UID: \"ffc6049e-eb3a-4131-874a-0822a009cea2\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-vbzt4"
Jul 13 03:08:14.783004 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:14.782949    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ffc6049e-eb3a-4131-874a-0822a009cea2-data\") pod \"postgres-69fb4594cf-vbzt4\" (UID: \"ffc6049e-eb3a-4131-874a-0822a009cea2\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-vbzt4"
Jul 13 03:08:14.783004 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:14.782989    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjck7\" (UniqueName: \"kubernetes.io/projected/ffc6049e-eb3a-4131-874a-0822a009cea2-kube-api-access-pjck7\") pod \"postgres-69fb4594cf-vbzt4\" (UID: \"ffc6049e-eb3a-4131-874a-0822a009cea2\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-vbzt4"
Jul 13 03:08:14.783289 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:14.783259    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ffc6049e-eb3a-4131-874a-0822a009cea2-data\") pod \"postgres-69fb4594cf-vbzt4\" (UID: \"ffc6049e-eb3a-4131-874a-0822a009cea2\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-vbzt4"
Jul 13 03:08:14.791140 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:14.791113    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjck7\" (UniqueName: \"kubernetes.io/projected/ffc6049e-eb3a-4131-874a-0822a009cea2-kube-api-access-pjck7\") pod \"postgres-69fb4594cf-vbzt4\" (UID: \"ffc6049e-eb3a-4131-874a-0822a009cea2\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-vbzt4"
Jul 13 03:08:14.895458 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:14.895433    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-vbzt4"
Jul 13 03:08:15.030373 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:15.030274    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-vbzt4"]
Jul 13 03:08:15.032443 ip-10-0-142-39 kubenswrapper[2563]: W0713 03:08:15.032418    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffc6049e_eb3a_4131_874a_0822a009cea2.slice/crio-ec22bfa869e55ac42d14269021522849d0bbdcfa1f83619e0b7e8eae6d7ebbe8 WatchSource:0}: Error finding container ec22bfa869e55ac42d14269021522849d0bbdcfa1f83619e0b7e8eae6d7ebbe8: Status 404 returned error can't find the container with id ec22bfa869e55ac42d14269021522849d0bbdcfa1f83619e0b7e8eae6d7ebbe8
Jul 13 03:08:15.246122 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:15.246084    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-vbzt4" event={"ID":"ffc6049e-eb3a-4131-874a-0822a009cea2","Type":"ContainerStarted","Data":"ec22bfa869e55ac42d14269021522849d0bbdcfa1f83619e0b7e8eae6d7ebbe8"}
Jul 13 03:08:21.282727 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:21.282642    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-vbzt4" event={"ID":"ffc6049e-eb3a-4131-874a-0822a009cea2","Type":"ContainerStarted","Data":"3771389b3c8a2f339ea0c3f74233070d8754e478f6df836e447aa875ecb82591"}
Jul 13 03:08:21.283143 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:21.282782    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-vbzt4"
Jul 13 03:08:21.298314 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:21.298161    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-vbzt4" podStartSLOduration=1.3674177539999999 podStartE2EDuration="7.298145389s" totalImagesPullingTime="5.930727635s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:08:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:08:21.297816291 +0000 UTC m=+717.280606401" watchObservedRunningTime="2026-07-13 03:08:21.298145389 +0000 UTC m=+717.280935499"
Jul 13 03:08:27.316000 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:27.315970    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-vbzt4"
Jul 13 03:08:27.634756 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:27.634680    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:08:27.886212 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:27.886141    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:08:33.810853 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:33.810809    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:08:33.811297 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:33.811275    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7f586fdfd-s4lv4"]
Jul 13 03:08:33.831643 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:33.831615    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7f586fdfd-s4lv4"]
Jul 13 03:08:33.831773 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:33.831730    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f586fdfd-s4lv4"
Jul 13 03:08:33.834353 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:33.834331    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-wzl4h\""
Jul 13 03:08:33.834486 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:33.834382    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 13 03:08:33.835074 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:33.835053    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 13 03:08:33.841361 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:33.841341    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5ebdd568-fc8c-4a67-b156-33692152acdc-webhook-cert\") pod \"maas-controller-7f586fdfd-s4lv4\" (UID: \"5ebdd568-fc8c-4a67-b156-33692152acdc\") " pod="opendatahub/maas-controller-7f586fdfd-s4lv4"
Jul 13 03:08:33.841453 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:33.841398    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hjmz\" (UniqueName: \"kubernetes.io/projected/5ebdd568-fc8c-4a67-b156-33692152acdc-kube-api-access-7hjmz\") pod \"maas-controller-7f586fdfd-s4lv4\" (UID: \"5ebdd568-fc8c-4a67-b156-33692152acdc\") " pod="opendatahub/maas-controller-7f586fdfd-s4lv4"
Jul 13 03:08:33.876951 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:33.876912    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:08:33.940366 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:33.940346    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:08:33.942541 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:33.942521    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5ebdd568-fc8c-4a67-b156-33692152acdc-webhook-cert\") pod \"maas-controller-7f586fdfd-s4lv4\" (UID: \"5ebdd568-fc8c-4a67-b156-33692152acdc\") " pod="opendatahub/maas-controller-7f586fdfd-s4lv4"
Jul 13 03:08:33.942606 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:33.942567    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hjmz\" (UniqueName: \"kubernetes.io/projected/5ebdd568-fc8c-4a67-b156-33692152acdc-kube-api-access-7hjmz\") pod \"maas-controller-7f586fdfd-s4lv4\" (UID: \"5ebdd568-fc8c-4a67-b156-33692152acdc\") " pod="opendatahub/maas-controller-7f586fdfd-s4lv4"
Jul 13 03:08:33.942661 ip-10-0-142-39 kubenswrapper[2563]: E0713 03:08:33.942647    2563 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 13 03:08:33.942713 ip-10-0-142-39 kubenswrapper[2563]: E0713 03:08:33.942703    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ebdd568-fc8c-4a67-b156-33692152acdc-webhook-cert podName:5ebdd568-fc8c-4a67-b156-33692152acdc nodeName:}" failed. No retries permitted until 2026-07-13 03:08:34.442689692 +0000 UTC m=+730.425479778 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/5ebdd568-fc8c-4a67-b156-33692152acdc-webhook-cert") pod "maas-controller-7f586fdfd-s4lv4" (UID: "5ebdd568-fc8c-4a67-b156-33692152acdc") : secret "maas-controller-webhook-cert" not found
Jul 13 03:08:33.952426 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:33.952403    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hjmz\" (UniqueName: \"kubernetes.io/projected/5ebdd568-fc8c-4a67-b156-33692152acdc-kube-api-access-7hjmz\") pod \"maas-controller-7f586fdfd-s4lv4\" (UID: \"5ebdd568-fc8c-4a67-b156-33692152acdc\") " pod="opendatahub/maas-controller-7f586fdfd-s4lv4"
Jul 13 03:08:33.977134 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:33.977112    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-676b6774c9-crxtq"]
Jul 13 03:08:33.979133 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:33.979117    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-676b6774c9-crxtq"
Jul 13 03:08:33.989420 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:33.989399    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-676b6774c9-crxtq"]
Jul 13 03:08:34.043282 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:34.043255    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6a9f8319-dcb3-4011-972c-8470bfaafa14-webhook-cert\") pod \"maas-controller-676b6774c9-crxtq\" (UID: \"6a9f8319-dcb3-4011-972c-8470bfaafa14\") " pod="opendatahub/maas-controller-676b6774c9-crxtq"
Jul 13 03:08:34.043391 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:34.043289    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klgnp\" (UniqueName: \"kubernetes.io/projected/6a9f8319-dcb3-4011-972c-8470bfaafa14-kube-api-access-klgnp\") pod \"maas-controller-676b6774c9-crxtq\" (UID: \"6a9f8319-dcb3-4011-972c-8470bfaafa14\") " pod="opendatahub/maas-controller-676b6774c9-crxtq"
Jul 13 03:08:34.102523 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:34.102469    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:08:34.143761 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:34.143738    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6a9f8319-dcb3-4011-972c-8470bfaafa14-webhook-cert\") pod \"maas-controller-676b6774c9-crxtq\" (UID: \"6a9f8319-dcb3-4011-972c-8470bfaafa14\") " pod="opendatahub/maas-controller-676b6774c9-crxtq"
Jul 13 03:08:34.143845 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:34.143765    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klgnp\" (UniqueName: \"kubernetes.io/projected/6a9f8319-dcb3-4011-972c-8470bfaafa14-kube-api-access-klgnp\") pod \"maas-controller-676b6774c9-crxtq\" (UID: \"6a9f8319-dcb3-4011-972c-8470bfaafa14\") " pod="opendatahub/maas-controller-676b6774c9-crxtq"
Jul 13 03:08:34.146194 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:34.146169    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6a9f8319-dcb3-4011-972c-8470bfaafa14-webhook-cert\") pod \"maas-controller-676b6774c9-crxtq\" (UID: \"6a9f8319-dcb3-4011-972c-8470bfaafa14\") " pod="opendatahub/maas-controller-676b6774c9-crxtq"
Jul 13 03:08:34.151721 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:34.151703    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-klgnp\" (UniqueName: \"kubernetes.io/projected/6a9f8319-dcb3-4011-972c-8470bfaafa14-kube-api-access-klgnp\") pod \"maas-controller-676b6774c9-crxtq\" (UID: \"6a9f8319-dcb3-4011-972c-8470bfaafa14\") " pod="opendatahub/maas-controller-676b6774c9-crxtq"
Jul 13 03:08:34.290109 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:34.290087    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-676b6774c9-crxtq"
Jul 13 03:08:34.415850 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:34.415827    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-676b6774c9-crxtq"]
Jul 13 03:08:34.417898 ip-10-0-142-39 kubenswrapper[2563]: W0713 03:08:34.417875    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a9f8319_dcb3_4011_972c_8470bfaafa14.slice/crio-244d4521e9b6f2d1e0c7bb7d6581c94d03b2eb9ac4a9cb9a8a79ef2d1fff5795 WatchSource:0}: Error finding container 244d4521e9b6f2d1e0c7bb7d6581c94d03b2eb9ac4a9cb9a8a79ef2d1fff5795: Status 404 returned error can't find the container with id 244d4521e9b6f2d1e0c7bb7d6581c94d03b2eb9ac4a9cb9a8a79ef2d1fff5795
Jul 13 03:08:34.445698 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:34.445669    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5ebdd568-fc8c-4a67-b156-33692152acdc-webhook-cert\") pod \"maas-controller-7f586fdfd-s4lv4\" (UID: \"5ebdd568-fc8c-4a67-b156-33692152acdc\") " pod="opendatahub/maas-controller-7f586fdfd-s4lv4"
Jul 13 03:08:34.448013 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:34.447993    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5ebdd568-fc8c-4a67-b156-33692152acdc-webhook-cert\") pod \"maas-controller-7f586fdfd-s4lv4\" (UID: \"5ebdd568-fc8c-4a67-b156-33692152acdc\") " pod="opendatahub/maas-controller-7f586fdfd-s4lv4"
Jul 13 03:08:34.741707 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:34.741641    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f586fdfd-s4lv4"
Jul 13 03:08:34.865245 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:34.865221    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7f586fdfd-s4lv4"]
Jul 13 03:08:34.867500 ip-10-0-142-39 kubenswrapper[2563]: W0713 03:08:34.867476    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ebdd568_fc8c_4a67_b156_33692152acdc.slice/crio-03b47aced03f0d6a593350c5f2ac2d4fb275b0a3f5b91aa7e7873791cabfa0f7 WatchSource:0}: Error finding container 03b47aced03f0d6a593350c5f2ac2d4fb275b0a3f5b91aa7e7873791cabfa0f7: Status 404 returned error can't find the container with id 03b47aced03f0d6a593350c5f2ac2d4fb275b0a3f5b91aa7e7873791cabfa0f7
Jul 13 03:08:35.344233 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:35.344185    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-676b6774c9-crxtq" event={"ID":"6a9f8319-dcb3-4011-972c-8470bfaafa14","Type":"ContainerStarted","Data":"244d4521e9b6f2d1e0c7bb7d6581c94d03b2eb9ac4a9cb9a8a79ef2d1fff5795"}
Jul 13 03:08:35.345664 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:35.345633    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f586fdfd-s4lv4" event={"ID":"5ebdd568-fc8c-4a67-b156-33692152acdc","Type":"ContainerStarted","Data":"03b47aced03f0d6a593350c5f2ac2d4fb275b0a3f5b91aa7e7873791cabfa0f7"}
Jul 13 03:08:37.172184 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:37.172151    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:08:37.263570 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:37.263493    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:08:37.355985 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:37.355927    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-676b6774c9-crxtq" event={"ID":"6a9f8319-dcb3-4011-972c-8470bfaafa14","Type":"ContainerStarted","Data":"0ea76eb825ed2464e69c099276e5c2ef2951b9494b98df476218144f1864e0c2"}
Jul 13 03:08:37.356148 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:37.356019    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-676b6774c9-crxtq"
Jul 13 03:08:37.357448 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:37.357424    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f586fdfd-s4lv4" event={"ID":"5ebdd568-fc8c-4a67-b156-33692152acdc","Type":"ContainerStarted","Data":"898f0576341c2a569aa5d5312ea852b88965cdee132c429d3abae1ce19ef096f"}
Jul 13 03:08:37.357559 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:37.357537    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7f586fdfd-s4lv4"
Jul 13 03:08:37.474897 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:37.474833    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7f586fdfd-s4lv4" podStartSLOduration=2.359470941 podStartE2EDuration="4.474814589s" totalImagesPullingTime="2.115343648s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:08:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:08:37.474685293 +0000 UTC m=+733.457475402" watchObservedRunningTime="2026-07-13 03:08:37.474814589 +0000 UTC m=+733.457604699"
Jul 13 03:08:37.475105 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:37.474973    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-676b6774c9-crxtq" podStartSLOduration=1.920308966 podStartE2EDuration="4.474964794s" totalImagesPullingTime="2.554655828s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:08:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:08:37.415161568 +0000 UTC m=+733.397951695" watchObservedRunningTime="2026-07-13 03:08:37.474964794 +0000 UTC m=+733.457754905"
Jul 13 03:08:48.366606 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:48.366567    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-676b6774c9-crxtq"
Jul 13 03:08:48.367210 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:48.366735    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7f586fdfd-s4lv4"
Jul 13 03:08:48.433734 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:48.433699    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7f586fdfd-s4lv4"]
Jul 13 03:08:48.433956 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:48.433912    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7f586fdfd-s4lv4" podUID="5ebdd568-fc8c-4a67-b156-33692152acdc" containerName="manager" containerID="cri-o://898f0576341c2a569aa5d5312ea852b88965cdee132c429d3abae1ce19ef096f" gracePeriod=30
Jul 13 03:08:48.671770 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:48.671747    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f586fdfd-s4lv4"
Jul 13 03:08:48.747048 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:48.747020    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7hjmz\" (UniqueName: \"kubernetes.io/projected/5ebdd568-fc8c-4a67-b156-33692152acdc-kube-api-access-7hjmz\") pod \"5ebdd568-fc8c-4a67-b156-33692152acdc\" (UID: \"5ebdd568-fc8c-4a67-b156-33692152acdc\") "
Jul 13 03:08:48.747172 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:48.747107    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5ebdd568-fc8c-4a67-b156-33692152acdc-webhook-cert\") pod \"5ebdd568-fc8c-4a67-b156-33692152acdc\" (UID: \"5ebdd568-fc8c-4a67-b156-33692152acdc\") "
Jul 13 03:08:48.749335 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:48.749313    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ebdd568-fc8c-4a67-b156-33692152acdc-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "5ebdd568-fc8c-4a67-b156-33692152acdc" (UID: "5ebdd568-fc8c-4a67-b156-33692152acdc"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 03:08:48.749438 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:48.749326    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ebdd568-fc8c-4a67-b156-33692152acdc-kube-api-access-7hjmz" (OuterVolumeSpecName: "kube-api-access-7hjmz") pod "5ebdd568-fc8c-4a67-b156-33692152acdc" (UID: "5ebdd568-fc8c-4a67-b156-33692152acdc"). InnerVolumeSpecName "kube-api-access-7hjmz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 03:08:48.847770 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:48.847746    2563 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5ebdd568-fc8c-4a67-b156-33692152acdc-webhook-cert\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 13 03:08:48.847770 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:48.847767    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7hjmz\" (UniqueName: \"kubernetes.io/projected/5ebdd568-fc8c-4a67-b156-33692152acdc-kube-api-access-7hjmz\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 13 03:08:49.407422 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:49.407384    2563 generic.go:356] "Generic (PLEG): container finished" podID="5ebdd568-fc8c-4a67-b156-33692152acdc" containerID="898f0576341c2a569aa5d5312ea852b88965cdee132c429d3abae1ce19ef096f" exitCode=0
Jul 13 03:08:49.407865 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:49.407431    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f586fdfd-s4lv4"
Jul 13 03:08:49.407865 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:49.407477    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f586fdfd-s4lv4" event={"ID":"5ebdd568-fc8c-4a67-b156-33692152acdc","Type":"ContainerDied","Data":"898f0576341c2a569aa5d5312ea852b88965cdee132c429d3abae1ce19ef096f"}
Jul 13 03:08:49.407865 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:49.407537    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f586fdfd-s4lv4" event={"ID":"5ebdd568-fc8c-4a67-b156-33692152acdc","Type":"ContainerDied","Data":"03b47aced03f0d6a593350c5f2ac2d4fb275b0a3f5b91aa7e7873791cabfa0f7"}
Jul 13 03:08:49.407865 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:49.407573    2563 scope.go:117] "RemoveContainer" containerID="898f0576341c2a569aa5d5312ea852b88965cdee132c429d3abae1ce19ef096f"
Jul 13 03:08:49.416083 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:49.416068    2563 scope.go:117] "RemoveContainer" containerID="898f0576341c2a569aa5d5312ea852b88965cdee132c429d3abae1ce19ef096f"
Jul 13 03:08:49.416303 ip-10-0-142-39 kubenswrapper[2563]: E0713 03:08:49.416283    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"898f0576341c2a569aa5d5312ea852b88965cdee132c429d3abae1ce19ef096f\": container with ID starting with 898f0576341c2a569aa5d5312ea852b88965cdee132c429d3abae1ce19ef096f not found: ID does not exist" containerID="898f0576341c2a569aa5d5312ea852b88965cdee132c429d3abae1ce19ef096f"
Jul 13 03:08:49.416391 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:49.416310    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"898f0576341c2a569aa5d5312ea852b88965cdee132c429d3abae1ce19ef096f"} err="failed to get container status \"898f0576341c2a569aa5d5312ea852b88965cdee132c429d3abae1ce19ef096f\": rpc error: code = NotFound desc = could not find container \"898f0576341c2a569aa5d5312ea852b88965cdee132c429d3abae1ce19ef096f\": container with ID starting with 898f0576341c2a569aa5d5312ea852b88965cdee132c429d3abae1ce19ef096f not found: ID does not exist"
Jul 13 03:08:49.427054 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:49.427030    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7f586fdfd-s4lv4"]
Jul 13 03:08:49.433193 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:49.433174    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7f586fdfd-s4lv4"]
Jul 13 03:08:50.536132 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:08:50.536101    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ebdd568-fc8c-4a67-b156-33692152acdc" path="/var/lib/kubelet/pods/5ebdd568-fc8c-4a67-b156-33692152acdc/volumes"
Jul 13 03:09:05.359382 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:05.359345    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:09:05.419823 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:05.419788    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:09:08.802728 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:08.802690    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:09:09.198330 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:09.198248    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:09:09.252890 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:09.252852    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-65ccc6b695-ndkl4"]
Jul 13 03:09:09.253202 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:09.253189    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ebdd568-fc8c-4a67-b156-33692152acdc" containerName="manager"
Jul 13 03:09:09.253251 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:09.253204    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ebdd568-fc8c-4a67-b156-33692152acdc" containerName="manager"
Jul 13 03:09:09.253284 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:09.253252    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ebdd568-fc8c-4a67-b156-33692152acdc" containerName="manager"
Jul 13 03:09:09.298523 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:09.298493    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:09:09.300649 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:09.300624    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-65ccc6b695-ndkl4"]
Jul 13 03:09:09.300781 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:09.300734    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-65ccc6b695-ndkl4"
Jul 13 03:09:09.304012 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:09.303971    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 13 03:09:09.304164 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:09.304027    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-v6shd\""
Jul 13 03:09:09.394041 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:09.394011    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e536bc2d-f408-4d9b-9f3c-5bd39a63f19d-maas-api-tls\") pod \"maas-api-65ccc6b695-ndkl4\" (UID: \"e536bc2d-f408-4d9b-9f3c-5bd39a63f19d\") " pod="odh-ai-gateway-infra/maas-api-65ccc6b695-ndkl4"
Jul 13 03:09:09.394165 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:09.394046    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e536bc2d-f408-4d9b-9f3c-5bd39a63f19d-openshift-service-ca\") pod \"maas-api-65ccc6b695-ndkl4\" (UID: \"e536bc2d-f408-4d9b-9f3c-5bd39a63f19d\") " pod="odh-ai-gateway-infra/maas-api-65ccc6b695-ndkl4"
Jul 13 03:09:09.394165 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:09.394079    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8cwz\" (UniqueName: \"kubernetes.io/projected/e536bc2d-f408-4d9b-9f3c-5bd39a63f19d-kube-api-access-w8cwz\") pod \"maas-api-65ccc6b695-ndkl4\" (UID: \"e536bc2d-f408-4d9b-9f3c-5bd39a63f19d\") " pod="odh-ai-gateway-infra/maas-api-65ccc6b695-ndkl4"
Jul 13 03:09:09.495080 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:09.495012    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e536bc2d-f408-4d9b-9f3c-5bd39a63f19d-maas-api-tls\") pod \"maas-api-65ccc6b695-ndkl4\" (UID: \"e536bc2d-f408-4d9b-9f3c-5bd39a63f19d\") " pod="odh-ai-gateway-infra/maas-api-65ccc6b695-ndkl4"
Jul 13 03:09:09.495080 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:09.495043    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e536bc2d-f408-4d9b-9f3c-5bd39a63f19d-openshift-service-ca\") pod \"maas-api-65ccc6b695-ndkl4\" (UID: \"e536bc2d-f408-4d9b-9f3c-5bd39a63f19d\") " pod="odh-ai-gateway-infra/maas-api-65ccc6b695-ndkl4"
Jul 13 03:09:09.495080 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:09.495067    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8cwz\" (UniqueName: \"kubernetes.io/projected/e536bc2d-f408-4d9b-9f3c-5bd39a63f19d-kube-api-access-w8cwz\") pod \"maas-api-65ccc6b695-ndkl4\" (UID: \"e536bc2d-f408-4d9b-9f3c-5bd39a63f19d\") " pod="odh-ai-gateway-infra/maas-api-65ccc6b695-ndkl4"
Jul 13 03:09:09.495648 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:09.495626    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e536bc2d-f408-4d9b-9f3c-5bd39a63f19d-openshift-service-ca\") pod \"maas-api-65ccc6b695-ndkl4\" (UID: \"e536bc2d-f408-4d9b-9f3c-5bd39a63f19d\") " pod="odh-ai-gateway-infra/maas-api-65ccc6b695-ndkl4"
Jul 13 03:09:09.497477 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:09.497457    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e536bc2d-f408-4d9b-9f3c-5bd39a63f19d-maas-api-tls\") pod \"maas-api-65ccc6b695-ndkl4\" (UID: \"e536bc2d-f408-4d9b-9f3c-5bd39a63f19d\") " pod="odh-ai-gateway-infra/maas-api-65ccc6b695-ndkl4"
Jul 13 03:09:09.503318 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:09.503299    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8cwz\" (UniqueName: \"kubernetes.io/projected/e536bc2d-f408-4d9b-9f3c-5bd39a63f19d-kube-api-access-w8cwz\") pod \"maas-api-65ccc6b695-ndkl4\" (UID: \"e536bc2d-f408-4d9b-9f3c-5bd39a63f19d\") " pod="odh-ai-gateway-infra/maas-api-65ccc6b695-ndkl4"
Jul 13 03:09:09.611158 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:09.611128    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-65ccc6b695-ndkl4"
Jul 13 03:09:09.722777 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:09.722720    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:09:09.749006 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:09.748984    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-65ccc6b695-ndkl4"]
Jul 13 03:09:09.752584 ip-10-0-142-39 kubenswrapper[2563]: W0713 03:09:09.752558    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode536bc2d_f408_4d9b_9f3c_5bd39a63f19d.slice/crio-58846127cef9a938b4a0a24eeac6d0e14f50223bf9ba5627fe202d1615e216d3 WatchSource:0}: Error finding container 58846127cef9a938b4a0a24eeac6d0e14f50223bf9ba5627fe202d1615e216d3: Status 404 returned error can't find the container with id 58846127cef9a938b4a0a24eeac6d0e14f50223bf9ba5627fe202d1615e216d3
Jul 13 03:09:09.824266 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:09.824236    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:09:09.824694 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:09.824673    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-dnlsq"]
Jul 13 03:09:09.827509 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:09.827492    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-dnlsq"
Jul 13 03:09:09.833045 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:09.833020    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 13 03:09:09.833303 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:09.833276    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-2vphc\""
Jul 13 03:09:09.838839 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:09.838814    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-dnlsq"]
Jul 13 03:09:09.868344 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:09.868324    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-6ldtl"]
Jul 13 03:09:09.870347 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:09.870330    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-6ldtl"
Jul 13 03:09:09.883459 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:09.883442    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-6ldtl"]
Jul 13 03:09:09.899420 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:09.899395    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xvb5\" (UniqueName: \"kubernetes.io/projected/592af000-244d-4b67-a299-b0519a05962b-kube-api-access-6xvb5\") pod \"payload-pre-processing-7964457696-dnlsq\" (UID: \"592af000-244d-4b67-a299-b0519a05962b\") " pod="openshift-ingress/payload-pre-processing-7964457696-dnlsq"
Jul 13 03:09:09.899544 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:09.899449    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n62h8\" (UniqueName: \"kubernetes.io/projected/9d25329f-b98a-4431-a3a2-88ad1be01bd2-kube-api-access-n62h8\") pod \"payload-processing-58f86c7798-6ldtl\" (UID: \"9d25329f-b98a-4431-a3a2-88ad1be01bd2\") " pod="openshift-ingress/payload-processing-58f86c7798-6ldtl"
Jul 13 03:09:09.899544 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:09.899514    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/592af000-244d-4b67-a299-b0519a05962b-plugins-config-volume\") pod \"payload-pre-processing-7964457696-dnlsq\" (UID: \"592af000-244d-4b67-a299-b0519a05962b\") " pod="openshift-ingress/payload-pre-processing-7964457696-dnlsq"
Jul 13 03:09:09.899663 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:09.899612    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9d25329f-b98a-4431-a3a2-88ad1be01bd2-plugins-config-volume\") pod \"payload-processing-58f86c7798-6ldtl\" (UID: \"9d25329f-b98a-4431-a3a2-88ad1be01bd2\") " pod="openshift-ingress/payload-processing-58f86c7798-6ldtl"
Jul 13 03:09:10.000461 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:10.000386    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n62h8\" (UniqueName: \"kubernetes.io/projected/9d25329f-b98a-4431-a3a2-88ad1be01bd2-kube-api-access-n62h8\") pod \"payload-processing-58f86c7798-6ldtl\" (UID: \"9d25329f-b98a-4431-a3a2-88ad1be01bd2\") " pod="openshift-ingress/payload-processing-58f86c7798-6ldtl"
Jul 13 03:09:10.000461 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:10.000423    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/592af000-244d-4b67-a299-b0519a05962b-plugins-config-volume\") pod \"payload-pre-processing-7964457696-dnlsq\" (UID: \"592af000-244d-4b67-a299-b0519a05962b\") " pod="openshift-ingress/payload-pre-processing-7964457696-dnlsq"
Jul 13 03:09:10.000461 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:10.000446    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9d25329f-b98a-4431-a3a2-88ad1be01bd2-plugins-config-volume\") pod \"payload-processing-58f86c7798-6ldtl\" (UID: \"9d25329f-b98a-4431-a3a2-88ad1be01bd2\") " pod="openshift-ingress/payload-processing-58f86c7798-6ldtl"
Jul 13 03:09:10.000761 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:10.000488    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xvb5\" (UniqueName: \"kubernetes.io/projected/592af000-244d-4b67-a299-b0519a05962b-kube-api-access-6xvb5\") pod \"payload-pre-processing-7964457696-dnlsq\" (UID: \"592af000-244d-4b67-a299-b0519a05962b\") " pod="openshift-ingress/payload-pre-processing-7964457696-dnlsq"
Jul 13 03:09:10.001263 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:10.001240    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9d25329f-b98a-4431-a3a2-88ad1be01bd2-plugins-config-volume\") pod \"payload-processing-58f86c7798-6ldtl\" (UID: \"9d25329f-b98a-4431-a3a2-88ad1be01bd2\") " pod="openshift-ingress/payload-processing-58f86c7798-6ldtl"
Jul 13 03:09:10.001375 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:10.001240    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/592af000-244d-4b67-a299-b0519a05962b-plugins-config-volume\") pod \"payload-pre-processing-7964457696-dnlsq\" (UID: \"592af000-244d-4b67-a299-b0519a05962b\") " pod="openshift-ingress/payload-pre-processing-7964457696-dnlsq"
Jul 13 03:09:10.008565 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:10.008543    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n62h8\" (UniqueName: \"kubernetes.io/projected/9d25329f-b98a-4431-a3a2-88ad1be01bd2-kube-api-access-n62h8\") pod \"payload-processing-58f86c7798-6ldtl\" (UID: \"9d25329f-b98a-4431-a3a2-88ad1be01bd2\") " pod="openshift-ingress/payload-processing-58f86c7798-6ldtl"
Jul 13 03:09:10.008676 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:10.008608    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xvb5\" (UniqueName: \"kubernetes.io/projected/592af000-244d-4b67-a299-b0519a05962b-kube-api-access-6xvb5\") pod \"payload-pre-processing-7964457696-dnlsq\" (UID: \"592af000-244d-4b67-a299-b0519a05962b\") " pod="openshift-ingress/payload-pre-processing-7964457696-dnlsq"
Jul 13 03:09:10.144148 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:10.144123    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-dnlsq"
Jul 13 03:09:10.180418 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:10.180186    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-6ldtl"
Jul 13 03:09:10.277895 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:10.277864    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-dnlsq"]
Jul 13 03:09:10.281065 ip-10-0-142-39 kubenswrapper[2563]: W0713 03:09:10.281041    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod592af000_244d_4b67_a299_b0519a05962b.slice/crio-f5f8308e0d95fe5e8ebc6ba587de60d6df03e41e00072259ca9ae0ce270bd28e WatchSource:0}: Error finding container f5f8308e0d95fe5e8ebc6ba587de60d6df03e41e00072259ca9ae0ce270bd28e: Status 404 returned error can't find the container with id f5f8308e0d95fe5e8ebc6ba587de60d6df03e41e00072259ca9ae0ce270bd28e
Jul 13 03:09:10.311301 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:10.311272    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-6ldtl"]
Jul 13 03:09:10.314089 ip-10-0-142-39 kubenswrapper[2563]: W0713 03:09:10.314061    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d25329f_b98a_4431_a3a2_88ad1be01bd2.slice/crio-98a63d5a58c36176ad8c34927bec252f40f70491eb763a58110e7a390dd41f56 WatchSource:0}: Error finding container 98a63d5a58c36176ad8c34927bec252f40f70491eb763a58110e7a390dd41f56: Status 404 returned error can't find the container with id 98a63d5a58c36176ad8c34927bec252f40f70491eb763a58110e7a390dd41f56
Jul 13 03:09:10.497476 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:10.497439    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-dnlsq" event={"ID":"592af000-244d-4b67-a299-b0519a05962b","Type":"ContainerStarted","Data":"f5f8308e0d95fe5e8ebc6ba587de60d6df03e41e00072259ca9ae0ce270bd28e"}
Jul 13 03:09:10.498869 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:10.498839    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-6ldtl" event={"ID":"9d25329f-b98a-4431-a3a2-88ad1be01bd2","Type":"ContainerStarted","Data":"98a63d5a58c36176ad8c34927bec252f40f70491eb763a58110e7a390dd41f56"}
Jul 13 03:09:10.500265 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:10.500210    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-65ccc6b695-ndkl4" event={"ID":"e536bc2d-f408-4d9b-9f3c-5bd39a63f19d","Type":"ContainerStarted","Data":"58846127cef9a938b4a0a24eeac6d0e14f50223bf9ba5627fe202d1615e216d3"}
Jul 13 03:09:12.512190 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:12.512154    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-dnlsq" event={"ID":"592af000-244d-4b67-a299-b0519a05962b","Type":"ContainerStarted","Data":"cb3b2847ad196a32667a68bf3f3eb00b57728980e25dd1cc435e24010c58bfa9"}
Jul 13 03:09:12.512619 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:12.512245    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-dnlsq"
Jul 13 03:09:12.513729 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:12.513702    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-6ldtl" event={"ID":"9d25329f-b98a-4431-a3a2-88ad1be01bd2","Type":"ContainerStarted","Data":"e82d60d691de197473462269c07c13eb10a3de93d39296b01ba933cbca681345"}
Jul 13 03:09:12.513857 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:12.513750    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-6ldtl"
Jul 13 03:09:12.515147 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:12.515123    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-65ccc6b695-ndkl4" event={"ID":"e536bc2d-f408-4d9b-9f3c-5bd39a63f19d","Type":"ContainerStarted","Data":"b8fecb1f75fe3696eeab1dc8a3d71776c3519211fbd7d4b3a96ad10f1d107721"}
Jul 13 03:09:12.515289 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:12.515275    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-65ccc6b695-ndkl4"
Jul 13 03:09:12.527243 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:12.527198    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-dnlsq" podStartSLOduration=2.021099886 podStartE2EDuration="3.527187588s" totalImagesPullingTime="1.506087702s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:09:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:09:12.526379228 +0000 UTC m=+768.509169336" watchObservedRunningTime="2026-07-13 03:09:12.527187588 +0000 UTC m=+768.509977676"
Jul 13 03:09:12.541490 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:12.541444    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-6ldtl" podStartSLOduration=2.069220903 podStartE2EDuration="3.541427683s" totalImagesPullingTime="1.47220678s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:09:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:09:12.541197388 +0000 UTC m=+768.523987498" watchObservedRunningTime="2026-07-13 03:09:12.541427683 +0000 UTC m=+768.524217793"
Jul 13 03:09:12.556648 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:12.556611    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-65ccc6b695-ndkl4" podStartSLOduration=1.5231115229999999 podStartE2EDuration="3.556598266s" totalImagesPullingTime="2.033486743s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:09:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:09:12.555977848 +0000 UTC m=+768.538767958" watchObservedRunningTime="2026-07-13 03:09:12.556598266 +0000 UTC m=+768.539388406"
Jul 13 03:09:18.524591 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:18.524562    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-65ccc6b695-ndkl4"
Jul 13 03:09:19.978775 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:19.978734    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:09:20.084460 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:20.084431    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:09:23.522188 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:23.522159    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-6ldtl"
Jul 13 03:09:23.522641 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:23.522229    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-dnlsq"
Jul 13 03:09:24.619784 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:24.619747    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mv4nv"]
Jul 13 03:09:24.624487 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:24.624463    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mv4nv"
Jul 13 03:09:24.626797 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:24.626776    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 13 03:09:24.628088 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:24.628065    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 13 03:09:24.628214 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:24.628105    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-85pt7\""
Jul 13 03:09:24.628214 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:24.628148    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 13 03:09:24.633596 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:24.633574    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mv4nv"]
Jul 13 03:09:24.645910 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:24.645873    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:09:24.716596 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:24.716567    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/080908ee-ec79-413e-93fe-09a35bac54b4-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mv4nv\" (UID: \"080908ee-ec79-413e-93fe-09a35bac54b4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mv4nv"
Jul 13 03:09:24.716596 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:24.716600    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/080908ee-ec79-413e-93fe-09a35bac54b4-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mv4nv\" (UID: \"080908ee-ec79-413e-93fe-09a35bac54b4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mv4nv"
Jul 13 03:09:24.716784 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:24.716619    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/080908ee-ec79-413e-93fe-09a35bac54b4-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mv4nv\" (UID: \"080908ee-ec79-413e-93fe-09a35bac54b4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mv4nv"
Jul 13 03:09:24.716784 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:24.716742    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/080908ee-ec79-413e-93fe-09a35bac54b4-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mv4nv\" (UID: \"080908ee-ec79-413e-93fe-09a35bac54b4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mv4nv"
Jul 13 03:09:24.716855 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:24.716786    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/080908ee-ec79-413e-93fe-09a35bac54b4-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mv4nv\" (UID: \"080908ee-ec79-413e-93fe-09a35bac54b4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mv4nv"
Jul 13 03:09:24.716855 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:24.716806    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nsqx\" (UniqueName: \"kubernetes.io/projected/080908ee-ec79-413e-93fe-09a35bac54b4-kube-api-access-9nsqx\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mv4nv\" (UID: \"080908ee-ec79-413e-93fe-09a35bac54b4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mv4nv"
Jul 13 03:09:24.818112 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:24.818075    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/080908ee-ec79-413e-93fe-09a35bac54b4-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mv4nv\" (UID: \"080908ee-ec79-413e-93fe-09a35bac54b4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mv4nv"
Jul 13 03:09:24.818112 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:24.818112    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/080908ee-ec79-413e-93fe-09a35bac54b4-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mv4nv\" (UID: \"080908ee-ec79-413e-93fe-09a35bac54b4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mv4nv"
Jul 13 03:09:24.818332 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:24.818133    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/080908ee-ec79-413e-93fe-09a35bac54b4-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mv4nv\" (UID: \"080908ee-ec79-413e-93fe-09a35bac54b4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mv4nv"
Jul 13 03:09:24.818332 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:24.818188    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/080908ee-ec79-413e-93fe-09a35bac54b4-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mv4nv\" (UID: \"080908ee-ec79-413e-93fe-09a35bac54b4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mv4nv"
Jul 13 03:09:24.818332 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:24.818214    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/080908ee-ec79-413e-93fe-09a35bac54b4-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mv4nv\" (UID: \"080908ee-ec79-413e-93fe-09a35bac54b4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mv4nv"
Jul 13 03:09:24.818332 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:24.818232    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nsqx\" (UniqueName: \"kubernetes.io/projected/080908ee-ec79-413e-93fe-09a35bac54b4-kube-api-access-9nsqx\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mv4nv\" (UID: \"080908ee-ec79-413e-93fe-09a35bac54b4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mv4nv"
Jul 13 03:09:24.818600 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:24.818564    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/080908ee-ec79-413e-93fe-09a35bac54b4-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mv4nv\" (UID: \"080908ee-ec79-413e-93fe-09a35bac54b4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mv4nv"
Jul 13 03:09:24.818890 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:24.818598    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/080908ee-ec79-413e-93fe-09a35bac54b4-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mv4nv\" (UID: \"080908ee-ec79-413e-93fe-09a35bac54b4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mv4nv"
Jul 13 03:09:24.818890 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:24.818572    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/080908ee-ec79-413e-93fe-09a35bac54b4-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mv4nv\" (UID: \"080908ee-ec79-413e-93fe-09a35bac54b4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mv4nv"
Jul 13 03:09:24.820338 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:24.820312    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/080908ee-ec79-413e-93fe-09a35bac54b4-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mv4nv\" (UID: \"080908ee-ec79-413e-93fe-09a35bac54b4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mv4nv"
Jul 13 03:09:24.820654 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:24.820631    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/080908ee-ec79-413e-93fe-09a35bac54b4-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mv4nv\" (UID: \"080908ee-ec79-413e-93fe-09a35bac54b4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mv4nv"
Jul 13 03:09:24.825694 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:24.825677    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nsqx\" (UniqueName: \"kubernetes.io/projected/080908ee-ec79-413e-93fe-09a35bac54b4-kube-api-access-9nsqx\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mv4nv\" (UID: \"080908ee-ec79-413e-93fe-09a35bac54b4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mv4nv"
Jul 13 03:09:24.936575 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:24.936543    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mv4nv"
Jul 13 03:09:25.070556 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:25.070532    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mv4nv"]
Jul 13 03:09:25.072623 ip-10-0-142-39 kubenswrapper[2563]: W0713 03:09:25.072588    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod080908ee_ec79_413e_93fe_09a35bac54b4.slice/crio-bc0a5aff54314c65f391a42db50bbc24c2880a321be406a92059793eb3b681b6 WatchSource:0}: Error finding container bc0a5aff54314c65f391a42db50bbc24c2880a321be406a92059793eb3b681b6: Status 404 returned error can't find the container with id bc0a5aff54314c65f391a42db50bbc24c2880a321be406a92059793eb3b681b6
Jul 13 03:09:25.571390 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:25.571354    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mv4nv" event={"ID":"080908ee-ec79-413e-93fe-09a35bac54b4","Type":"ContainerStarted","Data":"bc0a5aff54314c65f391a42db50bbc24c2880a321be406a92059793eb3b681b6"}
Jul 13 03:09:26.577166 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:26.577133    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mv4nv" event={"ID":"080908ee-ec79-413e-93fe-09a35bac54b4","Type":"ContainerStarted","Data":"8dbbaf4db529399a1372a46cc44bbf343af2bad060db039a7e8e0c8313dac95e"}
Jul 13 03:09:26.594947 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:26.594892    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mv4nv" podStartSLOduration=1.427629184 podStartE2EDuration="2.594877319s" totalImagesPullingTime="1.167248135s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:09:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:09:26.59354511 +0000 UTC m=+782.576335218" watchObservedRunningTime="2026-07-13 03:09:26.594877319 +0000 UTC m=+782.577667427"
Jul 13 03:09:32.694045 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:32.694012    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:09:34.936994 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:34.936960    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mv4nv"
Jul 13 03:09:34.937411 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:34.937052    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mv4nv"
Jul 13 03:09:34.949572 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:34.949547    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mv4nv"
Jul 13 03:09:35.632983 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:35.632957    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mv4nv"
Jul 13 03:09:38.027657 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:38.027613    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:09:44.825355 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:44.825321    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-mgzf5"]
Jul 13 03:09:44.829906 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:44.829882    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mgzf5"
Jul 13 03:09:44.832284 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:44.832263    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 13 03:09:44.840502 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:44.840469    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-mgzf5"]
Jul 13 03:09:44.859599 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:44.859576    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:09:44.980568 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:44.980533    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/39add498-7859-4bef-811a-2ad003b9b4fc-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mgzf5\" (UID: \"39add498-7859-4bef-811a-2ad003b9b4fc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mgzf5"
Jul 13 03:09:44.980568 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:44.980575    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/39add498-7859-4bef-811a-2ad003b9b4fc-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mgzf5\" (UID: \"39add498-7859-4bef-811a-2ad003b9b4fc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mgzf5"
Jul 13 03:09:44.980784 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:44.980614    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhbbt\" (UniqueName: \"kubernetes.io/projected/39add498-7859-4bef-811a-2ad003b9b4fc-kube-api-access-lhbbt\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mgzf5\" (UID: \"39add498-7859-4bef-811a-2ad003b9b4fc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mgzf5"
Jul 13 03:09:44.980784 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:44.980685    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/39add498-7859-4bef-811a-2ad003b9b4fc-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mgzf5\" (UID: \"39add498-7859-4bef-811a-2ad003b9b4fc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mgzf5"
Jul 13 03:09:44.980784 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:44.980732    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/39add498-7859-4bef-811a-2ad003b9b4fc-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mgzf5\" (UID: \"39add498-7859-4bef-811a-2ad003b9b4fc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mgzf5"
Jul 13 03:09:44.980784 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:44.980768    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39add498-7859-4bef-811a-2ad003b9b4fc-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mgzf5\" (UID: \"39add498-7859-4bef-811a-2ad003b9b4fc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mgzf5"
Jul 13 03:09:45.081948 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:45.081851    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhbbt\" (UniqueName: \"kubernetes.io/projected/39add498-7859-4bef-811a-2ad003b9b4fc-kube-api-access-lhbbt\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mgzf5\" (UID: \"39add498-7859-4bef-811a-2ad003b9b4fc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mgzf5"
Jul 13 03:09:45.081948 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:45.081916    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/39add498-7859-4bef-811a-2ad003b9b4fc-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mgzf5\" (UID: \"39add498-7859-4bef-811a-2ad003b9b4fc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mgzf5"
Jul 13 03:09:45.082182 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:45.081964    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/39add498-7859-4bef-811a-2ad003b9b4fc-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mgzf5\" (UID: \"39add498-7859-4bef-811a-2ad003b9b4fc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mgzf5"
Jul 13 03:09:45.082182 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:45.081993    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39add498-7859-4bef-811a-2ad003b9b4fc-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mgzf5\" (UID: \"39add498-7859-4bef-811a-2ad003b9b4fc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mgzf5"
Jul 13 03:09:45.082182 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:45.082037    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/39add498-7859-4bef-811a-2ad003b9b4fc-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mgzf5\" (UID: \"39add498-7859-4bef-811a-2ad003b9b4fc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mgzf5"
Jul 13 03:09:45.082182 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:45.082069    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/39add498-7859-4bef-811a-2ad003b9b4fc-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mgzf5\" (UID: \"39add498-7859-4bef-811a-2ad003b9b4fc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mgzf5"
Jul 13 03:09:45.082496 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:45.082471    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/39add498-7859-4bef-811a-2ad003b9b4fc-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mgzf5\" (UID: \"39add498-7859-4bef-811a-2ad003b9b4fc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mgzf5"
Jul 13 03:09:45.082577 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:45.082511    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/39add498-7859-4bef-811a-2ad003b9b4fc-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mgzf5\" (UID: \"39add498-7859-4bef-811a-2ad003b9b4fc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mgzf5"
Jul 13 03:09:45.082577 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:45.082529    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39add498-7859-4bef-811a-2ad003b9b4fc-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mgzf5\" (UID: \"39add498-7859-4bef-811a-2ad003b9b4fc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mgzf5"
Jul 13 03:09:45.084399 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:45.084375    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/39add498-7859-4bef-811a-2ad003b9b4fc-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mgzf5\" (UID: \"39add498-7859-4bef-811a-2ad003b9b4fc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mgzf5"
Jul 13 03:09:45.084536 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:45.084521    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/39add498-7859-4bef-811a-2ad003b9b4fc-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mgzf5\" (UID: \"39add498-7859-4bef-811a-2ad003b9b4fc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mgzf5"
Jul 13 03:09:45.090425 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:45.090402    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhbbt\" (UniqueName: \"kubernetes.io/projected/39add498-7859-4bef-811a-2ad003b9b4fc-kube-api-access-lhbbt\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mgzf5\" (UID: \"39add498-7859-4bef-811a-2ad003b9b4fc\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mgzf5"
Jul 13 03:09:45.143350 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:45.143323    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mgzf5"
Jul 13 03:09:45.281247 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:45.281222    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-mgzf5"]
Jul 13 03:09:45.283831 ip-10-0-142-39 kubenswrapper[2563]: W0713 03:09:45.283806    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39add498_7859_4bef_811a_2ad003b9b4fc.slice/crio-52e227b94c4b46e1832b4a36be69e208a09e37644fc79776bec7cf557b9c309f WatchSource:0}: Error finding container 52e227b94c4b46e1832b4a36be69e208a09e37644fc79776bec7cf557b9c309f: Status 404 returned error can't find the container with id 52e227b94c4b46e1832b4a36be69e208a09e37644fc79776bec7cf557b9c309f
Jul 13 03:09:45.665229 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:45.665157    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mgzf5" event={"ID":"39add498-7859-4bef-811a-2ad003b9b4fc","Type":"ContainerStarted","Data":"b30638cf18f5becdd0ac53a46cc8c638167305a79e24aea269cbdf7dca9a0ff6"}
Jul 13 03:09:45.665229 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:45.665205    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mgzf5" event={"ID":"39add498-7859-4bef-811a-2ad003b9b4fc","Type":"ContainerStarted","Data":"52e227b94c4b46e1832b4a36be69e208a09e37644fc79776bec7cf557b9c309f"}
Jul 13 03:09:45.683151 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:45.683109    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mgzf5" podStartSLOduration=1.449957962 podStartE2EDuration="1.68309343s" totalImagesPullingTime="233.135468ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:09:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:09:45.681297642 +0000 UTC m=+801.664087755" watchObservedRunningTime="2026-07-13 03:09:45.68309343 +0000 UTC m=+801.665883539"
Jul 13 03:09:54.654656 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:54.654614    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:09:55.143584 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:55.143551    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mgzf5"
Jul 13 03:09:55.143765 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:55.143611    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mgzf5"
Jul 13 03:09:55.155760 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:55.155739    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mgzf5"
Jul 13 03:09:55.717516 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:09:55.717487    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mgzf5"
Jul 13 03:10:08.637805 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:10:08.637767    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-dvm64"]
Jul 13 03:10:08.643714 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:10:08.643697    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dvm64"
Jul 13 03:10:08.646062 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:10:08.646032    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 13 03:10:08.649048 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:10:08.649027    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-dvm64"]
Jul 13 03:10:08.673103 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:10:08.673079    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a3bc9d0-6f94-448e-ba14-36e201bb11ab-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dvm64\" (UID: \"5a3bc9d0-6f94-448e-ba14-36e201bb11ab\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dvm64"
Jul 13 03:10:08.673228 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:10:08.673109    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a3bc9d0-6f94-448e-ba14-36e201bb11ab-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dvm64\" (UID: \"5a3bc9d0-6f94-448e-ba14-36e201bb11ab\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dvm64"
Jul 13 03:10:08.673228 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:10:08.673138    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnq9b\" (UniqueName: \"kubernetes.io/projected/5a3bc9d0-6f94-448e-ba14-36e201bb11ab-kube-api-access-hnq9b\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dvm64\" (UID: \"5a3bc9d0-6f94-448e-ba14-36e201bb11ab\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dvm64"
Jul 13 03:10:08.673301 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:10:08.673218    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a3bc9d0-6f94-448e-ba14-36e201bb11ab-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dvm64\" (UID: \"5a3bc9d0-6f94-448e-ba14-36e201bb11ab\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dvm64"
Jul 13 03:10:08.673301 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:10:08.673265    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a3bc9d0-6f94-448e-ba14-36e201bb11ab-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dvm64\" (UID: \"5a3bc9d0-6f94-448e-ba14-36e201bb11ab\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dvm64"
Jul 13 03:10:08.673301 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:10:08.673288    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a3bc9d0-6f94-448e-ba14-36e201bb11ab-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dvm64\" (UID: \"5a3bc9d0-6f94-448e-ba14-36e201bb11ab\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dvm64"
Jul 13 03:10:08.735874 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:10:08.735841    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:10:08.774131 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:10:08.774102    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a3bc9d0-6f94-448e-ba14-36e201bb11ab-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dvm64\" (UID: \"5a3bc9d0-6f94-448e-ba14-36e201bb11ab\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dvm64"
Jul 13 03:10:08.774302 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:10:08.774171    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a3bc9d0-6f94-448e-ba14-36e201bb11ab-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dvm64\" (UID: \"5a3bc9d0-6f94-448e-ba14-36e201bb11ab\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dvm64"
Jul 13 03:10:08.774302 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:10:08.774196    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a3bc9d0-6f94-448e-ba14-36e201bb11ab-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dvm64\" (UID: \"5a3bc9d0-6f94-448e-ba14-36e201bb11ab\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dvm64"
Jul 13 03:10:08.774302 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:10:08.774245    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a3bc9d0-6f94-448e-ba14-36e201bb11ab-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dvm64\" (UID: \"5a3bc9d0-6f94-448e-ba14-36e201bb11ab\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dvm64"
Jul 13 03:10:08.774302 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:10:08.774263    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a3bc9d0-6f94-448e-ba14-36e201bb11ab-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dvm64\" (UID: \"5a3bc9d0-6f94-448e-ba14-36e201bb11ab\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dvm64"
Jul 13 03:10:08.774463 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:10:08.774303    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnq9b\" (UniqueName: \"kubernetes.io/projected/5a3bc9d0-6f94-448e-ba14-36e201bb11ab-kube-api-access-hnq9b\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dvm64\" (UID: \"5a3bc9d0-6f94-448e-ba14-36e201bb11ab\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dvm64"
Jul 13 03:10:08.774581 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:10:08.774554    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a3bc9d0-6f94-448e-ba14-36e201bb11ab-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dvm64\" (UID: \"5a3bc9d0-6f94-448e-ba14-36e201bb11ab\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dvm64"
Jul 13 03:10:08.774648 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:10:08.774567    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a3bc9d0-6f94-448e-ba14-36e201bb11ab-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dvm64\" (UID: \"5a3bc9d0-6f94-448e-ba14-36e201bb11ab\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dvm64"
Jul 13 03:10:08.774690 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:10:08.774656    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a3bc9d0-6f94-448e-ba14-36e201bb11ab-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dvm64\" (UID: \"5a3bc9d0-6f94-448e-ba14-36e201bb11ab\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dvm64"
Jul 13 03:10:08.777024 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:10:08.776994    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a3bc9d0-6f94-448e-ba14-36e201bb11ab-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dvm64\" (UID: \"5a3bc9d0-6f94-448e-ba14-36e201bb11ab\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dvm64"
Jul 13 03:10:08.777157 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:10:08.777141    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a3bc9d0-6f94-448e-ba14-36e201bb11ab-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dvm64\" (UID: \"5a3bc9d0-6f94-448e-ba14-36e201bb11ab\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dvm64"
Jul 13 03:10:08.781560 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:10:08.781533    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnq9b\" (UniqueName: \"kubernetes.io/projected/5a3bc9d0-6f94-448e-ba14-36e201bb11ab-kube-api-access-hnq9b\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dvm64\" (UID: \"5a3bc9d0-6f94-448e-ba14-36e201bb11ab\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dvm64"
Jul 13 03:10:08.955898 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:10:08.955822    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dvm64"
Jul 13 03:10:09.094706 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:10:09.094680    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-dvm64"]
Jul 13 03:10:09.096924 ip-10-0-142-39 kubenswrapper[2563]: W0713 03:10:09.096900    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a3bc9d0_6f94_448e_ba14_36e201bb11ab.slice/crio-4b7e1b8bf688904e294a17cc7b20cc186b1fc445e18fa45e072d3808885df6a6 WatchSource:0}: Error finding container 4b7e1b8bf688904e294a17cc7b20cc186b1fc445e18fa45e072d3808885df6a6: Status 404 returned error can't find the container with id 4b7e1b8bf688904e294a17cc7b20cc186b1fc445e18fa45e072d3808885df6a6
Jul 13 03:10:09.774972 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:10:09.774860    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dvm64" event={"ID":"5a3bc9d0-6f94-448e-ba14-36e201bb11ab","Type":"ContainerStarted","Data":"557c29f187b7b41bcec09d55911bc26d906e60115c2a674025f9618c5511eb45"}
Jul 13 03:10:09.774972 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:10:09.774916    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dvm64" event={"ID":"5a3bc9d0-6f94-448e-ba14-36e201bb11ab","Type":"ContainerStarted","Data":"4b7e1b8bf688904e294a17cc7b20cc186b1fc445e18fa45e072d3808885df6a6"}
Jul 13 03:10:09.793968 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:10:09.793894    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dvm64" podStartSLOduration=1.5805523209999999 podStartE2EDuration="1.793871603s" totalImagesPullingTime="213.319282ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:10:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:10:09.79238795 +0000 UTC m=+825.775178060" watchObservedRunningTime="2026-07-13 03:10:09.793871603 +0000 UTC m=+825.776661715"
Jul 13 03:10:18.957010 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:10:18.956973    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dvm64"
Jul 13 03:10:18.957390 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:10:18.957038    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dvm64"
Jul 13 03:10:18.969390 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:10:18.969363    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dvm64"
Jul 13 03:10:19.359989 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:10:19.359957    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:10:19.830267 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:10:19.830243    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dvm64"
Jul 13 03:11:18.516803 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:11:18.516711    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:11:18.616392 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:11:18.616345    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:11:19.675459 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:11:19.675428    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:11:19.774380 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:11:19.774352    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:11:24.485440 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:11:24.485410    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v2725_a8933b47-8580-45ab-9f75-57c9a3f26842/ovn-acl-logging/0.log"
Jul 13 03:11:24.485917 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:11:24.485456    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v2725_a8933b47-8580-45ab-9f75-57c9a3f26842/ovn-acl-logging/0.log"
Jul 13 03:11:25.243991 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:11:25.243954    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:11:25.308365 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:11:25.308307    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:11:39.522210 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:11:39.522177    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:11:58.927297 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:11:58.927264    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:12:00.450760 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:12:00.450730    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:12:29.111257 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:12:29.111225    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:12:29.690683 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:12:29.690645    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:12:29.786616 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:12:29.786588    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-676b6774c9-crxtq"]
Jul 13 03:12:29.786822 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:12:29.786779    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-676b6774c9-crxtq" podUID="6a9f8319-dcb3-4011-972c-8470bfaafa14" containerName="manager" containerID="cri-o://0ea76eb825ed2464e69c099276e5c2ef2951b9494b98df476218144f1864e0c2" gracePeriod=30
Jul 13 03:12:30.035621 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:12:30.035595    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-676b6774c9-crxtq"
Jul 13 03:12:30.105523 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:12:30.105498    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-klgnp\" (UniqueName: \"kubernetes.io/projected/6a9f8319-dcb3-4011-972c-8470bfaafa14-kube-api-access-klgnp\") pod \"6a9f8319-dcb3-4011-972c-8470bfaafa14\" (UID: \"6a9f8319-dcb3-4011-972c-8470bfaafa14\") "
Jul 13 03:12:30.105679 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:12:30.105563    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6a9f8319-dcb3-4011-972c-8470bfaafa14-webhook-cert\") pod \"6a9f8319-dcb3-4011-972c-8470bfaafa14\" (UID: \"6a9f8319-dcb3-4011-972c-8470bfaafa14\") "
Jul 13 03:12:30.107605 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:12:30.107574    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a9f8319-dcb3-4011-972c-8470bfaafa14-kube-api-access-klgnp" (OuterVolumeSpecName: "kube-api-access-klgnp") pod "6a9f8319-dcb3-4011-972c-8470bfaafa14" (UID: "6a9f8319-dcb3-4011-972c-8470bfaafa14"). InnerVolumeSpecName "kube-api-access-klgnp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 03:12:30.107605 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:12:30.107574    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a9f8319-dcb3-4011-972c-8470bfaafa14-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "6a9f8319-dcb3-4011-972c-8470bfaafa14" (UID: "6a9f8319-dcb3-4011-972c-8470bfaafa14"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 03:12:30.206725 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:12:30.206668    2563 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6a9f8319-dcb3-4011-972c-8470bfaafa14-webhook-cert\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 13 03:12:30.206725 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:12:30.206692    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-klgnp\" (UniqueName: \"kubernetes.io/projected/6a9f8319-dcb3-4011-972c-8470bfaafa14-kube-api-access-klgnp\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 13 03:12:30.387154 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:12:30.387126    2563 generic.go:356] "Generic (PLEG): container finished" podID="6a9f8319-dcb3-4011-972c-8470bfaafa14" containerID="0ea76eb825ed2464e69c099276e5c2ef2951b9494b98df476218144f1864e0c2" exitCode=0
Jul 13 03:12:30.387276 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:12:30.387173    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-676b6774c9-crxtq"
Jul 13 03:12:30.387276 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:12:30.387199    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-676b6774c9-crxtq" event={"ID":"6a9f8319-dcb3-4011-972c-8470bfaafa14","Type":"ContainerDied","Data":"0ea76eb825ed2464e69c099276e5c2ef2951b9494b98df476218144f1864e0c2"}
Jul 13 03:12:30.387276 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:12:30.387241    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-676b6774c9-crxtq" event={"ID":"6a9f8319-dcb3-4011-972c-8470bfaafa14","Type":"ContainerDied","Data":"244d4521e9b6f2d1e0c7bb7d6581c94d03b2eb9ac4a9cb9a8a79ef2d1fff5795"}
Jul 13 03:12:30.387276 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:12:30.387263    2563 scope.go:117] "RemoveContainer" containerID="0ea76eb825ed2464e69c099276e5c2ef2951b9494b98df476218144f1864e0c2"
Jul 13 03:12:30.396230 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:12:30.396212    2563 scope.go:117] "RemoveContainer" containerID="0ea76eb825ed2464e69c099276e5c2ef2951b9494b98df476218144f1864e0c2"
Jul 13 03:12:30.396489 ip-10-0-142-39 kubenswrapper[2563]: E0713 03:12:30.396469    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ea76eb825ed2464e69c099276e5c2ef2951b9494b98df476218144f1864e0c2\": container with ID starting with 0ea76eb825ed2464e69c099276e5c2ef2951b9494b98df476218144f1864e0c2 not found: ID does not exist" containerID="0ea76eb825ed2464e69c099276e5c2ef2951b9494b98df476218144f1864e0c2"
Jul 13 03:12:30.396532 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:12:30.396498    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ea76eb825ed2464e69c099276e5c2ef2951b9494b98df476218144f1864e0c2"} err="failed to get container status \"0ea76eb825ed2464e69c099276e5c2ef2951b9494b98df476218144f1864e0c2\": rpc error: code = NotFound desc = could not find container \"0ea76eb825ed2464e69c099276e5c2ef2951b9494b98df476218144f1864e0c2\": container with ID starting with 0ea76eb825ed2464e69c099276e5c2ef2951b9494b98df476218144f1864e0c2 not found: ID does not exist"
Jul 13 03:12:30.408006 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:12:30.407979    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-676b6774c9-crxtq"]
Jul 13 03:12:30.412966 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:12:30.412926    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-676b6774c9-crxtq"]
Jul 13 03:12:30.530732 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:12:30.530676    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a9f8319-dcb3-4011-972c-8470bfaafa14" path="/var/lib/kubelet/pods/6a9f8319-dcb3-4011-972c-8470bfaafa14/volumes"
Jul 13 03:12:31.064502 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:12:31.064471    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:12:31.176947 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:12:31.176895    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-676b6774c9-dfwfc"]
Jul 13 03:12:31.177305 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:12:31.177286    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a9f8319-dcb3-4011-972c-8470bfaafa14" containerName="manager"
Jul 13 03:12:31.177389 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:12:31.177308    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a9f8319-dcb3-4011-972c-8470bfaafa14" containerName="manager"
Jul 13 03:12:31.177441 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:12:31.177422    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a9f8319-dcb3-4011-972c-8470bfaafa14" containerName="manager"
Jul 13 03:12:31.181545 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:12:31.181524    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-676b6774c9-dfwfc"
Jul 13 03:12:31.184082 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:12:31.184060    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-wzl4h\""
Jul 13 03:12:31.184893 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:12:31.184876    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 13 03:12:31.185011 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:12:31.184911    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 13 03:12:31.189247 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:12:31.189225    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-676b6774c9-dfwfc"]
Jul 13 03:12:31.314487 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:12:31.314453    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5d6762f9-6232-4deb-a56d-285c907466ce-webhook-cert\") pod \"maas-controller-676b6774c9-dfwfc\" (UID: \"5d6762f9-6232-4deb-a56d-285c907466ce\") " pod="opendatahub/maas-controller-676b6774c9-dfwfc"
Jul 13 03:12:31.314910 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:12:31.314520    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swjwl\" (UniqueName: \"kubernetes.io/projected/5d6762f9-6232-4deb-a56d-285c907466ce-kube-api-access-swjwl\") pod \"maas-controller-676b6774c9-dfwfc\" (UID: \"5d6762f9-6232-4deb-a56d-285c907466ce\") " pod="opendatahub/maas-controller-676b6774c9-dfwfc"
Jul 13 03:12:31.415052 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:12:31.415022    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5d6762f9-6232-4deb-a56d-285c907466ce-webhook-cert\") pod \"maas-controller-676b6774c9-dfwfc\" (UID: \"5d6762f9-6232-4deb-a56d-285c907466ce\") " pod="opendatahub/maas-controller-676b6774c9-dfwfc"
Jul 13 03:12:31.415240 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:12:31.415079    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swjwl\" (UniqueName: \"kubernetes.io/projected/5d6762f9-6232-4deb-a56d-285c907466ce-kube-api-access-swjwl\") pod \"maas-controller-676b6774c9-dfwfc\" (UID: \"5d6762f9-6232-4deb-a56d-285c907466ce\") " pod="opendatahub/maas-controller-676b6774c9-dfwfc"
Jul 13 03:12:31.417768 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:12:31.417743    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5d6762f9-6232-4deb-a56d-285c907466ce-webhook-cert\") pod \"maas-controller-676b6774c9-dfwfc\" (UID: \"5d6762f9-6232-4deb-a56d-285c907466ce\") " pod="opendatahub/maas-controller-676b6774c9-dfwfc"
Jul 13 03:12:31.423097 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:12:31.423080    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-swjwl\" (UniqueName: \"kubernetes.io/projected/5d6762f9-6232-4deb-a56d-285c907466ce-kube-api-access-swjwl\") pod \"maas-controller-676b6774c9-dfwfc\" (UID: \"5d6762f9-6232-4deb-a56d-285c907466ce\") " pod="opendatahub/maas-controller-676b6774c9-dfwfc"
Jul 13 03:12:31.492844 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:12:31.492796    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-676b6774c9-dfwfc"
Jul 13 03:12:31.622437 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:12:31.622416    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-676b6774c9-dfwfc"]
Jul 13 03:12:31.624705 ip-10-0-142-39 kubenswrapper[2563]: W0713 03:12:31.624684    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d6762f9_6232_4deb_a56d_285c907466ce.slice/crio-1bb02a061e987367a0cc388de39fa0c59eb31bd3e5824ebb6271f35b91aaaefa WatchSource:0}: Error finding container 1bb02a061e987367a0cc388de39fa0c59eb31bd3e5824ebb6271f35b91aaaefa: Status 404 returned error can't find the container with id 1bb02a061e987367a0cc388de39fa0c59eb31bd3e5824ebb6271f35b91aaaefa
Jul 13 03:12:32.399666 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:12:32.399590    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-676b6774c9-dfwfc" event={"ID":"5d6762f9-6232-4deb-a56d-285c907466ce","Type":"ContainerStarted","Data":"b7fc91e0254c213266bf1e9d8c996015e9eefa67bb77ef7606cb1d8636c904b3"}
Jul 13 03:12:32.399666 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:12:32.399636    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-676b6774c9-dfwfc" event={"ID":"5d6762f9-6232-4deb-a56d-285c907466ce","Type":"ContainerStarted","Data":"1bb02a061e987367a0cc388de39fa0c59eb31bd3e5824ebb6271f35b91aaaefa"}
Jul 13 03:12:32.400066 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:12:32.399677    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-676b6774c9-dfwfc"
Jul 13 03:12:32.416115 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:12:32.416031    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-676b6774c9-dfwfc" podStartSLOduration=0.981387693 podStartE2EDuration="1.416013169s" totalImagesPullingTime="434.625476ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:12:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:12:32.414204716 +0000 UTC m=+968.396994825" watchObservedRunningTime="2026-07-13 03:12:32.416013169 +0000 UTC m=+968.398803281"
Jul 13 03:12:43.410214 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:12:43.410183    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-676b6774c9-dfwfc"
Jul 13 03:12:49.469902 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:12:49.469822    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:13:01.562288 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:13:01.562246    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:13:11.638284 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:13:11.638234    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:13:11.737724 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:13:11.737687    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:13:11.834355 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:13:11.834330    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:13:17.548185 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:13:17.548150    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:13:17.610215 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:13:17.610167    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:13:17.711133 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:13:17.711098    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:13:17.793118 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:13:17.793091    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:13:17.912450 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:13:17.912382    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:13:23.728301 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:13:23.728268    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:13:23.785532 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:13:23.785496    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:16:24.511318 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:16:24.511251    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v2725_a8933b47-8580-45ab-9f75-57c9a3f26842/ovn-acl-logging/0.log"
Jul 13 03:16:24.512017 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:16:24.511995    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v2725_a8933b47-8580-45ab-9f75-57c9a3f26842/ovn-acl-logging/0.log"
Jul 13 03:18:12.007885 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:18:12.007853    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:18:13.309715 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:18:13.309687    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:18:19.752308 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:18:19.752272    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:18:19.853592 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:18:19.853544    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:21:24.538105 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:21:24.538077    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v2725_a8933b47-8580-45ab-9f75-57c9a3f26842/ovn-acl-logging/0.log"
Jul 13 03:21:24.540552 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:21:24.540534    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v2725_a8933b47-8580-45ab-9f75-57c9a3f26842/ovn-acl-logging/0.log"
Jul 13 03:21:34.926089 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:21:34.926049    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:23:58.788191 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:23:58.788154    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:24:06.189296 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:24:06.189259    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:24:14.442736 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:24:14.442695    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:24:19.536267 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:24:19.536236    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:25:57.168170 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:25:57.168138    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:25:57.216218 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:25:57.216188    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:26:24.564384 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:26:24.564355    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v2725_a8933b47-8580-45ab-9f75-57c9a3f26842/ovn-acl-logging/0.log"
Jul 13 03:26:24.568689 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:26:24.568668    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v2725_a8933b47-8580-45ab-9f75-57c9a3f26842/ovn-acl-logging/0.log"
Jul 13 03:27:39.680615 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:27:39.680572    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:30:31.005009 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:31.004972    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:30:32.587351 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:32.587321    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:30:37.039239 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:37.039201    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:30:37.139164 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:37.139138    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:30:37.239097 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:37.239068    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:30:37.339029 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:37.338976    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:30:37.691633 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:37.691550    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:30:37.791772 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:37.791730    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:30:38.320055 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:38.320018    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:30:38.420926 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:38.420894    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:30:38.728534 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:38.728463    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-927ff568-789f946c69-h6zqh"]
Jul 13 03:30:38.732007 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:38.731979    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-927ff568-789f946c69-h6zqh"
Jul 13 03:30:38.734509 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:38.734484    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-927ff568-serving-cert\""
Jul 13 03:30:38.744390 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:38.744366    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-927ff568-789f946c69-h6zqh"]
Jul 13 03:30:38.762838 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:38.762804    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:30:38.834850 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:38.834815    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:30:38.837153 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:38.837133    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsqh2\" (UniqueName: \"kubernetes.io/projected/2dbc159f-c93f-43e2-8d37-5c3fa78155e6-kube-api-access-wsqh2\") pod \"maas-api-e2e-ait-927ff568-789f946c69-h6zqh\" (UID: \"2dbc159f-c93f-43e2-8d37-5c3fa78155e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-927ff568-789f946c69-h6zqh"
Jul 13 03:30:38.837228 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:38.837183    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2dbc159f-c93f-43e2-8d37-5c3fa78155e6-maas-api-tls\") pod \"maas-api-e2e-ait-927ff568-789f946c69-h6zqh\" (UID: \"2dbc159f-c93f-43e2-8d37-5c3fa78155e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-927ff568-789f946c69-h6zqh"
Jul 13 03:30:38.837228 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:38.837201    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2dbc159f-c93f-43e2-8d37-5c3fa78155e6-openshift-service-ca\") pod \"maas-api-e2e-ait-927ff568-789f946c69-h6zqh\" (UID: \"2dbc159f-c93f-43e2-8d37-5c3fa78155e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-927ff568-789f946c69-h6zqh"
Jul 13 03:30:38.938532 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:38.938498    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsqh2\" (UniqueName: \"kubernetes.io/projected/2dbc159f-c93f-43e2-8d37-5c3fa78155e6-kube-api-access-wsqh2\") pod \"maas-api-e2e-ait-927ff568-789f946c69-h6zqh\" (UID: \"2dbc159f-c93f-43e2-8d37-5c3fa78155e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-927ff568-789f946c69-h6zqh"
Jul 13 03:30:38.938724 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:38.938549    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2dbc159f-c93f-43e2-8d37-5c3fa78155e6-maas-api-tls\") pod \"maas-api-e2e-ait-927ff568-789f946c69-h6zqh\" (UID: \"2dbc159f-c93f-43e2-8d37-5c3fa78155e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-927ff568-789f946c69-h6zqh"
Jul 13 03:30:38.938724 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:38.938572    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2dbc159f-c93f-43e2-8d37-5c3fa78155e6-openshift-service-ca\") pod \"maas-api-e2e-ait-927ff568-789f946c69-h6zqh\" (UID: \"2dbc159f-c93f-43e2-8d37-5c3fa78155e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-927ff568-789f946c69-h6zqh"
Jul 13 03:30:38.939356 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:38.939336    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2dbc159f-c93f-43e2-8d37-5c3fa78155e6-openshift-service-ca\") pod \"maas-api-e2e-ait-927ff568-789f946c69-h6zqh\" (UID: \"2dbc159f-c93f-43e2-8d37-5c3fa78155e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-927ff568-789f946c69-h6zqh"
Jul 13 03:30:38.941105 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:38.941087    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2dbc159f-c93f-43e2-8d37-5c3fa78155e6-maas-api-tls\") pod \"maas-api-e2e-ait-927ff568-789f946c69-h6zqh\" (UID: \"2dbc159f-c93f-43e2-8d37-5c3fa78155e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-927ff568-789f946c69-h6zqh"
Jul 13 03:30:38.946047 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:38.946030    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsqh2\" (UniqueName: \"kubernetes.io/projected/2dbc159f-c93f-43e2-8d37-5c3fa78155e6-kube-api-access-wsqh2\") pod \"maas-api-e2e-ait-927ff568-789f946c69-h6zqh\" (UID: \"2dbc159f-c93f-43e2-8d37-5c3fa78155e6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-927ff568-789f946c69-h6zqh"
Jul 13 03:30:39.044650 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:39.044538    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-927ff568-789f946c69-h6zqh"
Jul 13 03:30:39.177298 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:39.177269    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:30:39.177794 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:39.177577    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-927ff568-789f946c69-h6zqh"]
Jul 13 03:30:39.179992 ip-10-0-142-39 kubenswrapper[2563]: W0713 03:30:39.179963    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dbc159f_c93f_43e2_8d37_5c3fa78155e6.slice/crio-855b538df1793510632738ec3a08a9d412a144acadcda54f07dc646911e6e172 WatchSource:0}: Error finding container 855b538df1793510632738ec3a08a9d412a144acadcda54f07dc646911e6e172: Status 404 returned error can't find the container with id 855b538df1793510632738ec3a08a9d412a144acadcda54f07dc646911e6e172
Jul 13 03:30:39.181621 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:39.181598    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 03:30:39.259461 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:39.259423    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:30:40.188837 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:40.188803    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-927ff568-789f946c69-h6zqh" event={"ID":"2dbc159f-c93f-43e2-8d37-5c3fa78155e6","Type":"ContainerStarted","Data":"bae809a96add819d9fab1e5f47e9bf8b786e14086233e35be9d67aa0fc79ad9f"}
Jul 13 03:30:40.189225 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:40.188855    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-927ff568-789f946c69-h6zqh" event={"ID":"2dbc159f-c93f-43e2-8d37-5c3fa78155e6","Type":"ContainerStarted","Data":"855b538df1793510632738ec3a08a9d412a144acadcda54f07dc646911e6e172"}
Jul 13 03:30:40.189225 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:40.188882    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-927ff568-789f946c69-h6zqh"
Jul 13 03:30:40.205247 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:40.205193    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-927ff568-789f946c69-h6zqh" podStartSLOduration=1.36374389 podStartE2EDuration="2.205174674s" totalImagesPullingTime="841.430784ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:30:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:30:40.204170481 +0000 UTC m=+2056.186960592" watchObservedRunningTime="2026-07-13 03:30:40.205174674 +0000 UTC m=+2056.187964785"
Jul 13 03:30:40.774170 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:40.774139    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:30:43.336339 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:43.336306    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-927ff568-789f946c69-h6zqh"]
Jul 13 03:30:43.336818 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:43.336539    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-927ff568-789f946c69-h6zqh" podUID="2dbc159f-c93f-43e2-8d37-5c3fa78155e6" containerName="maas-api" containerID="cri-o://bae809a96add819d9fab1e5f47e9bf8b786e14086233e35be9d67aa0fc79ad9f" gracePeriod=30
Jul 13 03:30:43.356376 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:43.356353    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:30:43.456340 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:43.456316    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:30:43.564597 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:43.564574    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:30:43.584597 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:43.584575    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-927ff568-789f946c69-h6zqh"
Jul 13 03:30:43.661671 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:43.661595    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:30:43.678872 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:43.678841    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2dbc159f-c93f-43e2-8d37-5c3fa78155e6-openshift-service-ca\") pod \"2dbc159f-c93f-43e2-8d37-5c3fa78155e6\" (UID: \"2dbc159f-c93f-43e2-8d37-5c3fa78155e6\") "
Jul 13 03:30:43.679035 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:43.678887    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2dbc159f-c93f-43e2-8d37-5c3fa78155e6-maas-api-tls\") pod \"2dbc159f-c93f-43e2-8d37-5c3fa78155e6\" (UID: \"2dbc159f-c93f-43e2-8d37-5c3fa78155e6\") "
Jul 13 03:30:43.679035 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:43.678967    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wsqh2\" (UniqueName: \"kubernetes.io/projected/2dbc159f-c93f-43e2-8d37-5c3fa78155e6-kube-api-access-wsqh2\") pod \"2dbc159f-c93f-43e2-8d37-5c3fa78155e6\" (UID: \"2dbc159f-c93f-43e2-8d37-5c3fa78155e6\") "
Jul 13 03:30:43.679288 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:43.679263    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2dbc159f-c93f-43e2-8d37-5c3fa78155e6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2dbc159f-c93f-43e2-8d37-5c3fa78155e6" (UID: "2dbc159f-c93f-43e2-8d37-5c3fa78155e6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 03:30:43.681325 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:43.681300    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2dbc159f-c93f-43e2-8d37-5c3fa78155e6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2dbc159f-c93f-43e2-8d37-5c3fa78155e6" (UID: "2dbc159f-c93f-43e2-8d37-5c3fa78155e6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 03:30:43.681414 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:43.681306    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2dbc159f-c93f-43e2-8d37-5c3fa78155e6-kube-api-access-wsqh2" (OuterVolumeSpecName: "kube-api-access-wsqh2") pod "2dbc159f-c93f-43e2-8d37-5c3fa78155e6" (UID: "2dbc159f-c93f-43e2-8d37-5c3fa78155e6"). InnerVolumeSpecName "kube-api-access-wsqh2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 03:30:43.780436 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:43.780408    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2dbc159f-c93f-43e2-8d37-5c3fa78155e6-openshift-service-ca\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 13 03:30:43.780436 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:43.780431    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2dbc159f-c93f-43e2-8d37-5c3fa78155e6-maas-api-tls\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 13 03:30:43.780436 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:43.780440    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wsqh2\" (UniqueName: \"kubernetes.io/projected/2dbc159f-c93f-43e2-8d37-5c3fa78155e6-kube-api-access-wsqh2\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 13 03:30:44.206712 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:44.206678    2563 generic.go:356] "Generic (PLEG): container finished" podID="2dbc159f-c93f-43e2-8d37-5c3fa78155e6" containerID="bae809a96add819d9fab1e5f47e9bf8b786e14086233e35be9d67aa0fc79ad9f" exitCode=0
Jul 13 03:30:44.206855 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:44.206728    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-927ff568-789f946c69-h6zqh"
Jul 13 03:30:44.206855 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:44.206766    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-927ff568-789f946c69-h6zqh" event={"ID":"2dbc159f-c93f-43e2-8d37-5c3fa78155e6","Type":"ContainerDied","Data":"bae809a96add819d9fab1e5f47e9bf8b786e14086233e35be9d67aa0fc79ad9f"}
Jul 13 03:30:44.206855 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:44.206819    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-927ff568-789f946c69-h6zqh" event={"ID":"2dbc159f-c93f-43e2-8d37-5c3fa78155e6","Type":"ContainerDied","Data":"855b538df1793510632738ec3a08a9d412a144acadcda54f07dc646911e6e172"}
Jul 13 03:30:44.206855 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:44.206844    2563 scope.go:117] "RemoveContainer" containerID="bae809a96add819d9fab1e5f47e9bf8b786e14086233e35be9d67aa0fc79ad9f"
Jul 13 03:30:44.217083 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:44.217065    2563 scope.go:117] "RemoveContainer" containerID="bae809a96add819d9fab1e5f47e9bf8b786e14086233e35be9d67aa0fc79ad9f"
Jul 13 03:30:44.217351 ip-10-0-142-39 kubenswrapper[2563]: E0713 03:30:44.217333    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bae809a96add819d9fab1e5f47e9bf8b786e14086233e35be9d67aa0fc79ad9f\": container with ID starting with bae809a96add819d9fab1e5f47e9bf8b786e14086233e35be9d67aa0fc79ad9f not found: ID does not exist" containerID="bae809a96add819d9fab1e5f47e9bf8b786e14086233e35be9d67aa0fc79ad9f"
Jul 13 03:30:44.217411 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:44.217362    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bae809a96add819d9fab1e5f47e9bf8b786e14086233e35be9d67aa0fc79ad9f"} err="failed to get container status \"bae809a96add819d9fab1e5f47e9bf8b786e14086233e35be9d67aa0fc79ad9f\": rpc error: code = NotFound desc = could not find container \"bae809a96add819d9fab1e5f47e9bf8b786e14086233e35be9d67aa0fc79ad9f\": container with ID starting with bae809a96add819d9fab1e5f47e9bf8b786e14086233e35be9d67aa0fc79ad9f not found: ID does not exist"
Jul 13 03:30:44.227990 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:44.227970    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-927ff568-789f946c69-h6zqh"]
Jul 13 03:30:44.235169 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:44.235144    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-927ff568-789f946c69-h6zqh"]
Jul 13 03:30:44.530959 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:44.530865    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2dbc159f-c93f-43e2-8d37-5c3fa78155e6" path="/var/lib/kubelet/pods/2dbc159f-c93f-43e2-8d37-5c3fa78155e6/volumes"
Jul 13 03:30:44.910455 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:44.910406    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:30:49.377329 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:49.377232    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:30:49.435718 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:49.435685    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:30:49.650659 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:49.650554    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:30:49.748699 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:49.748664    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:30:50.798778 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:50.798740    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:30:50.889723 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:50.889687    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:30:50.954902 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:50.954861    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-49b1aeaf-557f4fc8c9-swbwg"]
Jul 13 03:30:50.955443 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:50.955425    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2dbc159f-c93f-43e2-8d37-5c3fa78155e6" containerName="maas-api"
Jul 13 03:30:50.955488 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:50.955446    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="2dbc159f-c93f-43e2-8d37-5c3fa78155e6" containerName="maas-api"
Jul 13 03:30:50.955555 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:50.955545    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="2dbc159f-c93f-43e2-8d37-5c3fa78155e6" containerName="maas-api"
Jul 13 03:30:50.960161 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:50.960141    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-49b1aeaf-557f4fc8c9-swbwg"
Jul 13 03:30:50.962209 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:50.962190    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-49b1aeaf-serving-cert\""
Jul 13 03:30:50.969130 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:50.969104    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-49b1aeaf-557f4fc8c9-swbwg"]
Jul 13 03:30:50.988648 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:50.988623    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:30:51.040775 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:51.040739    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/be288c3c-37d4-4248-b4a3-588dbd5cd3df-openshift-service-ca\") pod \"maas-api-e2e-ait-49b1aeaf-557f4fc8c9-swbwg\" (UID: \"be288c3c-37d4-4248-b4a3-588dbd5cd3df\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-49b1aeaf-557f4fc8c9-swbwg"
Jul 13 03:30:51.041014 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:51.040802    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2fdp\" (UniqueName: \"kubernetes.io/projected/be288c3c-37d4-4248-b4a3-588dbd5cd3df-kube-api-access-w2fdp\") pod \"maas-api-e2e-ait-49b1aeaf-557f4fc8c9-swbwg\" (UID: \"be288c3c-37d4-4248-b4a3-588dbd5cd3df\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-49b1aeaf-557f4fc8c9-swbwg"
Jul 13 03:30:51.041014 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:51.040887    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/be288c3c-37d4-4248-b4a3-588dbd5cd3df-maas-api-tls\") pod \"maas-api-e2e-ait-49b1aeaf-557f4fc8c9-swbwg\" (UID: \"be288c3c-37d4-4248-b4a3-588dbd5cd3df\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-49b1aeaf-557f4fc8c9-swbwg"
Jul 13 03:30:51.142131 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:51.142044    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/be288c3c-37d4-4248-b4a3-588dbd5cd3df-maas-api-tls\") pod \"maas-api-e2e-ait-49b1aeaf-557f4fc8c9-swbwg\" (UID: \"be288c3c-37d4-4248-b4a3-588dbd5cd3df\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-49b1aeaf-557f4fc8c9-swbwg"
Jul 13 03:30:51.142131 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:51.142112    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/be288c3c-37d4-4248-b4a3-588dbd5cd3df-openshift-service-ca\") pod \"maas-api-e2e-ait-49b1aeaf-557f4fc8c9-swbwg\" (UID: \"be288c3c-37d4-4248-b4a3-588dbd5cd3df\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-49b1aeaf-557f4fc8c9-swbwg"
Jul 13 03:30:51.142360 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:51.142167    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2fdp\" (UniqueName: \"kubernetes.io/projected/be288c3c-37d4-4248-b4a3-588dbd5cd3df-kube-api-access-w2fdp\") pod \"maas-api-e2e-ait-49b1aeaf-557f4fc8c9-swbwg\" (UID: \"be288c3c-37d4-4248-b4a3-588dbd5cd3df\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-49b1aeaf-557f4fc8c9-swbwg"
Jul 13 03:30:51.142360 ip-10-0-142-39 kubenswrapper[2563]: E0713 03:30:51.142223    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-49b1aeaf-serving-cert: secret "maas-api-e2e-ait-49b1aeaf-serving-cert" not found
Jul 13 03:30:51.142360 ip-10-0-142-39 kubenswrapper[2563]: E0713 03:30:51.142298    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be288c3c-37d4-4248-b4a3-588dbd5cd3df-maas-api-tls podName:be288c3c-37d4-4248-b4a3-588dbd5cd3df nodeName:}" failed. No retries permitted until 2026-07-13 03:30:51.642278297 +0000 UTC m=+2067.625068384 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/be288c3c-37d4-4248-b4a3-588dbd5cd3df-maas-api-tls") pod "maas-api-e2e-ait-49b1aeaf-557f4fc8c9-swbwg" (UID: "be288c3c-37d4-4248-b4a3-588dbd5cd3df") : secret "maas-api-e2e-ait-49b1aeaf-serving-cert" not found
Jul 13 03:30:51.142741 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:51.142723    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/be288c3c-37d4-4248-b4a3-588dbd5cd3df-openshift-service-ca\") pod \"maas-api-e2e-ait-49b1aeaf-557f4fc8c9-swbwg\" (UID: \"be288c3c-37d4-4248-b4a3-588dbd5cd3df\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-49b1aeaf-557f4fc8c9-swbwg"
Jul 13 03:30:51.150385 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:51.150365    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2fdp\" (UniqueName: \"kubernetes.io/projected/be288c3c-37d4-4248-b4a3-588dbd5cd3df-kube-api-access-w2fdp\") pod \"maas-api-e2e-ait-49b1aeaf-557f4fc8c9-swbwg\" (UID: \"be288c3c-37d4-4248-b4a3-588dbd5cd3df\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-49b1aeaf-557f4fc8c9-swbwg"
Jul 13 03:30:51.333654 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:51.333618    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:30:51.434246 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:51.434171    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:30:51.535324 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:51.535296    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:30:51.647860 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:51.647827    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/be288c3c-37d4-4248-b4a3-588dbd5cd3df-maas-api-tls\") pod \"maas-api-e2e-ait-49b1aeaf-557f4fc8c9-swbwg\" (UID: \"be288c3c-37d4-4248-b4a3-588dbd5cd3df\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-49b1aeaf-557f4fc8c9-swbwg"
Jul 13 03:30:51.650319 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:51.650292    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/be288c3c-37d4-4248-b4a3-588dbd5cd3df-maas-api-tls\") pod \"maas-api-e2e-ait-49b1aeaf-557f4fc8c9-swbwg\" (UID: \"be288c3c-37d4-4248-b4a3-588dbd5cd3df\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-49b1aeaf-557f4fc8c9-swbwg"
Jul 13 03:30:51.871669 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:51.871637    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-49b1aeaf-557f4fc8c9-swbwg"
Jul 13 03:30:52.003709 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:52.003685    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-49b1aeaf-557f4fc8c9-swbwg"]
Jul 13 03:30:52.005757 ip-10-0-142-39 kubenswrapper[2563]: W0713 03:30:52.005733    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe288c3c_37d4_4248_b4a3_588dbd5cd3df.slice/crio-72533ea33d93036938fdbb570a8a4673cc685bb5cde09154e93aae964db45a3a WatchSource:0}: Error finding container 72533ea33d93036938fdbb570a8a4673cc685bb5cde09154e93aae964db45a3a: Status 404 returned error can't find the container with id 72533ea33d93036938fdbb570a8a4673cc685bb5cde09154e93aae964db45a3a
Jul 13 03:30:52.244022 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:52.243952    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-49b1aeaf-557f4fc8c9-swbwg" event={"ID":"be288c3c-37d4-4248-b4a3-588dbd5cd3df","Type":"ContainerStarted","Data":"72533ea33d93036938fdbb570a8a4673cc685bb5cde09154e93aae964db45a3a"}
Jul 13 03:30:52.923138 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:52.923104    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:30:53.249720 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:53.249636    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-49b1aeaf-557f4fc8c9-swbwg" event={"ID":"be288c3c-37d4-4248-b4a3-588dbd5cd3df","Type":"ContainerStarted","Data":"5bcaccdc7a6cc68c50b34ff787d9ca6bf2d1b4b9c58d6ed38058fb3065a09598"}
Jul 13 03:30:53.249908 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:53.249722    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-49b1aeaf-557f4fc8c9-swbwg"
Jul 13 03:30:53.272157 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:53.272109    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-49b1aeaf-557f4fc8c9-swbwg" podStartSLOduration=3.003502216 podStartE2EDuration="3.272092832s" totalImagesPullingTime="268.590616ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:30:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:30:53.263432126 +0000 UTC m=+2069.246222248" watchObservedRunningTime="2026-07-13 03:30:53.272092832 +0000 UTC m=+2069.254882942"
Jul 13 03:30:55.748773 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:55.748730    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-49b1aeaf-557f4fc8c9-swbwg"]
Jul 13 03:30:55.749496 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:55.749463    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-49b1aeaf-557f4fc8c9-swbwg" podUID="be288c3c-37d4-4248-b4a3-588dbd5cd3df" containerName="maas-api" containerID="cri-o://5bcaccdc7a6cc68c50b34ff787d9ca6bf2d1b4b9c58d6ed38058fb3065a09598" gracePeriod=30
Jul 13 03:30:55.769360 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:55.769333    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:30:55.823135 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:55.823105    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:30:56.005204 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:56.005143    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-49b1aeaf-557f4fc8c9-swbwg"
Jul 13 03:30:56.084343 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:56.084301    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w2fdp\" (UniqueName: \"kubernetes.io/projected/be288c3c-37d4-4248-b4a3-588dbd5cd3df-kube-api-access-w2fdp\") pod \"be288c3c-37d4-4248-b4a3-588dbd5cd3df\" (UID: \"be288c3c-37d4-4248-b4a3-588dbd5cd3df\") "
Jul 13 03:30:56.084544 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:56.084362    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/be288c3c-37d4-4248-b4a3-588dbd5cd3df-maas-api-tls\") pod \"be288c3c-37d4-4248-b4a3-588dbd5cd3df\" (UID: \"be288c3c-37d4-4248-b4a3-588dbd5cd3df\") "
Jul 13 03:30:56.084544 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:56.084383    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/be288c3c-37d4-4248-b4a3-588dbd5cd3df-openshift-service-ca\") pod \"be288c3c-37d4-4248-b4a3-588dbd5cd3df\" (UID: \"be288c3c-37d4-4248-b4a3-588dbd5cd3df\") "
Jul 13 03:30:56.084776 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:56.084751    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be288c3c-37d4-4248-b4a3-588dbd5cd3df-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "be288c3c-37d4-4248-b4a3-588dbd5cd3df" (UID: "be288c3c-37d4-4248-b4a3-588dbd5cd3df"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 03:30:56.086579 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:56.086557    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be288c3c-37d4-4248-b4a3-588dbd5cd3df-kube-api-access-w2fdp" (OuterVolumeSpecName: "kube-api-access-w2fdp") pod "be288c3c-37d4-4248-b4a3-588dbd5cd3df" (UID: "be288c3c-37d4-4248-b4a3-588dbd5cd3df"). InnerVolumeSpecName "kube-api-access-w2fdp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 03:30:56.086663 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:56.086641    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be288c3c-37d4-4248-b4a3-588dbd5cd3df-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "be288c3c-37d4-4248-b4a3-588dbd5cd3df" (UID: "be288c3c-37d4-4248-b4a3-588dbd5cd3df"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 03:30:56.185530 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:56.185500    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w2fdp\" (UniqueName: \"kubernetes.io/projected/be288c3c-37d4-4248-b4a3-588dbd5cd3df-kube-api-access-w2fdp\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 13 03:30:56.185530 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:56.185526    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/be288c3c-37d4-4248-b4a3-588dbd5cd3df-maas-api-tls\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 13 03:30:56.185678 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:56.185540    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/be288c3c-37d4-4248-b4a3-588dbd5cd3df-openshift-service-ca\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 13 03:30:56.263903 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:56.263838    2563 generic.go:356] "Generic (PLEG): container finished" podID="be288c3c-37d4-4248-b4a3-588dbd5cd3df" containerID="5bcaccdc7a6cc68c50b34ff787d9ca6bf2d1b4b9c58d6ed38058fb3065a09598" exitCode=0
Jul 13 03:30:56.263903 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:56.263871    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-49b1aeaf-557f4fc8c9-swbwg" event={"ID":"be288c3c-37d4-4248-b4a3-588dbd5cd3df","Type":"ContainerDied","Data":"5bcaccdc7a6cc68c50b34ff787d9ca6bf2d1b4b9c58d6ed38058fb3065a09598"}
Jul 13 03:30:56.264048 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:56.263901    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-49b1aeaf-557f4fc8c9-swbwg"
Jul 13 03:30:56.264048 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:56.263951    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-49b1aeaf-557f4fc8c9-swbwg" event={"ID":"be288c3c-37d4-4248-b4a3-588dbd5cd3df","Type":"ContainerDied","Data":"72533ea33d93036938fdbb570a8a4673cc685bb5cde09154e93aae964db45a3a"}
Jul 13 03:30:56.264048 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:56.263984    2563 scope.go:117] "RemoveContainer" containerID="5bcaccdc7a6cc68c50b34ff787d9ca6bf2d1b4b9c58d6ed38058fb3065a09598"
Jul 13 03:30:56.273538 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:56.273522    2563 scope.go:117] "RemoveContainer" containerID="5bcaccdc7a6cc68c50b34ff787d9ca6bf2d1b4b9c58d6ed38058fb3065a09598"
Jul 13 03:30:56.273801 ip-10-0-142-39 kubenswrapper[2563]: E0713 03:30:56.273783    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5bcaccdc7a6cc68c50b34ff787d9ca6bf2d1b4b9c58d6ed38058fb3065a09598\": container with ID starting with 5bcaccdc7a6cc68c50b34ff787d9ca6bf2d1b4b9c58d6ed38058fb3065a09598 not found: ID does not exist" containerID="5bcaccdc7a6cc68c50b34ff787d9ca6bf2d1b4b9c58d6ed38058fb3065a09598"
Jul 13 03:30:56.273861 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:56.273814    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5bcaccdc7a6cc68c50b34ff787d9ca6bf2d1b4b9c58d6ed38058fb3065a09598"} err="failed to get container status \"5bcaccdc7a6cc68c50b34ff787d9ca6bf2d1b4b9c58d6ed38058fb3065a09598\": rpc error: code = NotFound desc = could not find container \"5bcaccdc7a6cc68c50b34ff787d9ca6bf2d1b4b9c58d6ed38058fb3065a09598\": container with ID starting with 5bcaccdc7a6cc68c50b34ff787d9ca6bf2d1b4b9c58d6ed38058fb3065a09598 not found: ID does not exist"
Jul 13 03:30:56.284167 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:56.284148    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-49b1aeaf-557f4fc8c9-swbwg"]
Jul 13 03:30:56.289431 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:56.289411    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-49b1aeaf-557f4fc8c9-swbwg"]
Jul 13 03:30:56.532010 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:56.531922    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be288c3c-37d4-4248-b4a3-588dbd5cd3df" path="/var/lib/kubelet/pods/be288c3c-37d4-4248-b4a3-588dbd5cd3df/volumes"
Jul 13 03:30:56.709557 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:56.709524    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:30:56.809330 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:56.809302    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:30:59.001760 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:30:59.001726    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:31:02.418233 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:31:02.418198    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:31:02.472408 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:31:02.472378    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:31:02.620849 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:31:02.620822    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:31:02.718441 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:31:02.718366    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:31:03.709230 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:31:03.709186    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:31:03.807801 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:31:03.807772    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:31:05.955071 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:31:05.955020    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:31:08.139353 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:31:08.139319    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:31:08.372981 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:31:08.372926    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:31:08.473427 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:31:08.473332    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:31:09.881271 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:31:09.881233    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:31:14.082508 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:31:14.082478    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:31:14.137603 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:31:14.137574    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:31:14.534374 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:31:14.534262    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:31:14.633049 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:31:14.633019    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:31:14.734407 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:31:14.734378    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:31:16.103162 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:31:16.103129    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:31:21.792684 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:31:21.792649    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:31:21.855548 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:31:21.855518    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:31:21.925337 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:31:21.925304    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:31:22.025090 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:31:22.025055    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:31:22.125430 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:31:22.125403    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:31:22.473014 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:31:22.472905    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:31:24.590095 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:31:24.590073    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v2725_a8933b47-8580-45ab-9f75-57c9a3f26842/ovn-acl-logging/0.log"
Jul 13 03:31:24.595047 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:31:24.595027    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v2725_a8933b47-8580-45ab-9f75-57c9a3f26842/ovn-acl-logging/0.log"
Jul 13 03:31:48.422711 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:31:48.422679    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:31:54.082149 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:31:54.082110    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:31:54.132583 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:31:54.132554    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:31:54.210083 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:31:54.210046    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:31:54.358168 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:31:54.358098    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:32:10.174636 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:32:10.174603    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:32:15.779032 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:32:15.778952    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:32:15.842894 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:32:15.842859    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:32:15.909804 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:32:15.909775    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:32:16.009500 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:32:16.009465    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:32:26.503018 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:32:26.502983    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:32:27.283947 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:32:27.283895    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:32:32.897625 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:32:32.897592    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:32:32.998125 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:32:32.998095    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:32:33.097533 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:32:33.097498    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:32:33.200440 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:32:33.200369    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:32:33.935264 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:32:33.935231    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:32:34.034269 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:32:34.034232    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:32:34.134019 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:32:34.133994    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:32:35.717233 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:32:35.717199    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:32:41.428965 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:32:41.428913    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:32:41.488201 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:32:41.488161    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:32:42.067149 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:32:42.067119    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:32:48.132114 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:32:48.132079    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:32:48.233043 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:32:48.233010    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:32:48.360747 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:32:48.360720    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:32:48.670461 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:32:48.670433    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:32:48.986352 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:32:48.986273    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:32:51.877797 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:32:51.877755    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:32:51.972289 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:32:51.972260    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:32:56.364812 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:32:56.364778    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:34:50.259780 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:34:50.259738    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:36:01.309372 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:36:01.309341    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:36:03.028382 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:36:03.028347    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:36:07.401459 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:36:07.401401    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:36:07.502464 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:36:07.502431    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:36:07.620497 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:36:07.620464    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:36:07.894710 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:36:07.894665    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:36:08.000029 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:36:07.999982    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:36:08.102655 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:36:08.102610    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:36:08.231261 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:36:08.231168    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:36:09.166291 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:36:09.166258    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:36:14.029648 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:36:14.029612    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:36:14.090290 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:36:14.090262    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:36:14.161229 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:36:14.161193    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:36:14.257704 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:36:14.257670    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:36:14.376977 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:36:14.376912    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:36:20.240853 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:36:20.240815    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:36:20.341033 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:36:20.340998    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:36:24.616210 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:36:24.616180    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v2725_a8933b47-8580-45ab-9f75-57c9a3f26842/ovn-acl-logging/0.log"
Jul 13 03:36:24.623738 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:36:24.623718    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v2725_a8933b47-8580-45ab-9f75-57c9a3f26842/ovn-acl-logging/0.log"
Jul 13 03:36:26.925498 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:36:26.925459    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:36:27.223242 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:36:27.223161    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:36:27.740700 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:36:27.740665    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:36:30.072640 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:36:30.072581    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:36:30.170487 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:36:30.170459    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:36:30.245871 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:36:30.245843    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-766a483d-555595dd98-fjx4p"]
Jul 13 03:36:30.246249 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:36:30.246227    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be288c3c-37d4-4248-b4a3-588dbd5cd3df" containerName="maas-api"
Jul 13 03:36:30.246249 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:36:30.246246    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="be288c3c-37d4-4248-b4a3-588dbd5cd3df" containerName="maas-api"
Jul 13 03:36:30.246430 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:36:30.246327    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="be288c3c-37d4-4248-b4a3-588dbd5cd3df" containerName="maas-api"
Jul 13 03:36:30.249274 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:36:30.249257    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-766a483d-555595dd98-fjx4p"
Jul 13 03:36:30.251468 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:36:30.251443    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-766a483d-serving-cert\""
Jul 13 03:36:30.260953 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:36:30.260905    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-766a483d-555595dd98-fjx4p"]
Jul 13 03:36:30.286681 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:36:30.286649    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:36:30.399305 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:36:30.399239    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6sxpg\" (UniqueName: \"kubernetes.io/projected/fc681a9e-c6c5-44b3-a0f3-5a8592373cf7-kube-api-access-6sxpg\") pod \"maas-api-e2e-mt-766a483d-555595dd98-fjx4p\" (UID: \"fc681a9e-c6c5-44b3-a0f3-5a8592373cf7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-766a483d-555595dd98-fjx4p"
Jul 13 03:36:30.399305 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:36:30.399299    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc681a9e-c6c5-44b3-a0f3-5a8592373cf7-openshift-service-ca\") pod \"maas-api-e2e-mt-766a483d-555595dd98-fjx4p\" (UID: \"fc681a9e-c6c5-44b3-a0f3-5a8592373cf7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-766a483d-555595dd98-fjx4p"
Jul 13 03:36:30.399466 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:36:30.399333    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc681a9e-c6c5-44b3-a0f3-5a8592373cf7-maas-api-tls\") pod \"maas-api-e2e-mt-766a483d-555595dd98-fjx4p\" (UID: \"fc681a9e-c6c5-44b3-a0f3-5a8592373cf7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-766a483d-555595dd98-fjx4p"
Jul 13 03:36:30.500569 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:36:30.500538    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc681a9e-c6c5-44b3-a0f3-5a8592373cf7-openshift-service-ca\") pod \"maas-api-e2e-mt-766a483d-555595dd98-fjx4p\" (UID: \"fc681a9e-c6c5-44b3-a0f3-5a8592373cf7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-766a483d-555595dd98-fjx4p"
Jul 13 03:36:30.500691 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:36:30.500577    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc681a9e-c6c5-44b3-a0f3-5a8592373cf7-maas-api-tls\") pod \"maas-api-e2e-mt-766a483d-555595dd98-fjx4p\" (UID: \"fc681a9e-c6c5-44b3-a0f3-5a8592373cf7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-766a483d-555595dd98-fjx4p"
Jul 13 03:36:30.500747 ip-10-0-142-39 kubenswrapper[2563]: E0713 03:36:30.500691    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-766a483d-serving-cert: secret "maas-api-e2e-mt-766a483d-serving-cert" not found
Jul 13 03:36:30.500747 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:36:30.500713    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6sxpg\" (UniqueName: \"kubernetes.io/projected/fc681a9e-c6c5-44b3-a0f3-5a8592373cf7-kube-api-access-6sxpg\") pod \"maas-api-e2e-mt-766a483d-555595dd98-fjx4p\" (UID: \"fc681a9e-c6c5-44b3-a0f3-5a8592373cf7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-766a483d-555595dd98-fjx4p"
Jul 13 03:36:30.500855 ip-10-0-142-39 kubenswrapper[2563]: E0713 03:36:30.500755    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc681a9e-c6c5-44b3-a0f3-5a8592373cf7-maas-api-tls podName:fc681a9e-c6c5-44b3-a0f3-5a8592373cf7 nodeName:}" failed. No retries permitted until 2026-07-13 03:36:31.000734303 +0000 UTC m=+2406.983524390 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/fc681a9e-c6c5-44b3-a0f3-5a8592373cf7-maas-api-tls") pod "maas-api-e2e-mt-766a483d-555595dd98-fjx4p" (UID: "fc681a9e-c6c5-44b3-a0f3-5a8592373cf7") : secret "maas-api-e2e-mt-766a483d-serving-cert" not found
Jul 13 03:36:30.501250 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:36:30.501230    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc681a9e-c6c5-44b3-a0f3-5a8592373cf7-openshift-service-ca\") pod \"maas-api-e2e-mt-766a483d-555595dd98-fjx4p\" (UID: \"fc681a9e-c6c5-44b3-a0f3-5a8592373cf7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-766a483d-555595dd98-fjx4p"
Jul 13 03:36:30.508925 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:36:30.508908    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6sxpg\" (UniqueName: \"kubernetes.io/projected/fc681a9e-c6c5-44b3-a0f3-5a8592373cf7-kube-api-access-6sxpg\") pod \"maas-api-e2e-mt-766a483d-555595dd98-fjx4p\" (UID: \"fc681a9e-c6c5-44b3-a0f3-5a8592373cf7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-766a483d-555595dd98-fjx4p"
Jul 13 03:36:30.701760 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:36:30.701691    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:36:30.803247 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:36:30.803206    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:36:30.902917 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:36:30.902887    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:36:31.005222 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:36:31.005147    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc681a9e-c6c5-44b3-a0f3-5a8592373cf7-maas-api-tls\") pod \"maas-api-e2e-mt-766a483d-555595dd98-fjx4p\" (UID: \"fc681a9e-c6c5-44b3-a0f3-5a8592373cf7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-766a483d-555595dd98-fjx4p"
Jul 13 03:36:31.007691 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:36:31.007663    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc681a9e-c6c5-44b3-a0f3-5a8592373cf7-maas-api-tls\") pod \"maas-api-e2e-mt-766a483d-555595dd98-fjx4p\" (UID: \"fc681a9e-c6c5-44b3-a0f3-5a8592373cf7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-766a483d-555595dd98-fjx4p"
Jul 13 03:36:31.162792 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:36:31.162759    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-766a483d-555595dd98-fjx4p"
Jul 13 03:36:31.294983 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:36:31.294956    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-766a483d-555595dd98-fjx4p"]
Jul 13 03:36:31.296795 ip-10-0-142-39 kubenswrapper[2563]: W0713 03:36:31.296766    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc681a9e_c6c5_44b3_a0f3_5a8592373cf7.slice/crio-ab40b7401597cec8e5e3274ce357c096f3cdbc7b373ce6b87d3189306e2382c2 WatchSource:0}: Error finding container ab40b7401597cec8e5e3274ce357c096f3cdbc7b373ce6b87d3189306e2382c2: Status 404 returned error can't find the container with id ab40b7401597cec8e5e3274ce357c096f3cdbc7b373ce6b87d3189306e2382c2
Jul 13 03:36:31.298155 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:36:31.298133    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 03:36:31.727476 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:36:31.727440    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-766a483d-555595dd98-fjx4p" event={"ID":"fc681a9e-c6c5-44b3-a0f3-5a8592373cf7","Type":"ContainerStarted","Data":"ab40b7401597cec8e5e3274ce357c096f3cdbc7b373ce6b87d3189306e2382c2"}
Jul 13 03:36:32.733169 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:36:32.733129    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-766a483d-555595dd98-fjx4p" event={"ID":"fc681a9e-c6c5-44b3-a0f3-5a8592373cf7","Type":"ContainerStarted","Data":"2461b4d70ddaccb68148abc0b7cae93a85060af315aa6884152cd6fd8cd5294e"}
Jul 13 03:36:32.733633 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:36:32.733216    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-766a483d-555595dd98-fjx4p"
Jul 13 03:36:32.749428 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:36:32.749381    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-766a483d-555595dd98-fjx4p" podStartSLOduration=2.2557975900000002 podStartE2EDuration="2.749365858s" totalImagesPullingTime="493.568268ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:36:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:36:32.746978128 +0000 UTC m=+2408.729768237" watchObservedRunningTime="2026-07-13 03:36:32.749365858 +0000 UTC m=+2408.732155967"
Jul 13 03:36:34.573144 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:36:34.573117    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:36:38.744424 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:36:38.744391    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-766a483d-555595dd98-fjx4p"
Jul 13 03:36:52.554363 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:36:52.554271    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:36:57.937422 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:36:57.937388    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:37:11.980266 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:37:11.980231    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-766a483d-555595dd98-fjx4p"]
Jul 13 03:37:11.981036 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:37:11.981002    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-766a483d-555595dd98-fjx4p" podUID="fc681a9e-c6c5-44b3-a0f3-5a8592373cf7" containerName="maas-api" containerID="cri-o://2461b4d70ddaccb68148abc0b7cae93a85060af315aa6884152cd6fd8cd5294e" gracePeriod=30
Jul 13 03:37:12.011349 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:37:12.011323    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:37:12.064987 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:37:12.064961    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:37:12.224475 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:37:12.224455    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-766a483d-555595dd98-fjx4p"
Jul 13 03:37:12.358702 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:37:12.358664    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc681a9e-c6c5-44b3-a0f3-5a8592373cf7-maas-api-tls\") pod \"fc681a9e-c6c5-44b3-a0f3-5a8592373cf7\" (UID: \"fc681a9e-c6c5-44b3-a0f3-5a8592373cf7\") "
Jul 13 03:37:12.358862 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:37:12.358720    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6sxpg\" (UniqueName: \"kubernetes.io/projected/fc681a9e-c6c5-44b3-a0f3-5a8592373cf7-kube-api-access-6sxpg\") pod \"fc681a9e-c6c5-44b3-a0f3-5a8592373cf7\" (UID: \"fc681a9e-c6c5-44b3-a0f3-5a8592373cf7\") "
Jul 13 03:37:12.358862 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:37:12.358763    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc681a9e-c6c5-44b3-a0f3-5a8592373cf7-openshift-service-ca\") pod \"fc681a9e-c6c5-44b3-a0f3-5a8592373cf7\" (UID: \"fc681a9e-c6c5-44b3-a0f3-5a8592373cf7\") "
Jul 13 03:37:12.359167 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:37:12.359143    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc681a9e-c6c5-44b3-a0f3-5a8592373cf7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fc681a9e-c6c5-44b3-a0f3-5a8592373cf7" (UID: "fc681a9e-c6c5-44b3-a0f3-5a8592373cf7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 03:37:12.360836 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:37:12.360812    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc681a9e-c6c5-44b3-a0f3-5a8592373cf7-kube-api-access-6sxpg" (OuterVolumeSpecName: "kube-api-access-6sxpg") pod "fc681a9e-c6c5-44b3-a0f3-5a8592373cf7" (UID: "fc681a9e-c6c5-44b3-a0f3-5a8592373cf7"). InnerVolumeSpecName "kube-api-access-6sxpg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 03:37:12.360836 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:37:12.360818    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc681a9e-c6c5-44b3-a0f3-5a8592373cf7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fc681a9e-c6c5-44b3-a0f3-5a8592373cf7" (UID: "fc681a9e-c6c5-44b3-a0f3-5a8592373cf7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 03:37:12.460284 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:37:12.460253    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc681a9e-c6c5-44b3-a0f3-5a8592373cf7-maas-api-tls\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 13 03:37:12.460284 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:37:12.460279    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6sxpg\" (UniqueName: \"kubernetes.io/projected/fc681a9e-c6c5-44b3-a0f3-5a8592373cf7-kube-api-access-6sxpg\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 13 03:37:12.460284 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:37:12.460288    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc681a9e-c6c5-44b3-a0f3-5a8592373cf7-openshift-service-ca\") on node \"ip-10-0-142-39.ec2.internal\" DevicePath \"\""
Jul 13 03:37:12.913421 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:37:12.913388    2563 generic.go:356] "Generic (PLEG): container finished" podID="fc681a9e-c6c5-44b3-a0f3-5a8592373cf7" containerID="2461b4d70ddaccb68148abc0b7cae93a85060af315aa6884152cd6fd8cd5294e" exitCode=0
Jul 13 03:37:12.913619 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:37:12.913433    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-766a483d-555595dd98-fjx4p"
Jul 13 03:37:12.913619 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:37:12.913474    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-766a483d-555595dd98-fjx4p" event={"ID":"fc681a9e-c6c5-44b3-a0f3-5a8592373cf7","Type":"ContainerDied","Data":"2461b4d70ddaccb68148abc0b7cae93a85060af315aa6884152cd6fd8cd5294e"}
Jul 13 03:37:12.913619 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:37:12.913535    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-766a483d-555595dd98-fjx4p" event={"ID":"fc681a9e-c6c5-44b3-a0f3-5a8592373cf7","Type":"ContainerDied","Data":"ab40b7401597cec8e5e3274ce357c096f3cdbc7b373ce6b87d3189306e2382c2"}
Jul 13 03:37:12.913619 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:37:12.913565    2563 scope.go:117] "RemoveContainer" containerID="2461b4d70ddaccb68148abc0b7cae93a85060af315aa6884152cd6fd8cd5294e"
Jul 13 03:37:12.922034 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:37:12.922019    2563 scope.go:117] "RemoveContainer" containerID="2461b4d70ddaccb68148abc0b7cae93a85060af315aa6884152cd6fd8cd5294e"
Jul 13 03:37:12.922270 ip-10-0-142-39 kubenswrapper[2563]: E0713 03:37:12.922249    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2461b4d70ddaccb68148abc0b7cae93a85060af315aa6884152cd6fd8cd5294e\": container with ID starting with 2461b4d70ddaccb68148abc0b7cae93a85060af315aa6884152cd6fd8cd5294e not found: ID does not exist" containerID="2461b4d70ddaccb68148abc0b7cae93a85060af315aa6884152cd6fd8cd5294e"
Jul 13 03:37:12.922331 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:37:12.922277    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2461b4d70ddaccb68148abc0b7cae93a85060af315aa6884152cd6fd8cd5294e"} err="failed to get container status \"2461b4d70ddaccb68148abc0b7cae93a85060af315aa6884152cd6fd8cd5294e\": rpc error: code = NotFound desc = could not find container \"2461b4d70ddaccb68148abc0b7cae93a85060af315aa6884152cd6fd8cd5294e\": container with ID starting with 2461b4d70ddaccb68148abc0b7cae93a85060af315aa6884152cd6fd8cd5294e not found: ID does not exist"
Jul 13 03:37:12.930288 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:37:12.930267    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-766a483d-555595dd98-fjx4p"]
Jul 13 03:37:12.936371 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:37:12.936352    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-766a483d-555595dd98-fjx4p"]
Jul 13 03:37:12.976715 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:37:12.976692    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:37:14.530881 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:37:14.530851    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc681a9e-c6c5-44b3-a0f3-5a8592373cf7" path="/var/lib/kubelet/pods/fc681a9e-c6c5-44b3-a0f3-5a8592373cf7/volumes"
Jul 13 03:37:17.995222 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:37:17.995190    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:37:54.125669 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:37:54.125638    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:37:54.786832 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:37:54.786802    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:38:00.210159 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:38:00.210122    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:38:13.980877 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:38:13.980841    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:38:14.048280 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:38:14.048242    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:38:14.254215 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:38:14.254132    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:38:14.486894 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:38:14.486861    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:38:15.545453 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:38:15.545400    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:38:15.656441 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:38:15.656357    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:38:15.746399 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:38:15.746374    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:38:16.428084 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:38:16.428047    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:38:16.524045 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:38:16.524006    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:38:16.624533 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:38:16.624480    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:38:17.963433 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:38:17.963401    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:38:23.593117 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:38:23.593080    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:38:23.647286 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:38:23.647253    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:38:24.262761 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:38:24.262724    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:38:29.835569 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:38:29.835536    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:38:29.936070 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:38:29.936038    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:38:30.035860 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:38:30.035830    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:38:40.523065 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:38:40.523027    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:38:40.855599 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:38:40.855570    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:39:01.802788 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:39:01.802751    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:39:07.285440 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:39:07.285408    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:39:07.341661 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:39:07.341632    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:39:07.618594 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:39:07.618561    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:39:07.921224 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:39:07.921131    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:39:08.584423 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:39:08.584373    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:39:10.964437 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:39:10.964403    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:39:11.060132 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:39:11.060102    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:39:15.472133 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:39:15.472101    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:41:15.842652 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:41:15.842572    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:41:24.649715 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:41:24.649690    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v2725_a8933b47-8580-45ab-9f75-57c9a3f26842/ovn-acl-logging/0.log"
Jul 13 03:41:24.656834 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:41:24.656814    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v2725_a8933b47-8580-45ab-9f75-57c9a3f26842/ovn-acl-logging/0.log"
Jul 13 03:42:20.154850 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:42:20.154813    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:20.559335 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:42:20.559306    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:26.078401 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:42:26.078363    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:26.137490 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:42:26.137456    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:26.345841 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:42:26.345768    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:26.561379 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:42:26.561350    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:32.601037 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:42:32.601008    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-kkrxv_22e90bdc-3021-475c-ad1d-b6e7b47e8131/manager/0.log"
Jul 13 03:42:32.715256 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:42:32.715224    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-9pzfx_fa6b54a5-7538-423a-9b0a-79e12ee939a2/manager/0.log"
Jul 13 03:42:32.831603 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:42:32.831569    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-676b6774c9-dfwfc_5d6762f9-6232-4deb-a56d-285c907466ce/manager/0.log"
Jul 13 03:42:33.024629 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:42:33.024554    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:33.074047 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:42:33.074024    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-mfvhq_0703ea47-f1a2-4858-9556-b85e5e159a23/manager/0.log"
Jul 13 03:42:33.310842 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:42:33.310816    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7dcb9ff95f-9xp5r_701e0cbb-36f3-4c1f-861d-580c18b3fd4b/copy-manifests/0.log"
Jul 13 03:42:33.322759 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:42:33.322738    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7dcb9ff95f-9xp5r_701e0cbb-36f3-4c1f-861d-580c18b3fd4b/manager/0.log"
Jul 13 03:42:33.794704 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:42:33.794630    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-65ccc6b695-ndkl4_e536bc2d-f408-4d9b-9f3c-5bd39a63f19d/maas-api/0.log"
Jul 13 03:42:33.908404 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:42:33.908376    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-vbzt4_ffc6049e-eb3a-4131-874a-0822a009cea2/postgres/0.log"
Jul 13 03:42:35.366370 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:42:35.366344    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-x9nf2_35b056f6-3ec0-4b4b-9b5b-230ab4c799ce/manager/0.log"
Jul 13 03:42:35.952213 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:42:35.952184    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-4kkfg_b466c987-e2f4-4885-8a68-bf2d0baa466a/manager/0.log"
Jul 13 03:42:36.419494 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:42:36.419467    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-7rxv4_1e7425aa-f1d3-4112-8e6a-0b386da39c82/discovery/0.log"
Jul 13 03:42:36.528153 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:42:36.528125    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d889b4b4f-8rcx2_456aa16f-c8fa-4226-a7c7-40fed0985550/kube-auth-proxy/0.log"
Jul 13 03:42:36.875163 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:42:36.875140    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-dnlsq_592af000-244d-4b67-a299-b0519a05962b/payload-pre-processing/0.log"
Jul 13 03:42:36.990839 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:42:36.990813    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-6ldtl_9d25329f-b98a-4431-a3a2-88ad1be01bd2/payload-processing/0.log"
Jul 13 03:42:37.441671 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:42:37.441641    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-mv4nv_080908ee-ec79-413e-93fe-09a35bac54b4/main/0.log"
Jul 13 03:42:37.664204 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:42:37.664167    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-mgzf5_39add498-7859-4bef-811a-2ad003b9b4fc/main/0.log"
Jul 13 03:42:37.879472 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:42:37.879443    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-dvm64_5a3bc9d0-6f94-448e-ba14-36e201bb11ab/main/0.log"
Jul 13 03:42:41.598017 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:42:41.597968    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:41.653868 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:42:41.653827    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:44.625817 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:42:44.625775    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-j7pcm_6dc5ae9e-d973-46ae-9924-43fc3e1e80f7/global-pull-secret-syncer/0.log"
Jul 13 03:42:44.710793 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:42:44.710765    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-dfsgr_f526e46c-7702-4938-986f-45c9199f8e78/konnectivity-agent/0.log"
Jul 13 03:42:44.838416 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:42:44.838388    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-39.ec2.internal_22757a058972fd2ede1c4ccbaa378251/haproxy/0.log"
Jul 13 03:42:49.874498 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:42:49.874280    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-x9nf2_35b056f6-3ec0-4b4b-9b5b-230ab4c799ce/manager/0.log"
Jul 13 03:42:50.136731 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:42:50.136630    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-4kkfg_b466c987-e2f4-4885-8a68-bf2d0baa466a/manager/0.log"
Jul 13 03:42:52.327831 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:42:52.327806    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vq7cc_66a2170d-cced-4865-9429-6285f8bab2e6/node-exporter/0.log"
Jul 13 03:42:52.351687 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:42:52.351661    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vq7cc_66a2170d-cced-4865-9429-6285f8bab2e6/kube-rbac-proxy/0.log"
Jul 13 03:42:52.372303 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:42:52.372280    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vq7cc_66a2170d-cced-4865-9429-6285f8bab2e6/init-textfile/0.log"
Jul 13 03:42:53.975258 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:42:53.975230    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-4pspv_917248b5-3953-4ace-831e-99a59df139c1/networking-console-plugin/0.log"
Jul 13 03:42:54.366446 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:42:54.366416    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-xjlbl/perf-node-gather-daemonset-gqwrs"]
Jul 13 03:42:54.366750 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:42:54.366738    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc681a9e-c6c5-44b3-a0f3-5a8592373cf7" containerName="maas-api"
Jul 13 03:42:54.366795 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:42:54.366751    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc681a9e-c6c5-44b3-a0f3-5a8592373cf7" containerName="maas-api"
Jul 13 03:42:54.366830 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:42:54.366823    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc681a9e-c6c5-44b3-a0f3-5a8592373cf7" containerName="maas-api"
Jul 13 03:42:54.369977 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:42:54.369960    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xjlbl/perf-node-gather-daemonset-gqwrs"
Jul 13 03:42:54.372100 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:42:54.372084    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-xjlbl\"/\"default-dockercfg-5wgrz\""
Jul 13 03:42:54.372170 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:42:54.372119    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xjlbl\"/\"openshift-service-ca.crt\""
Jul 13 03:42:54.372921 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:42:54.372906    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xjlbl\"/\"kube-root-ca.crt\""
Jul 13 03:42:54.376161 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:42:54.376140    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xjlbl/perf-node-gather-daemonset-gqwrs"]
Jul 13 03:42:54.416942 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:42:54.416913    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2cfefb02-ffbe-4101-a5a5-a2fa9d14da62-sys\") pod \"perf-node-gather-daemonset-gqwrs\" (UID: \"2cfefb02-ffbe-4101-a5a5-a2fa9d14da62\") " pod="openshift-must-gather-xjlbl/perf-node-gather-daemonset-gqwrs"
Jul 13 03:42:54.417085 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:42:54.416978    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drcqs\" (UniqueName: \"kubernetes.io/projected/2cfefb02-ffbe-4101-a5a5-a2fa9d14da62-kube-api-access-drcqs\") pod \"perf-node-gather-daemonset-gqwrs\" (UID: \"2cfefb02-ffbe-4101-a5a5-a2fa9d14da62\") " pod="openshift-must-gather-xjlbl/perf-node-gather-daemonset-gqwrs"
Jul 13 03:42:54.417085 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:42:54.417002    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2cfefb02-ffbe-4101-a5a5-a2fa9d14da62-lib-modules\") pod \"perf-node-gather-daemonset-gqwrs\" (UID: \"2cfefb02-ffbe-4101-a5a5-a2fa9d14da62\") " pod="openshift-must-gather-xjlbl/perf-node-gather-daemonset-gqwrs"
Jul 13 03:42:54.417085 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:42:54.417024    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2cfefb02-ffbe-4101-a5a5-a2fa9d14da62-proc\") pod \"perf-node-gather-daemonset-gqwrs\" (UID: \"2cfefb02-ffbe-4101-a5a5-a2fa9d14da62\") " pod="openshift-must-gather-xjlbl/perf-node-gather-daemonset-gqwrs"
Jul 13 03:42:54.417085 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:42:54.417056    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2cfefb02-ffbe-4101-a5a5-a2fa9d14da62-podres\") pod \"perf-node-gather-daemonset-gqwrs\" (UID: \"2cfefb02-ffbe-4101-a5a5-a2fa9d14da62\") " pod="openshift-must-gather-xjlbl/perf-node-gather-daemonset-gqwrs"
Jul 13 03:42:54.518314 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:42:54.518283    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2cfefb02-ffbe-4101-a5a5-a2fa9d14da62-podres\") pod \"perf-node-gather-daemonset-gqwrs\" (UID: \"2cfefb02-ffbe-4101-a5a5-a2fa9d14da62\") " pod="openshift-must-gather-xjlbl/perf-node-gather-daemonset-gqwrs"
Jul 13 03:42:54.518458 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:42:54.518351    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2cfefb02-ffbe-4101-a5a5-a2fa9d14da62-sys\") pod \"perf-node-gather-daemonset-gqwrs\" (UID: \"2cfefb02-ffbe-4101-a5a5-a2fa9d14da62\") " pod="openshift-must-gather-xjlbl/perf-node-gather-daemonset-gqwrs"
Jul 13 03:42:54.518458 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:42:54.518398    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drcqs\" (UniqueName: \"kubernetes.io/projected/2cfefb02-ffbe-4101-a5a5-a2fa9d14da62-kube-api-access-drcqs\") pod \"perf-node-gather-daemonset-gqwrs\" (UID: \"2cfefb02-ffbe-4101-a5a5-a2fa9d14da62\") " pod="openshift-must-gather-xjlbl/perf-node-gather-daemonset-gqwrs"
Jul 13 03:42:54.518458 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:42:54.518431    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2cfefb02-ffbe-4101-a5a5-a2fa9d14da62-lib-modules\") pod \"perf-node-gather-daemonset-gqwrs\" (UID: \"2cfefb02-ffbe-4101-a5a5-a2fa9d14da62\") " pod="openshift-must-gather-xjlbl/perf-node-gather-daemonset-gqwrs"
Jul 13 03:42:54.518458 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:42:54.518446    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2cfefb02-ffbe-4101-a5a5-a2fa9d14da62-podres\") pod \"perf-node-gather-daemonset-gqwrs\" (UID: \"2cfefb02-ffbe-4101-a5a5-a2fa9d14da62\") " pod="openshift-must-gather-xjlbl/perf-node-gather-daemonset-gqwrs"
Jul 13 03:42:54.518594 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:42:54.518466    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2cfefb02-ffbe-4101-a5a5-a2fa9d14da62-proc\") pod \"perf-node-gather-daemonset-gqwrs\" (UID: \"2cfefb02-ffbe-4101-a5a5-a2fa9d14da62\") " pod="openshift-must-gather-xjlbl/perf-node-gather-daemonset-gqwrs"
Jul 13 03:42:54.518594 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:42:54.518470    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2cfefb02-ffbe-4101-a5a5-a2fa9d14da62-sys\") pod \"perf-node-gather-daemonset-gqwrs\" (UID: \"2cfefb02-ffbe-4101-a5a5-a2fa9d14da62\") " pod="openshift-must-gather-xjlbl/perf-node-gather-daemonset-gqwrs"
Jul 13 03:42:54.518594 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:42:54.518534    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2cfefb02-ffbe-4101-a5a5-a2fa9d14da62-proc\") pod \"perf-node-gather-daemonset-gqwrs\" (UID: \"2cfefb02-ffbe-4101-a5a5-a2fa9d14da62\") " pod="openshift-must-gather-xjlbl/perf-node-gather-daemonset-gqwrs"
Jul 13 03:42:54.518685 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:42:54.518591    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2cfefb02-ffbe-4101-a5a5-a2fa9d14da62-lib-modules\") pod \"perf-node-gather-daemonset-gqwrs\" (UID: \"2cfefb02-ffbe-4101-a5a5-a2fa9d14da62\") " pod="openshift-must-gather-xjlbl/perf-node-gather-daemonset-gqwrs"
Jul 13 03:42:54.526008 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:42:54.525979    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-drcqs\" (UniqueName: \"kubernetes.io/projected/2cfefb02-ffbe-4101-a5a5-a2fa9d14da62-kube-api-access-drcqs\") pod \"perf-node-gather-daemonset-gqwrs\" (UID: \"2cfefb02-ffbe-4101-a5a5-a2fa9d14da62\") " pod="openshift-must-gather-xjlbl/perf-node-gather-daemonset-gqwrs"
Jul 13 03:42:54.680591 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:42:54.680506    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xjlbl/perf-node-gather-daemonset-gqwrs"
Jul 13 03:42:54.811143 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:42:54.811120    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xjlbl/perf-node-gather-daemonset-gqwrs"]
Jul 13 03:42:54.813029 ip-10-0-142-39 kubenswrapper[2563]: W0713 03:42:54.812997    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2cfefb02_ffbe_4101_a5a5_a2fa9d14da62.slice/crio-9cbc85f714ceebdf6242b8e7f122d27b00c7b53a2575d8840195856c495b9ec1 WatchSource:0}: Error finding container 9cbc85f714ceebdf6242b8e7f122d27b00c7b53a2575d8840195856c495b9ec1: Status 404 returned error can't find the container with id 9cbc85f714ceebdf6242b8e7f122d27b00c7b53a2575d8840195856c495b9ec1
Jul 13 03:42:55.413281 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:42:55.413239    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xjlbl/perf-node-gather-daemonset-gqwrs" event={"ID":"2cfefb02-ffbe-4101-a5a5-a2fa9d14da62","Type":"ContainerStarted","Data":"8b4d2595f89bf21030aebd913f6f42bae38e6e603cd731465b022379b6d6e260"}
Jul 13 03:42:55.413652 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:42:55.413296    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xjlbl/perf-node-gather-daemonset-gqwrs" event={"ID":"2cfefb02-ffbe-4101-a5a5-a2fa9d14da62","Type":"ContainerStarted","Data":"9cbc85f714ceebdf6242b8e7f122d27b00c7b53a2575d8840195856c495b9ec1"}
Jul 13 03:42:55.413652 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:42:55.413375    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-xjlbl/perf-node-gather-daemonset-gqwrs"
Jul 13 03:42:55.427867 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:42:55.427819    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-xjlbl/perf-node-gather-daemonset-gqwrs" podStartSLOduration=1.427805588 podStartE2EDuration="1.427805588s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 03:42:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:42:55.426576358 +0000 UTC m=+2791.409366468" watchObservedRunningTime="2026-07-13 03:42:55.427805588 +0000 UTC m=+2791.410595696"
Jul 13 03:42:56.634697 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:42:56.634664    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5tx4z_b32f1a22-542e-47d1-9c40-9de1fb178864/dns/0.log"
Jul 13 03:42:56.658105 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:42:56.658081    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5tx4z_b32f1a22-542e-47d1-9c40-9de1fb178864/kube-rbac-proxy/0.log"
Jul 13 03:42:56.803480 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:42:56.803452    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xnfwg_b3b58c31-485d-4010-b36b-049e6006b525/dns-node-resolver/0.log"
Jul 13 03:42:57.312312 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:42:57.312277    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jvpfc_bbf72fd6-813d-4e7e-8168-7b41c4605230/node-ca/0.log"
Jul 13 03:42:58.300892 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:42:58.300867    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-7rxv4_1e7425aa-f1d3-4112-8e6a-0b386da39c82/discovery/0.log"
Jul 13 03:42:58.318758 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:42:58.318736    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d889b4b4f-8rcx2_456aa16f-c8fa-4226-a7c7-40fed0985550/kube-auth-proxy/0.log"
Jul 13 03:42:58.464678 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:42:58.464648    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-dnlsq_592af000-244d-4b67-a299-b0519a05962b/payload-pre-processing/0.log"
Jul 13 03:42:58.491859 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:42:58.491832    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-6ldtl_9d25329f-b98a-4431-a3a2-88ad1be01bd2/payload-processing/0.log"
Jul 13 03:42:59.184456 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:42:59.184421    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-sgg7j_3965be9b-fcc2-48b2-b5b0-d75dd94206a4/serve-healthcheck-canary/0.log"
Jul 13 03:42:59.621956 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:42:59.621920    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bn5nq_6d73644f-10d2-45bc-821e-9a7c3177b107/kube-rbac-proxy/0.log"
Jul 13 03:42:59.639814 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:42:59.639783    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bn5nq_6d73644f-10d2-45bc-821e-9a7c3177b107/exporter/0.log"
Jul 13 03:42:59.657226 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:42:59.657208    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bn5nq_6d73644f-10d2-45bc-821e-9a7c3177b107/extractor/0.log"
Jul 13 03:43:01.428629 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:43:01.428604    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-xjlbl/perf-node-gather-daemonset-gqwrs"
Jul 13 03:43:01.791294 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:43:01.791189    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-kkrxv_22e90bdc-3021-475c-ad1d-b6e7b47e8131/manager/0.log"
Jul 13 03:43:01.872704 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:43:01.872664    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-9pzfx_fa6b54a5-7538-423a-9b0a-79e12ee939a2/manager/0.log"
Jul 13 03:43:01.946665 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:43:01.946630    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-676b6774c9-dfwfc_5d6762f9-6232-4deb-a56d-285c907466ce/manager/0.log"
Jul 13 03:43:02.018906 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:43:02.018873    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-mfvhq_0703ea47-f1a2-4858-9556-b85e5e159a23/manager/0.log"
Jul 13 03:43:02.119308 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:43:02.119265    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7dcb9ff95f-9xp5r_701e0cbb-36f3-4c1f-861d-580c18b3fd4b/manager/0.log"
Jul 13 03:43:02.133807 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:43:02.133786    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7dcb9ff95f-9xp5r_701e0cbb-36f3-4c1f-861d-580c18b3fd4b/copy-manifests/0.log"
Jul 13 03:43:03.460895 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:43:03.460866    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-h4gqd_368d5c78-3bd8-4c0d-a975-cb82145c2147/openshift-lws-operator/0.log"
Jul 13 03:43:04.988288 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:43:04.988262    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-7rxv4_1e7425aa-f1d3-4112-8e6a-0b386da39c82/discovery/0.log"
Jul 13 03:43:04.998227 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:43:04.998204    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d889b4b4f-8rcx2_456aa16f-c8fa-4226-a7c7-40fed0985550/kube-auth-proxy/0.log"
Jul 13 03:43:05.113343 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:43:05.113323    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-dnlsq_592af000-244d-4b67-a299-b0519a05962b/payload-pre-processing/0.log"
Jul 13 03:43:05.130969 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:43:05.130925    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-6ldtl_9d25329f-b98a-4431-a3a2-88ad1be01bd2/payload-processing/0.log"
Jul 13 03:43:06.324369 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:43:06.324339    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-7rxv4_1e7425aa-f1d3-4112-8e6a-0b386da39c82/discovery/0.log"
Jul 13 03:43:06.334870 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:43:06.334847    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d889b4b4f-8rcx2_456aa16f-c8fa-4226-a7c7-40fed0985550/kube-auth-proxy/0.log"
Jul 13 03:43:06.457234 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:43:06.457205    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-dnlsq_592af000-244d-4b67-a299-b0519a05962b/payload-pre-processing/0.log"
Jul 13 03:43:06.490594 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:43:06.490571    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-6ldtl_9d25329f-b98a-4431-a3a2-88ad1be01bd2/payload-processing/0.log"
Jul 13 03:43:09.993624 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:43:09.993543    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f94rg_89566977-a84a-41c6-815a-dbb71c0752c6/kube-multus-additional-cni-plugins/0.log"
Jul 13 03:43:10.012884 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:43:10.012849    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f94rg_89566977-a84a-41c6-815a-dbb71c0752c6/egress-router-binary-copy/0.log"
Jul 13 03:43:10.031110 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:43:10.031093    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f94rg_89566977-a84a-41c6-815a-dbb71c0752c6/cni-plugins/0.log"
Jul 13 03:43:10.049291 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:43:10.049270    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f94rg_89566977-a84a-41c6-815a-dbb71c0752c6/bond-cni-plugin/0.log"
Jul 13 03:43:10.067140 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:43:10.067122    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f94rg_89566977-a84a-41c6-815a-dbb71c0752c6/routeoverride-cni/0.log"
Jul 13 03:43:10.085330 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:43:10.085315    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f94rg_89566977-a84a-41c6-815a-dbb71c0752c6/whereabouts-cni-bincopy/0.log"
Jul 13 03:43:10.104489 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:43:10.104465    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f94rg_89566977-a84a-41c6-815a-dbb71c0752c6/whereabouts-cni/0.log"
Jul 13 03:43:10.328225 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:43:10.328200    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v5jkl_98357ee0-0a92-426c-8da6-516bf9162a68/kube-multus/0.log"
Jul 13 03:43:10.421490 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:43:10.421467    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-p44kl_cd0ac0dd-db5b-41c3-b69d-bcf3af528e20/network-metrics-daemon/0.log"
Jul 13 03:43:10.438879 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:43:10.438859    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-p44kl_cd0ac0dd-db5b-41c3-b69d-bcf3af528e20/kube-rbac-proxy/0.log"
Jul 13 03:43:11.594794 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:43:11.594766    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v2725_a8933b47-8580-45ab-9f75-57c9a3f26842/ovn-controller/0.log"
Jul 13 03:43:11.613409 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:43:11.613382    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v2725_a8933b47-8580-45ab-9f75-57c9a3f26842/ovn-acl-logging/0.log"
Jul 13 03:43:11.613675 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:43:11.613658    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v2725_a8933b47-8580-45ab-9f75-57c9a3f26842/ovn-acl-logging/1.log"
Jul 13 03:43:11.631038 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:43:11.631020    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v2725_a8933b47-8580-45ab-9f75-57c9a3f26842/kube-rbac-proxy-node/0.log"
Jul 13 03:43:11.649402 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:43:11.649383    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v2725_a8933b47-8580-45ab-9f75-57c9a3f26842/kube-rbac-proxy-ovn-metrics/0.log"
Jul 13 03:43:11.664640 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:43:11.664618    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v2725_a8933b47-8580-45ab-9f75-57c9a3f26842/northd/0.log"
Jul 13 03:43:11.682882 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:43:11.682866    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v2725_a8933b47-8580-45ab-9f75-57c9a3f26842/nbdb/0.log"
Jul 13 03:43:11.700771 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:43:11.700757    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v2725_a8933b47-8580-45ab-9f75-57c9a3f26842/sbdb/0.log"
Jul 13 03:43:11.744298 ip-10-0-142-39 kubenswrapper[2563]: I0713 03:43:11.744276    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v2725_a8933b47-8580-45ab-9f75-57c9a3f26842/ovnkube-controller/0.log"