Jul 05 13:13:18.278651 ip-10-0-129-239 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 05 13:13:18.278660 ip-10-0-129-239 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 05 13:13:18.278668 ip-10-0-129-239 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 05 13:13:18.278894 ip-10-0-129-239 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 05 13:13:28.503966 ip-10-0-129-239 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 05 13:13:28.503987 ip-10-0-129-239 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot bfe352a7137342eea1229091fb5c8d17 --
Jul 05 13:15:19.805616 ip-10-0-129-239 systemd[1]: Starting Kubernetes Kubelet...
Jul 05 13:15:20.128726 ip-10-0-129-239 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 05 13:15:20.128726 ip-10-0-129-239 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 05 13:15:20.128726 ip-10-0-129-239 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 05 13:15:20.128726 ip-10-0-129-239 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 05 13:15:20.128726 ip-10-0-129-239 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 05 13:15:20.130204 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.130076    2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 05 13:15:20.133731 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133710    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 05 13:15:20.133731 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133729    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 05 13:15:20.133731 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133733    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 05 13:15:20.133872 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133737    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 05 13:15:20.133872 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133741    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 05 13:15:20.133872 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133744    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 05 13:15:20.133872 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133746    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 05 13:15:20.133872 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133749    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 05 13:15:20.133872 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133752    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 05 13:15:20.133872 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133755    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 05 13:15:20.133872 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133757    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 05 13:15:20.133872 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133760    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 05 13:15:20.133872 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133763    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 05 13:15:20.133872 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133766    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 05 13:15:20.133872 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133768    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 05 13:15:20.133872 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133771    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 05 13:15:20.133872 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133774    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 05 13:15:20.133872 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133777    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 05 13:15:20.133872 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133779    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 05 13:15:20.133872 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133782    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 05 13:15:20.133872 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133784    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 05 13:15:20.133872 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133793    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 05 13:15:20.133872 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133796    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 05 13:15:20.134380 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133798    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 05 13:15:20.134380 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133801    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 05 13:15:20.134380 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133804    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 05 13:15:20.134380 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133806    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 05 13:15:20.134380 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133809    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 05 13:15:20.134380 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133812    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 05 13:15:20.134380 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133814    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 05 13:15:20.134380 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133817    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 05 13:15:20.134380 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133819    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 05 13:15:20.134380 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133822    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 05 13:15:20.134380 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133825    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 05 13:15:20.134380 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133827    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 05 13:15:20.134380 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133829    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 05 13:15:20.134380 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133833    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 05 13:15:20.134380 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133835    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 05 13:15:20.134380 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133838    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 05 13:15:20.134380 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133841    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 05 13:15:20.134380 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133843    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 05 13:15:20.134380 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133846    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 05 13:15:20.134853 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133848    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 05 13:15:20.134853 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133851    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 05 13:15:20.134853 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133854    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 05 13:15:20.134853 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133856    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 05 13:15:20.134853 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133859    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 05 13:15:20.134853 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133861    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 05 13:15:20.134853 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133863    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 05 13:15:20.134853 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133866    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 05 13:15:20.134853 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133868    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 05 13:15:20.134853 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133871    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 05 13:15:20.134853 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133874    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 05 13:15:20.134853 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133877    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 05 13:15:20.134853 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133886    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 05 13:15:20.134853 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133889    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 05 13:15:20.134853 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133891    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 05 13:15:20.134853 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133896    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 05 13:15:20.134853 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133900    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 05 13:15:20.134853 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133903    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 05 13:15:20.134853 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133906    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 05 13:15:20.135343 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133909    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 05 13:15:20.135343 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133911    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 05 13:15:20.135343 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133914    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 05 13:15:20.135343 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133917    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 05 13:15:20.135343 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133919    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 05 13:15:20.135343 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133922    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 05 13:15:20.135343 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133924    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 05 13:15:20.135343 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133928    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 05 13:15:20.135343 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133931    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 05 13:15:20.135343 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133934    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 05 13:15:20.135343 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133937    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 05 13:15:20.135343 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133939    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 05 13:15:20.135343 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133942    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 05 13:15:20.135343 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133944    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 05 13:15:20.135343 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133947    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 05 13:15:20.135343 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133950    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 05 13:15:20.135343 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133952    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 05 13:15:20.135343 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133954    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 05 13:15:20.135343 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133957    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 05 13:15:20.135343 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133961    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 05 13:15:20.135825 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133964    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 05 13:15:20.135825 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133967    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 05 13:15:20.135825 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133970    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 05 13:15:20.135825 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133973    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 05 13:15:20.135825 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133975    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 05 13:15:20.135825 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133978    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 05 13:15:20.135825 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133986    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 05 13:15:20.135825 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133988    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 05 13:15:20.135825 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133991    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 05 13:15:20.135825 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133996    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 05 13:15:20.135825 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.133999    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 05 13:15:20.135825 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.134002    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 05 13:15:20.135825 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.134005    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 05 13:15:20.135825 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.134007    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 05 13:15:20.135825 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.134010    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 05 13:15:20.135825 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.134013    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 05 13:15:20.135825 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.134016    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 05 13:15:20.135825 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.134018    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 05 13:15:20.135825 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.134848    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 05 13:15:20.135825 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.134857    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 05 13:15:20.136332 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.134861    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 05 13:15:20.136332 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.134864    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 05 13:15:20.136332 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.134867    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 05 13:15:20.136332 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.134870    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 05 13:15:20.136332 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.134872    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 05 13:15:20.136332 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.134875    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 05 13:15:20.136332 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.134878    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 05 13:15:20.136332 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.134880    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 05 13:15:20.136332 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.134883    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 05 13:15:20.136332 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.134885    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 05 13:15:20.136332 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.134888    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 05 13:15:20.136332 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.134890    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 05 13:15:20.136332 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.134893    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 05 13:15:20.136332 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.134895    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 05 13:15:20.136332 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.134898    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 05 13:15:20.136332 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.134900    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 05 13:15:20.136332 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.134903    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 05 13:15:20.136332 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.134905    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 05 13:15:20.136332 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.134908    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 05 13:15:20.136332 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.134911    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 05 13:15:20.136876 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.134914    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 05 13:15:20.136876 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.134916    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 05 13:15:20.136876 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.134919    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 05 13:15:20.136876 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.134921    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 05 13:15:20.136876 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.134924    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 05 13:15:20.136876 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.134926    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 05 13:15:20.136876 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.134929    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 05 13:15:20.136876 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.134931    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 05 13:15:20.136876 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.134933    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 05 13:15:20.136876 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.134936    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 05 13:15:20.136876 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.134938    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 05 13:15:20.136876 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.134942    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 05 13:15:20.136876 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.134945    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 05 13:15:20.136876 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.134947    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 05 13:15:20.136876 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.134950    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 05 13:15:20.136876 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.134953    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 05 13:15:20.136876 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.134955    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 05 13:15:20.136876 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.134957    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 05 13:15:20.136876 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.134960    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 05 13:15:20.137355 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.134962    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 05 13:15:20.137355 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.134965    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 05 13:15:20.137355 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.134967    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 05 13:15:20.137355 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.134969    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 05 13:15:20.137355 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.134972    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 05 13:15:20.137355 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.134975    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 05 13:15:20.137355 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.134978    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 05 13:15:20.137355 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.134980    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 05 13:15:20.137355 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.134983    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 05 13:15:20.137355 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.134986    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 05 13:15:20.137355 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.134988    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 05 13:15:20.137355 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.134991    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 05 13:15:20.137355 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.134993    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 05 13:15:20.137355 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.134999    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 05 13:15:20.137355 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135002    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 05 13:15:20.137355 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135004    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 05 13:15:20.137355 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135007    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 05 13:15:20.137355 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135009    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 05 13:15:20.137355 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135012    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 05 13:15:20.137355 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135014    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 05 13:15:20.137839 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135017    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 05 13:15:20.137839 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135019    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 05 13:15:20.137839 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135021    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 05 13:15:20.137839 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135024    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 05 13:15:20.137839 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135027    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 05 13:15:20.137839 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135030    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 05 13:15:20.137839 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135033    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 05 13:15:20.137839 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135035    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 05 13:15:20.137839 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135038    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 05 13:15:20.137839 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135041    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 05 13:15:20.137839 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135045    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 05 13:15:20.137839 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135049    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 05 13:15:20.137839 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135053    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 05 13:15:20.137839 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135055    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 05 13:15:20.137839 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135058    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 05 13:15:20.137839 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135061    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 05 13:15:20.137839 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135063    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 05 13:15:20.137839 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135066    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 05 13:15:20.137839 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135069    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 05 13:15:20.138331 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135071    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 05 13:15:20.138331 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135074    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 05 13:15:20.138331 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135076    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 05 13:15:20.138331 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135078    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 05 13:15:20.138331 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135081    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 05 13:15:20.138331 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135084    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 05 13:15:20.138331 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135086    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 05 13:15:20.138331 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135089    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 05 13:15:20.138331 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135092    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 05 13:15:20.138331 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135094    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 05 13:15:20.138331 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135096    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 05 13:15:20.138331 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135099    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 05 13:15:20.138331 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135101    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 05 13:15:20.138331 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135105    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 05 13:15:20.138331 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135108    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 05 13:15:20.138331 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135111    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 05 13:15:20.138331 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135114    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 05 13:15:20.138331 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135117    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 05 13:15:20.138331 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135120    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 05 13:15:20.138802 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135559    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 05 13:15:20.138802 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135565    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 05 13:15:20.138802 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135570    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 05 13:15:20.138802 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135573    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 05 13:15:20.138802 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135576    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 05 13:15:20.138802 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135579    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 05 13:15:20.138802 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135583    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 05 13:15:20.138802 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135586    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 05 13:15:20.138802 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135588    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 05 13:15:20.138802 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135591    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 05 13:15:20.138802 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135594    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 05 13:15:20.138802 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135596    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 05 13:15:20.138802 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135599    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 05 13:15:20.138802 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135602    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 05 13:15:20.138802 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135604    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 05 13:15:20.138802 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135607    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 05 13:15:20.138802 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135609    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 05 13:15:20.138802 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135612    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 05 13:15:20.138802 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135615    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 05 13:15:20.139286 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135618    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 05 13:15:20.139286 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135622    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 05 13:15:20.139286 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135626    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 05 13:15:20.139286 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135629    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 05 13:15:20.139286 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135632    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 05 13:15:20.139286 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135634    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 05 13:15:20.139286 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135637    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 05 13:15:20.139286 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135639    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 05 13:15:20.139286 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135642    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 05 13:15:20.139286 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135644    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 05 13:15:20.139286 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135648    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 05 13:15:20.139286 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135650    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 05 13:15:20.139286 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135653    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 05 13:15:20.139286 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135655    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 05 13:15:20.139286 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135658    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 05 13:15:20.139286 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135660    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 05 13:15:20.139286 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135663    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 05 13:15:20.139286 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135667    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 05 13:15:20.139286 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135670    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 05 13:15:20.139754 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135673    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 05 13:15:20.139754 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135677    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 05 13:15:20.139754 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135679    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 05 13:15:20.139754 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135682    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 05 13:15:20.139754 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135685    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 05 13:15:20.139754 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135687    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 05 13:15:20.139754 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135690    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 05 13:15:20.139754 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135693    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 05 13:15:20.139754 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135695    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 05 13:15:20.139754 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135698    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 05 13:15:20.139754 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135701    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 05 13:15:20.139754 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135703    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 05 13:15:20.139754 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135705    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 05 13:15:20.139754 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135708    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 05 13:15:20.139754 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135710    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 05 13:15:20.139754 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135718    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 05 13:15:20.139754 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135721    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 05 13:15:20.139754 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135724    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 05 13:15:20.139754 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135726    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 05 13:15:20.139754 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135728    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 05 13:15:20.140255 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135731    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 05 13:15:20.140255 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135734    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 05 13:15:20.140255 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135736    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 05 13:15:20.140255 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135739    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 05 13:15:20.140255 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135741    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 05 13:15:20.140255 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135744    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 05 13:15:20.140255 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135746    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 05 13:15:20.140255 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135749    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 05 13:15:20.140255 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135751    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 05 13:15:20.140255 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135754    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 05 13:15:20.140255 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135756    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 05 13:15:20.140255 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135758    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 05 13:15:20.140255 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135761    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 05 13:15:20.140255 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135763    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 05 13:15:20.140255 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135765    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 05 13:15:20.140255 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135768    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 05 13:15:20.140255 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135770    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 05 13:15:20.140255 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135773    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 05 13:15:20.140255 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135775    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 05 13:15:20.140255 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135778    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 05 13:15:20.140744 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135781    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 05 13:15:20.140744 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135784    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 05 13:15:20.140744 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135789    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 05 13:15:20.140744 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135791    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 05 13:15:20.140744 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135794    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 05 13:15:20.140744 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135797    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 05 13:15:20.140744 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135799    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 05 13:15:20.140744 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135802    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 05 13:15:20.140744 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135810    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 05 13:15:20.140744 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135813    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 05 13:15:20.140744 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135815    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 05 13:15:20.140744 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135817    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 05 13:15:20.140744 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135820    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 05 13:15:20.140744 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135823    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 05 13:15:20.140744 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135825    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 05 13:15:20.140744 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135828    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 05 13:15:20.140744 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135831    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 05 13:15:20.140744 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135833    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 05 13:15:20.140744 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135836    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 05 13:15:20.140744 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135838    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 05 13:15:20.141240 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.135841    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 05 13:15:20.141240 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.135920    2563 flags.go:64] FLAG: --address="0.0.0.0"
Jul 05 13:15:20.141240 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.135930    2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 05 13:15:20.141240 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.135954    2563 flags.go:64] FLAG: --anonymous-auth="true"
Jul 05 13:15:20.141240 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.135961    2563 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 05 13:15:20.141240 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.135966    2563 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 05 13:15:20.141240 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.135969    2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 05 13:15:20.141240 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.135974    2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 05 13:15:20.141240 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.135978    2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 05 13:15:20.141240 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.135981    2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 05 13:15:20.141240 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.135984    2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 05 13:15:20.141240 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.135988    2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 05 13:15:20.141240 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.135991    2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 05 13:15:20.141240 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.135994    2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 05 13:15:20.141240 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.135999    2563 flags.go:64] FLAG: --cgroup-root=""
Jul 05 13:15:20.141240 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136002    2563 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 05 13:15:20.141240 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136005    2563 flags.go:64] FLAG: --client-ca-file=""
Jul 05 13:15:20.141240 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136008    2563 flags.go:64] FLAG: --cloud-provider="external"
Jul 05 13:15:20.141240 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136011    2563 flags.go:64] FLAG: --cluster-dns="[]"
Jul 05 13:15:20.141240 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136018    2563 flags.go:64] FLAG: --cluster-domain=""
Jul 05 13:15:20.141240 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136021    2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 05 13:15:20.141240 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136030    2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 05 13:15:20.141240 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136033    2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 05 13:15:20.141240 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136036    2563 flags.go:64] FLAG: --container-log-max-files="5"
Jul 05 13:15:20.141875 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136040    2563 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 05 13:15:20.141875 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136043    2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 05 13:15:20.141875 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136046    2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 05 13:15:20.141875 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136049    2563 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 05 13:15:20.141875 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136052    2563 flags.go:64] FLAG: --contention-profiling="false"
Jul 05 13:15:20.141875 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136055    2563 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 05 13:15:20.141875 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136058    2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 05 13:15:20.141875 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136061    2563 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 05 13:15:20.141875 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136064    2563 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 05 13:15:20.141875 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136068    2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 05 13:15:20.141875 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136071    2563 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 05 13:15:20.141875 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136074    2563 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 05 13:15:20.141875 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136077    2563 flags.go:64] FLAG: --enable-load-reader="false"
Jul 05 13:15:20.141875 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136080    2563 flags.go:64] FLAG: --enable-server="true"
Jul 05 13:15:20.141875 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136083    2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 05 13:15:20.141875 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136090    2563 flags.go:64] FLAG: --event-burst="100"
Jul 05 13:15:20.141875 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136093    2563 flags.go:64] FLAG: --event-qps="50"
Jul 05 13:15:20.141875 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136096    2563 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 05 13:15:20.141875 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136099    2563 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 05 13:15:20.141875 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136101    2563 flags.go:64] FLAG: --eviction-hard=""
Jul 05 13:15:20.141875 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136110    2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 05 13:15:20.141875 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136113    2563 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 05 13:15:20.141875 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136118    2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 05 13:15:20.141875 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136121    2563 flags.go:64] FLAG: --eviction-soft=""
Jul 05 13:15:20.141875 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136124    2563 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 05 13:15:20.142588 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136126    2563 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 05 13:15:20.142588 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136130    2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 05 13:15:20.142588 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136133    2563 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 05 13:15:20.142588 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136135    2563 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 05 13:15:20.142588 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136138    2563 flags.go:64] FLAG: --fail-swap-on="true"
Jul 05 13:15:20.142588 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136142    2563 flags.go:64] FLAG: --feature-gates=""
Jul 05 13:15:20.142588 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136146    2563 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 05 13:15:20.142588 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136149    2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 05 13:15:20.142588 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136152    2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 05 13:15:20.142588 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136155    2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 05 13:15:20.142588 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136158    2563 flags.go:64] FLAG: --healthz-port="10248"
Jul 05 13:15:20.142588 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136161    2563 flags.go:64] FLAG: --help="false"
Jul 05 13:15:20.142588 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136164    2563 flags.go:64] FLAG: --hostname-override="ip-10-0-129-239.ec2.internal"
Jul 05 13:15:20.142588 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136167    2563 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 05 13:15:20.142588 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136170    2563 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 05 13:15:20.142588 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136173    2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 05 13:15:20.142588 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136177    2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 05 13:15:20.142588 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136180    2563 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 05 13:15:20.142588 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136183    2563 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 05 13:15:20.142588 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136186    2563 flags.go:64] FLAG: --image-service-endpoint=""
Jul 05 13:15:20.142588 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136189    2563 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 05 13:15:20.142588 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136192    2563 flags.go:64] FLAG: --kube-api-burst="100"
Jul 05 13:15:20.142588 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136195    2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 05 13:15:20.143173 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136198    2563 flags.go:64] FLAG: --kube-api-qps="50"
Jul 05 13:15:20.143173 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136200    2563 flags.go:64] FLAG: --kube-reserved=""
Jul 05 13:15:20.143173 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136203    2563 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 05 13:15:20.143173 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136206    2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 05 13:15:20.143173 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136209    2563 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 05 13:15:20.143173 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136212    2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 05 13:15:20.143173 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136228    2563 flags.go:64] FLAG: --lock-file=""
Jul 05 13:15:20.143173 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136231    2563 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 05 13:15:20.143173 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136234    2563 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 05 13:15:20.143173 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136238    2563 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 05 13:15:20.143173 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136243    2563 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 05 13:15:20.143173 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136246    2563 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 05 13:15:20.143173 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136249    2563 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 05 13:15:20.143173 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136252    2563 flags.go:64] FLAG: --logging-format="text"
Jul 05 13:15:20.143173 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136255    2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 05 13:15:20.143173 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136259    2563 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 05 13:15:20.143173 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136261    2563 flags.go:64] FLAG: --manifest-url=""
Jul 05 13:15:20.143173 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136264    2563 flags.go:64] FLAG: --manifest-url-header=""
Jul 05 13:15:20.143173 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136269    2563 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 05 13:15:20.143173 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136275    2563 flags.go:64] FLAG: --max-open-files="1000000"
Jul 05 13:15:20.143173 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136279    2563 flags.go:64] FLAG: --max-pods="110"
Jul 05 13:15:20.143173 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136282    2563 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 05 13:15:20.143173 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136285    2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 05 13:15:20.143173 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136288    2563 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 05 13:15:20.143173 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136291    2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 05 13:15:20.144147 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136294    2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 05 13:15:20.144147 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136297    2563 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 05 13:15:20.144147 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136300    2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 05 13:15:20.144147 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136307    2563 flags.go:64] FLAG: --node-status-max-images="50"
Jul 05 13:15:20.144147 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136310    2563 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 05 13:15:20.144147 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136313    2563 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 05 13:15:20.144147 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136316    2563 flags.go:64] FLAG: --pod-cidr=""
Jul 05 13:15:20.144147 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136319    2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 05 13:15:20.144147 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136326    2563 flags.go:64] FLAG: --pod-manifest-path=""
Jul 05 13:15:20.144147 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136329    2563 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 05 13:15:20.144147 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136332    2563 flags.go:64] FLAG: --pods-per-core="0"
Jul 05 13:15:20.144147 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136336    2563 flags.go:64] FLAG: --port="10250"
Jul 05 13:15:20.144147 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136339    2563 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 05 13:15:20.144147 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136342    2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-03bd7c148826066fb"
Jul 05 13:15:20.144147 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136346    2563 flags.go:64] FLAG: --qos-reserved=""
Jul 05 13:15:20.144147 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136349    2563 flags.go:64] FLAG: --read-only-port="10255"
Jul 05 13:15:20.144147 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136352    2563 flags.go:64] FLAG: --register-node="true"
Jul 05 13:15:20.144147 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136355    2563 flags.go:64] FLAG: --register-with-taints=""
Jul 05 13:15:20.144147 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136359    2563 flags.go:64] FLAG: --registry-burst="10"
Jul 05 13:15:20.144147 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136362    2563 flags.go:64] FLAG: --registry-qps="5"
Jul 05 13:15:20.144147 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136364    2563 flags.go:64] FLAG: --reserved-cpus=""
Jul 05 13:15:20.144147 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136367    2563 flags.go:64] FLAG: --reserved-memory=""
Jul 05 13:15:20.144147 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136371    2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 05 13:15:20.144147 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136375    2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 05 13:15:20.144147 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136378    2563 flags.go:64] FLAG: --rotate-certificates="false"
Jul 05 13:15:20.144935 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136381    2563 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 05 13:15:20.144935 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136386    2563 flags.go:64] FLAG: --runonce="false"
Jul 05 13:15:20.144935 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136389    2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 05 13:15:20.144935 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136392    2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 05 13:15:20.144935 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136394    2563 flags.go:64] FLAG: --seccomp-default="false"
Jul 05 13:15:20.144935 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136397    2563 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 05 13:15:20.144935 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136401    2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 05 13:15:20.144935 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136404    2563 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 05 13:15:20.144935 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136407    2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 05 13:15:20.144935 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136410    2563 flags.go:64] FLAG: --storage-driver-password="root"
Jul 05 13:15:20.144935 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136413    2563 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 05 13:15:20.144935 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136427    2563 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 05 13:15:20.144935 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136431    2563 flags.go:64] FLAG: --storage-driver-user="root"
Jul 05 13:15:20.144935 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136434    2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 05 13:15:20.144935 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136437    2563 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 05 13:15:20.144935 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136440    2563 flags.go:64] FLAG: --system-cgroups=""
Jul 05 13:15:20.144935 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136443    2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 05 13:15:20.144935 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136449    2563 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 05 13:15:20.144935 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136452    2563 flags.go:64] FLAG: --tls-cert-file=""
Jul 05 13:15:20.144935 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136455    2563 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 05 13:15:20.144935 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136462    2563 flags.go:64] FLAG: --tls-min-version=""
Jul 05 13:15:20.144935 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136467    2563 flags.go:64] FLAG: --tls-private-key-file=""
Jul 05 13:15:20.144935 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136470    2563 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 05 13:15:20.144935 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136473    2563 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 05 13:15:20.144935 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136476    2563 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 05 13:15:20.145576 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136479    2563 flags.go:64] FLAG: --v="2"
Jul 05 13:15:20.145576 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136483    2563 flags.go:64] FLAG: --version="false"
Jul 05 13:15:20.145576 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136487    2563 flags.go:64] FLAG: --vmodule=""
Jul 05 13:15:20.145576 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136491    2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 05 13:15:20.145576 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136495    2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 05 13:15:20.145576 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136630    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 05 13:15:20.145576 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136634    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 05 13:15:20.145576 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136637    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 05 13:15:20.145576 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136642    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 05 13:15:20.145576 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136644    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 05 13:15:20.145576 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136647    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 05 13:15:20.145576 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136649    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 05 13:15:20.145576 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136652    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 05 13:15:20.145576 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136654    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 05 13:15:20.145576 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136657    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 05 13:15:20.145576 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136662    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 05 13:15:20.145576 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136666    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 05 13:15:20.145576 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136669    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 05 13:15:20.145576 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136672    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 05 13:15:20.145576 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136675    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 05 13:15:20.146098 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136678    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 05 13:15:20.146098 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136681    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 05 13:15:20.146098 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136684    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 05 13:15:20.146098 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136687    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 05 13:15:20.146098 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136689    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 05 13:15:20.146098 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136692    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 05 13:15:20.146098 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136694    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 05 13:15:20.146098 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136697    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 05 13:15:20.146098 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136701    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 05 13:15:20.146098 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136707    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 05 13:15:20.146098 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136709    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 05 13:15:20.146098 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136712    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 05 13:15:20.146098 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136714    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 05 13:15:20.146098 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136717    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 05 13:15:20.146098 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136719    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 05 13:15:20.146098 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136722    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 05 13:15:20.146098 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136725    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 05 13:15:20.146098 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136727    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 05 13:15:20.146098 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136730    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 05 13:15:20.146098 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136733    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 05 13:15:20.146611 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136737    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 05 13:15:20.146611 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136739    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 05 13:15:20.146611 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136742    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 05 13:15:20.146611 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136744    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 05 13:15:20.146611 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136747    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 05 13:15:20.146611 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136749    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 05 13:15:20.146611 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136752    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 05 13:15:20.146611 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136754    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 05 13:15:20.146611 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136757    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 05 13:15:20.146611 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136760    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 05 13:15:20.146611 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136762    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 05 13:15:20.146611 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136765    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 05 13:15:20.146611 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136767    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 05 13:15:20.146611 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136770    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 05 13:15:20.146611 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136772    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 05 13:15:20.146611 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136775    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 05 13:15:20.146611 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136777    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 05 13:15:20.146611 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136780    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 05 13:15:20.146611 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136782    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 05 13:15:20.146611 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136785    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 05 13:15:20.147112 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136789    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 05 13:15:20.147112 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136791    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 05 13:15:20.147112 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136794    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 05 13:15:20.147112 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136796    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 05 13:15:20.147112 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136799    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 05 13:15:20.147112 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136802    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 05 13:15:20.147112 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136805    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 05 13:15:20.147112 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136808    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 05 13:15:20.147112 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136810    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 05 13:15:20.147112 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136813    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 05 13:15:20.147112 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136815    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 05 13:15:20.147112 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136818    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 05 13:15:20.147112 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136822    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 05 13:15:20.147112 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136825    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 05 13:15:20.147112 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136828    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 05 13:15:20.147112 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136830    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 05 13:15:20.147112 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136833    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 05 13:15:20.147112 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136835    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 05 13:15:20.147112 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136838    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 05 13:15:20.147112 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136840    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 05 13:15:20.147623 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136843    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 05 13:15:20.147623 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136845    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 05 13:15:20.147623 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136848    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 05 13:15:20.147623 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136850    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 05 13:15:20.147623 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136853    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 05 13:15:20.147623 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136855    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 05 13:15:20.147623 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136857    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 05 13:15:20.147623 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136860    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 05 13:15:20.147623 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136862    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 05 13:15:20.147623 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136865    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 05 13:15:20.147623 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136868    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 05 13:15:20.147623 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136870    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 05 13:15:20.147623 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136874    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 05 13:15:20.147623 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136876    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 05 13:15:20.147623 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136879    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 05 13:15:20.147623 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136883    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 05 13:15:20.147623 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136887    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 05 13:15:20.147623 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136890    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 05 13:15:20.147623 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136893    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 05 13:15:20.147623 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136895    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 05 13:15:20.148117 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136898    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 05 13:15:20.148117 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136900    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 05 13:15:20.148117 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136903    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 05 13:15:20.148117 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.136905    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 05 13:15:20.148117 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.136939    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 05 13:15:20.148117 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.145448    2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 05 13:15:20.148117 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.145466    2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 05 13:15:20.148117 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.145487    2563 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 05 13:15:20.148117 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.145497    2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 05 13:15:20.148117 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145556    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 05 13:15:20.148117 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145561    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 05 13:15:20.148117 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145565    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 05 13:15:20.148117 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145568    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 05 13:15:20.148117 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145571    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 05 13:15:20.148602 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145575    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 05 13:15:20.148602 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145577    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 05 13:15:20.148602 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145581    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 05 13:15:20.148602 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145584    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 05 13:15:20.148602 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145586    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 05 13:15:20.148602 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145591    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 05 13:15:20.148602 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145594    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 05 13:15:20.148602 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145597    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 05 13:15:20.148602 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145601    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 05 13:15:20.148602 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145604    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 05 13:15:20.148602 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145607    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 05 13:15:20.148602 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145610    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 05 13:15:20.148602 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145612    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 05 13:15:20.148602 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145615    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 05 13:15:20.148602 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145618    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 05 13:15:20.148602 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145620    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 05 13:15:20.148602 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145623    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 05 13:15:20.148602 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145625    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 05 13:15:20.148602 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145628    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 05 13:15:20.148602 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145631    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 05 13:15:20.149128 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145634    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 05 13:15:20.149128 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145636    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 05 13:15:20.149128 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145639    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 05 13:15:20.149128 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145642    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 05 13:15:20.149128 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145645    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 05 13:15:20.149128 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145650    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 05 13:15:20.149128 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145653    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 05 13:15:20.149128 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145656    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 05 13:15:20.149128 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145659    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 05 13:15:20.149128 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145661    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 05 13:15:20.149128 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145664    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 05 13:15:20.149128 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145667    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 05 13:15:20.149128 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145670    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 05 13:15:20.149128 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145672    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 05 13:15:20.149128 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145675    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 05 13:15:20.149128 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145678    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 05 13:15:20.149128 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145680    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 05 13:15:20.149128 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145683    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 05 13:15:20.149128 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145685    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 05 13:15:20.149611 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145688    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 05 13:15:20.149611 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145690    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 05 13:15:20.149611 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145694    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 05 13:15:20.149611 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145696    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 05 13:15:20.149611 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145699    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 05 13:15:20.149611 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145701    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 05 13:15:20.149611 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145704    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 05 13:15:20.149611 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145706    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 05 13:15:20.149611 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145709    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 05 13:15:20.149611 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145711    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 05 13:15:20.149611 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145714    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 05 13:15:20.149611 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145716    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 05 13:15:20.149611 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145719    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 05 13:15:20.149611 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145722    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 05 13:15:20.149611 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145725    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 05 13:15:20.149611 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145727    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 05 13:15:20.149611 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145729    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 05 13:15:20.149611 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145734    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 05 13:15:20.149611 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145736    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 05 13:15:20.149611 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145739    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 05 13:15:20.150099 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145742    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 05 13:15:20.150099 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145745    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 05 13:15:20.150099 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145748    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 05 13:15:20.150099 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145750    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 05 13:15:20.150099 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145753    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 05 13:15:20.150099 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145756    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 05 13:15:20.150099 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145758    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 05 13:15:20.150099 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145761    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 05 13:15:20.150099 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145763    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 05 13:15:20.150099 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145766    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 05 13:15:20.150099 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145769    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 05 13:15:20.150099 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145772    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 05 13:15:20.150099 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145774    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 05 13:15:20.150099 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145776    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 05 13:15:20.150099 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145779    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 05 13:15:20.150099 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145783    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 05 13:15:20.150099 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145786    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 05 13:15:20.150099 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145788    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 05 13:15:20.150099 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145791    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 05 13:15:20.150099 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145793    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 05 13:15:20.150591 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145796    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 05 13:15:20.150591 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145798    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 05 13:15:20.150591 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145801    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 05 13:15:20.150591 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145803    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 05 13:15:20.150591 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145806    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 05 13:15:20.150591 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145809    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 05 13:15:20.150591 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145811    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 05 13:15:20.150591 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145813    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 05 13:15:20.150591 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145816    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 05 13:15:20.150591 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145820    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 05 13:15:20.150591 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145825    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 05 13:15:20.150591 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145828    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 05 13:15:20.150591 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145830    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 05 13:15:20.150591 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145833    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 05 13:15:20.150591 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145835    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 05 13:15:20.150979 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.145841    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 05 13:15:20.150979 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145977    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 05 13:15:20.150979 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145982    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 05 13:15:20.150979 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145985    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 05 13:15:20.150979 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145988    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 05 13:15:20.150979 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145991    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 05 13:15:20.150979 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145994    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 05 13:15:20.150979 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145996    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 05 13:15:20.150979 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.145999    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 05 13:15:20.150979 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146001    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 05 13:15:20.150979 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146004    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 05 13:15:20.150979 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146007    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 05 13:15:20.150979 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146009    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 05 13:15:20.150979 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146012    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 05 13:15:20.150979 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146015    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 05 13:15:20.151376 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146017    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 05 13:15:20.151376 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146020    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 05 13:15:20.151376 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146022    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 05 13:15:20.151376 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146025    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 05 13:15:20.151376 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146027    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 05 13:15:20.151376 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146030    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 05 13:15:20.151376 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146033    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 05 13:15:20.151376 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146035    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 05 13:15:20.151376 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146038    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 05 13:15:20.151376 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146041    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 05 13:15:20.151376 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146043    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 05 13:15:20.151376 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146046    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 05 13:15:20.151376 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146049    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 05 13:15:20.151376 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146051    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 05 13:15:20.151376 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146054    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 05 13:15:20.151376 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146057    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 05 13:15:20.151376 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146060    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 05 13:15:20.151376 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146062    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 05 13:15:20.151376 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146065    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 05 13:15:20.151376 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146067    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 05 13:15:20.151882 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146070    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 05 13:15:20.151882 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146072    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 05 13:15:20.151882 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146075    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 05 13:15:20.151882 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146078    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 05 13:15:20.151882 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146080    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 05 13:15:20.151882 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146084    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 05 13:15:20.151882 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146088    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 05 13:15:20.151882 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146091    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 05 13:15:20.151882 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146094    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 05 13:15:20.151882 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146096    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 05 13:15:20.151882 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146099    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 05 13:15:20.151882 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146104    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 05 13:15:20.151882 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146107    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 05 13:15:20.151882 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146110    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 05 13:15:20.151882 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146113    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 05 13:15:20.151882 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146115    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 05 13:15:20.151882 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146118    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 05 13:15:20.151882 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146120    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 05 13:15:20.151882 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146123    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 05 13:15:20.152382 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146125    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 05 13:15:20.152382 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146128    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 05 13:15:20.152382 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146130    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 05 13:15:20.152382 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146133    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 05 13:15:20.152382 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146136    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 05 13:15:20.152382 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146139    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 05 13:15:20.152382 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146142    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 05 13:15:20.152382 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146144    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 05 13:15:20.152382 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146147    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 05 13:15:20.152382 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146149    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 05 13:15:20.152382 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146152    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 05 13:15:20.152382 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146154    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 05 13:15:20.152382 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146157    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 05 13:15:20.152382 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146160    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 05 13:15:20.152382 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146162    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 05 13:15:20.152382 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146165    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 05 13:15:20.152382 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146167    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 05 13:15:20.152382 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146169    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 05 13:15:20.152382 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146172    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 05 13:15:20.152382 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146174    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 05 13:15:20.152883 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146177    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 05 13:15:20.152883 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146179    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 05 13:15:20.152883 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146182    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 05 13:15:20.152883 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146185    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 05 13:15:20.152883 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146187    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 05 13:15:20.152883 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146190    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 05 13:15:20.152883 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146193    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 05 13:15:20.152883 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146195    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 05 13:15:20.152883 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146198    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 05 13:15:20.152883 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146201    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 05 13:15:20.152883 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146203    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 05 13:15:20.152883 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146206    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 05 13:15:20.152883 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146208    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 05 13:15:20.152883 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146211    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 05 13:15:20.152883 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146213    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 05 13:15:20.152883 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146234    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 05 13:15:20.152883 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146237    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 05 13:15:20.152883 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146240    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 05 13:15:20.152883 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146244    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 05 13:15:20.153409 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146248    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 05 13:15:20.153409 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146251    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 05 13:15:20.153409 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146254    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 05 13:15:20.153409 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146257    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 05 13:15:20.153409 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146259    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 05 13:15:20.153409 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146262    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 05 13:15:20.153409 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:20.146266    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 05 13:15:20.153409 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.146271    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 05 13:15:20.153409 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.146398    2563 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 05 13:15:20.153409 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.150762    2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 05 13:15:20.153409 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.151909    2563 server.go:1019] "Starting client certificate rotation"
Jul 05 13:15:20.153409 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.152008    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 05 13:15:20.153409 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.152036    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 05 13:15:20.154060 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.154046    2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 05 13:15:20.157259 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.157240    2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 05 13:15:20.167050 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.167028    2563 log.go:25] "Validated CRI v1 runtime API"
Jul 05 13:15:20.169710 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.169694    2563 log.go:25] "Validated CRI v1 image API"
Jul 05 13:15:20.171178 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.171157    2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 05 13:15:20.173344 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.173316    2563 fs.go:135] Filesystem UUIDs: map[0094b0e8-8676-45f6-a05d-2c81324211ac:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 a50aa03c-8357-4cc9-8e89-ad6a043476f9:/dev/nvme0n1p3]
Jul 05 13:15:20.173441 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.173341    2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 05 13:15:20.180524 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.180490    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 05 13:15:20.180663 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.180012    2563 manager.go:216] Machine: {Timestamp:2026-07-05 13:15:20.177817396 +0000 UTC m=+0.271703012 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100955 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20d4148a8cf49519cd086c8d4dfb6b SystemUUID:ec20d414-8a8c-f495-19cd-086c8d4dfb6b BootID:bfe352a7-1373-42ee-a122-9091fb5c8d17 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b5:6a:08:ec:6f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b5:6a:08:ec:6f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ca:f4:4c:f0:f4:b0 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 05 13:15:20.180663 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.180537    2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 05 13:15:20.180663 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.180655    2563 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 05 13:15:20.183263 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.183231    2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 05 13:15:20.183410 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.183265    2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-239.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 05 13:15:20.183846 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.183836    2563 topology_manager.go:138] "Creating topology manager with none policy"
Jul 05 13:15:20.183876 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.183848    2563 container_manager_linux.go:309] "Creating device plugin manager"
Jul 05 13:15:20.183876 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.183856    2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 05 13:15:20.184436 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.184424    2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 05 13:15:20.185580 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.185569    2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 05 13:15:20.189289 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.189274    2563 state_mem.go:36] "Initialized new in-memory state store"
Jul 05 13:15:20.189420 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.189410    2563 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 05 13:15:20.189453 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.189440    2563 kubelet.go:486] "Attempting to sync node with API server"
Jul 05 13:15:20.189453 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.189450    2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 05 13:15:20.189504 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.189465    2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 05 13:15:20.189504 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.189475    2563 kubelet.go:398] "Adding apiserver pod source"
Jul 05 13:15:20.189504 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.189484    2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 05 13:15:20.190394 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.190379    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 05 13:15:20.190472 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.190403    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 05 13:15:20.192304 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.192286    2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 05 13:15:20.194243 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.194209    2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 05 13:15:20.194326 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.194265    2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 05 13:15:20.195341 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.195328    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 05 13:15:20.195405 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.195353    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 05 13:15:20.195405 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.195364    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 05 13:15:20.195405 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.195373    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 05 13:15:20.195405 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.195386    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 05 13:15:20.195405 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.195394    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 05 13:15:20.195405 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.195407    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 05 13:15:20.195607 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.195415    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 05 13:15:20.195607 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.195425    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 05 13:15:20.195607 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.195435    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 05 13:15:20.195607 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.195447    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 05 13:15:20.195607 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.195457    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 05 13:15:20.196529 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.196517    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 05 13:15:20.196581 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.196531    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 05 13:15:20.198037 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.198013    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cfw8h"
Jul 05 13:15:20.199096 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.199077    2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-239.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 05 13:15:20.199510 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:20.199489    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 05 13:15:20.199510 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:20.199495    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-239.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 05 13:15:20.199836 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.199822    2563 server.go:1268] "Started kubelet"
Jul 05 13:15:20.199960 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.199902    2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 05 13:15:20.200011 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.199934    2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 05 13:15:20.200425 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.200165    2563 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 05 13:15:20.200854 ip-10-0-129-239 systemd[1]: Started Kubernetes Kubelet.
Jul 05 13:15:20.201476 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.201373    2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 05 13:15:20.201476 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.201388    2563 server.go:310] "Adding debug handlers to kubelet server"
Jul 05 13:15:20.204841 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:20.204811    2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 05 13:15:20.206116 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.206100    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cfw8h"
Jul 05 13:15:20.207610 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.207593    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 05 13:15:20.208026 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.208005    2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 05 13:15:20.208123 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:20.208079    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-239.ec2.internal\" not found"
Jul 05 13:15:20.208570 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.208546    2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 05 13:15:20.208570 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.208552    2563 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 05 13:15:20.208717 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.208572    2563 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 05 13:15:20.209267 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.209253    2563 reconstruct.go:97] "Volume reconstruction finished"
Jul 05 13:15:20.209267 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.209264    2563 reconciler.go:29] "Reconciler: start to sync state"
Jul 05 13:15:20.209385 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.209331    2563 factory.go:55] Registering systemd factory
Jul 05 13:15:20.209385 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.209344    2563 factory.go:223] Registration of the systemd container factory successfully
Jul 05 13:15:20.209600 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.209589    2563 factory.go:153] Registering CRI-O factory
Jul 05 13:15:20.209600 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.209601    2563 factory.go:223] Registration of the crio container factory successfully
Jul 05 13:15:20.209690 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.209665    2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 05 13:15:20.209734 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.209711    2563 factory.go:103] Registering Raw factory
Jul 05 13:15:20.209734 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.209728    2563 manager.go:1196] Started watching for new ooms in manager
Jul 05 13:15:20.210276 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.210263    2563 manager.go:349] Starting recovery of all containers
Jul 05 13:15:20.212113 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.212094    2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 05 13:15:20.215164 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:20.215134    2563 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-129-239.ec2.internal\" not found" node="ip-10-0-129-239.ec2.internal"
Jul 05 13:15:20.222443 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.222422    2563 manager.go:354] Recovery completed
Jul 05 13:15:20.224058 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:20.223951    2563 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 05 13:15:20.227107 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.227094    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 05 13:15:20.229053 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.229037    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-239.ec2.internal" event="NodeHasSufficientMemory"
Jul 05 13:15:20.229134 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.229070    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-239.ec2.internal" event="NodeHasNoDiskPressure"
Jul 05 13:15:20.229134 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.229085    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-239.ec2.internal" event="NodeHasSufficientPID"
Jul 05 13:15:20.229703 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.229684    2563 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 05 13:15:20.229703 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.229702    2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 05 13:15:20.229703 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.229685    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 05 13:15:20.229885 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.229722    2563 state_mem.go:36] "Initialized new in-memory state store"
Jul 05 13:15:20.230453 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.230438    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-239.ec2.internal" event="NodeHasSufficientMemory"
Jul 05 13:15:20.230516 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.230463    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-239.ec2.internal" event="NodeHasNoDiskPressure"
Jul 05 13:15:20.230516 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.230472    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-239.ec2.internal" event="NodeHasSufficientPID"
Jul 05 13:15:20.231826 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.231814    2563 policy_none.go:49] "None policy: Start"
Jul 05 13:15:20.231865 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.231830    2563 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 05 13:15:20.231865 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.231841    2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 05 13:15:20.233846 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.233833    2563 policy_none.go:47] "Start"
Jul 05 13:15:20.278212 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.278008    2563 manager.go:337] "Starting Device Plugin manager"
Jul 05 13:15:20.278367 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:20.278251    2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 05 13:15:20.278367 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.278269    2563 server.go:87] "Starting device plugin registration server"
Jul 05 13:15:20.278563 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.278551    2563 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 05 13:15:20.278595 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.278564    2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 05 13:15:20.278755 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.278660    2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 05 13:15:20.278755 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.278749    2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 05 13:15:20.278867 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.278759    2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 05 13:15:20.279421 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:20.279401    2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 05 13:15:20.279524 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:20.279452    2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-239.ec2.internal\" not found"
Jul 05 13:15:20.341329 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.341283    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 05 13:15:20.343537 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.342533    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 05 13:15:20.343537 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.342571    2563 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 05 13:15:20.343537 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.342596    2563 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 05 13:15:20.343537 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:20.342632    2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 05 13:15:20.345527 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.345509    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 05 13:15:20.378797 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.378703    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 05 13:15:20.379811 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.379795    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-239.ec2.internal" event="NodeHasSufficientMemory"
Jul 05 13:15:20.379891 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.379828    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-239.ec2.internal" event="NodeHasNoDiskPressure"
Jul 05 13:15:20.379891 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.379839    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-239.ec2.internal" event="NodeHasSufficientPID"
Jul 05 13:15:20.379891 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.379871    2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-239.ec2.internal"
Jul 05 13:15:20.388677 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.388659    2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-239.ec2.internal"
Jul 05 13:15:20.388739 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:20.388683    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-239.ec2.internal\": node \"ip-10-0-129-239.ec2.internal\" not found"
Jul 05 13:15:20.406893 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:20.406858    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-239.ec2.internal\" not found"
Jul 05 13:15:20.443512 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.443471    2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-239.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-239.ec2.internal"]
Jul 05 13:15:20.443658 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.443561    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 05 13:15:20.446236 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.446193    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-239.ec2.internal" event="NodeHasSufficientMemory"
Jul 05 13:15:20.446236 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.446235    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-239.ec2.internal" event="NodeHasNoDiskPressure"
Jul 05 13:15:20.446492 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.446246    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-239.ec2.internal" event="NodeHasSufficientPID"
Jul 05 13:15:20.448607 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.448592    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 05 13:15:20.448740 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.448724    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-239.ec2.internal"
Jul 05 13:15:20.448803 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.448763    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 05 13:15:20.450367 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.450351    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-239.ec2.internal" event="NodeHasSufficientMemory"
Jul 05 13:15:20.450458 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.450386    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-239.ec2.internal" event="NodeHasNoDiskPressure"
Jul 05 13:15:20.450458 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.450396    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-239.ec2.internal" event="NodeHasSufficientPID"
Jul 05 13:15:20.450458 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.450355    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-239.ec2.internal" event="NodeHasSufficientMemory"
Jul 05 13:15:20.450555 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.450458    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-239.ec2.internal" event="NodeHasNoDiskPressure"
Jul 05 13:15:20.450555 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.450470    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-239.ec2.internal" event="NodeHasSufficientPID"
Jul 05 13:15:20.452800 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.452785    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-239.ec2.internal"
Jul 05 13:15:20.452907 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.452814    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 05 13:15:20.453666 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.453648    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-239.ec2.internal" event="NodeHasSufficientMemory"
Jul 05 13:15:20.453745 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.453682    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-239.ec2.internal" event="NodeHasNoDiskPressure"
Jul 05 13:15:20.453745 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.453700    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-239.ec2.internal" event="NodeHasSufficientPID"
Jul 05 13:15:20.480265 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:20.480218    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-239.ec2.internal\" not found" node="ip-10-0-129-239.ec2.internal"
Jul 05 13:15:20.484147 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:20.484129    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-239.ec2.internal\" not found" node="ip-10-0-129-239.ec2.internal"
Jul 05 13:15:20.506969 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:20.506937    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-239.ec2.internal\" not found"
Jul 05 13:15:20.511038 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.511021    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/18b0ee83163856176658dd62eef90454-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-239.ec2.internal\" (UID: \"18b0ee83163856176658dd62eef90454\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-239.ec2.internal"
Jul 05 13:15:20.511087 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.511046    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/18b0ee83163856176658dd62eef90454-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-239.ec2.internal\" (UID: \"18b0ee83163856176658dd62eef90454\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-239.ec2.internal"
Jul 05 13:15:20.511087 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.511061    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/accb531ad4f6f6ba026b8fe327ce0ae5-config\") pod \"kube-apiserver-proxy-ip-10-0-129-239.ec2.internal\" (UID: \"accb531ad4f6f6ba026b8fe327ce0ae5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-239.ec2.internal"
Jul 05 13:15:20.607570 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:20.607526    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-239.ec2.internal\" not found"
Jul 05 13:15:20.611978 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.611951    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/18b0ee83163856176658dd62eef90454-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-239.ec2.internal\" (UID: \"18b0ee83163856176658dd62eef90454\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-239.ec2.internal"
Jul 05 13:15:20.612111 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.611948    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/18b0ee83163856176658dd62eef90454-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-239.ec2.internal\" (UID: \"18b0ee83163856176658dd62eef90454\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-239.ec2.internal"
Jul 05 13:15:20.612111 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.612012    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/18b0ee83163856176658dd62eef90454-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-239.ec2.internal\" (UID: \"18b0ee83163856176658dd62eef90454\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-239.ec2.internal"
Jul 05 13:15:20.612111 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.612032    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/accb531ad4f6f6ba026b8fe327ce0ae5-config\") pod \"kube-apiserver-proxy-ip-10-0-129-239.ec2.internal\" (UID: \"accb531ad4f6f6ba026b8fe327ce0ae5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-239.ec2.internal"
Jul 05 13:15:20.612111 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.612051    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/accb531ad4f6f6ba026b8fe327ce0ae5-config\") pod \"kube-apiserver-proxy-ip-10-0-129-239.ec2.internal\" (UID: \"accb531ad4f6f6ba026b8fe327ce0ae5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-239.ec2.internal"
Jul 05 13:15:20.612111 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.612052    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/18b0ee83163856176658dd62eef90454-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-239.ec2.internal\" (UID: \"18b0ee83163856176658dd62eef90454\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-239.ec2.internal"
Jul 05 13:15:20.707880 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:20.707778    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-239.ec2.internal\" not found"
Jul 05 13:15:20.784459 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.784419    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-239.ec2.internal"
Jul 05 13:15:20.786649 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:20.786621    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-239.ec2.internal"
Jul 05 13:15:20.808474 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:20.808435    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-239.ec2.internal\" not found"
Jul 05 13:15:20.909076 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:20.909024    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-239.ec2.internal\" not found"
Jul 05 13:15:21.010548 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:21.010447    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-239.ec2.internal\" not found"
Jul 05 13:15:21.111231 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:21.111186    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-239.ec2.internal\" not found"
Jul 05 13:15:21.151555 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:21.151526    2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 05 13:15:21.152008 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:21.151692    2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 05 13:15:21.152008 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:21.151698    2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 05 13:15:21.208833 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:21.208789    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-04 13:10:20 +0000 UTC" deadline="2028-03-11 09:44:37.257360356 +0000 UTC"
Jul 05 13:15:21.208833 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:21.208828    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14756h29m16.048536692s"
Jul 05 13:15:21.211980 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:21.211958    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-239.ec2.internal\" not found"
Jul 05 13:15:21.284344 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:21.284259    2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 05 13:15:21.309288 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:21.309255    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-239.ec2.internal"
Jul 05 13:15:21.319736 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:21.319713    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 05 13:15:21.321406 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:21.321388    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-239.ec2.internal"
Jul 05 13:15:21.327654 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:21.327636    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 05 13:15:21.373399 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:21.373354    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaccb531ad4f6f6ba026b8fe327ce0ae5.slice/crio-11bbcdeaf9db6798f76f671827e11aae9ab7e7e6fc4ac5ee4619a053d5acd332 WatchSource:0}: Error finding container 11bbcdeaf9db6798f76f671827e11aae9ab7e7e6fc4ac5ee4619a053d5acd332: Status 404 returned error can't find the container with id 11bbcdeaf9db6798f76f671827e11aae9ab7e7e6fc4ac5ee4619a053d5acd332
Jul 05 13:15:21.373658 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:21.373645    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18b0ee83163856176658dd62eef90454.slice/crio-44311e2dc053b5276ec293cca912cb65d4f5af97e8527b72ce5fe1efd1deaa2e WatchSource:0}: Error finding container 44311e2dc053b5276ec293cca912cb65d4f5af97e8527b72ce5fe1efd1deaa2e: Status 404 returned error can't find the container with id 44311e2dc053b5276ec293cca912cb65d4f5af97e8527b72ce5fe1efd1deaa2e
Jul 05 13:15:21.377893 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:21.377876    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 05 13:15:21.515738 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:21.515705    2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 05 13:15:22.042540 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.042506    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 05 13:15:22.190232 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.190183    2563 apiserver.go:52] "Watching apiserver"
Jul 05 13:15:22.199610 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.199574    2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 05 13:15:22.200075 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.200040    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-s9x2h","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-239.ec2.internal","openshift-network-operator/iptables-alerter-t6kt6","kube-system/konnectivity-agent-jrlbp","kube-system/kube-apiserver-proxy-ip-10-0-129-239.ec2.internal","openshift-dns/node-resolver-vsz6t","openshift-multus/multus-additional-cni-plugins-xvkqz","openshift-multus/multus-m9m5n","openshift-multus/network-metrics-daemon-49n5p","openshift-network-diagnostics/network-check-target-2bmk6","openshift-ovn-kubernetes/ovnkube-node-ht6xk","kube-system/global-pull-secret-syncer-nll82","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgz9n","openshift-cluster-node-tuning-operator/tuned-w88w4"]
Jul 05 13:15:22.203135 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.203088    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xvkqz"
Jul 05 13:15:22.205254 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.205231    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ht6xk"
Jul 05 13:15:22.206077 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.206054    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 05 13:15:22.206440 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.206275    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 05 13:15:22.206440 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.206212    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-qcbg2\""
Jul 05 13:15:22.206440 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.206297    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 05 13:15:22.206440 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.206303    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 05 13:15:22.206440 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.206436    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 05 13:15:22.207450 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.207368    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 05 13:15:22.207541 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.207511    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 05 13:15:22.207774 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.207758    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-t6kt6"
Jul 05 13:15:22.208073 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.208053    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 05 13:15:22.208869 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.208391    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 05 13:15:22.208869 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.208425    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 05 13:15:22.208869 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.208425    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 05 13:15:22.208869 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.208596    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 05 13:15:22.208869 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.208619    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-2jx2x\""
Jul 05 13:15:22.209741 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.209634    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 05 13:15:22.210154 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.209844    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 05 13:15:22.210154 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.209947    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-2h8nt\""
Jul 05 13:15:22.210154 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.209844    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 05 13:15:22.210377 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.210273    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jrlbp"
Jul 05 13:15:22.212913 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.212893    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-w88w4"
Jul 05 13:15:22.213874 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.213585    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 05 13:15:22.213874 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.213726    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-4pwzs\""
Jul 05 13:15:22.213874 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.213778    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 05 13:15:22.214868 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.214847    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 05 13:15:22.215310 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.215264    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vsz6t"
Jul 05 13:15:22.215895 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.215876    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 05 13:15:22.215985 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.215940    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-pnqq4\""
Jul 05 13:15:22.217855 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.217758    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-49n5p"
Jul 05 13:15:22.217855 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:22.217855    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-49n5p" podUID="7f4539d3-5413-4b71-9c09-a9503e62c68a"
Jul 05 13:15:22.220009 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.219567    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 05 13:15:22.220009 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.219768    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e17e56ea-7aa6-4a13-a11c-399e00d91800-konnectivity-ca\") pod \"konnectivity-agent-jrlbp\" (UID: \"e17e56ea-7aa6-4a13-a11c-399e00d91800\") " pod="kube-system/konnectivity-agent-jrlbp"
Jul 05 13:15:22.220009 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.219793    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 05 13:15:22.220009 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.219800    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/50c8a3c5-bf60-4554-bcf9-0b020c1f82ae-system-cni-dir\") pod \"multus-additional-cni-plugins-xvkqz\" (UID: \"50c8a3c5-bf60-4554-bcf9-0b020c1f82ae\") " pod="openshift-multus/multus-additional-cni-plugins-xvkqz"
Jul 05 13:15:22.220009 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.219838    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmjxh\" (UniqueName: \"kubernetes.io/projected/50c8a3c5-bf60-4554-bcf9-0b020c1f82ae-kube-api-access-hmjxh\") pod \"multus-additional-cni-plugins-xvkqz\" (UID: \"50c8a3c5-bf60-4554-bcf9-0b020c1f82ae\") " pod="openshift-multus/multus-additional-cni-plugins-xvkqz"
Jul 05 13:15:22.220009 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.219856    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9810b314-df2c-4247-a5ae-43aea8036357-node-log\") pod \"ovnkube-node-ht6xk\" (UID: \"9810b314-df2c-4247-a5ae-43aea8036357\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht6xk"
Jul 05 13:15:22.220009 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.219873    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9810b314-df2c-4247-a5ae-43aea8036357-log-socket\") pod \"ovnkube-node-ht6xk\" (UID: \"9810b314-df2c-4247-a5ae-43aea8036357\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht6xk"
Jul 05 13:15:22.220009 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.219893    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9810b314-df2c-4247-a5ae-43aea8036357-env-overrides\") pod \"ovnkube-node-ht6xk\" (UID: \"9810b314-df2c-4247-a5ae-43aea8036357\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht6xk"
Jul 05 13:15:22.220009 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.219916    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/50c8a3c5-bf60-4554-bcf9-0b020c1f82ae-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xvkqz\" (UID: \"50c8a3c5-bf60-4554-bcf9-0b020c1f82ae\") " pod="openshift-multus/multus-additional-cni-plugins-xvkqz"
Jul 05 13:15:22.220009 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.219964    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/50c8a3c5-bf60-4554-bcf9-0b020c1f82ae-cni-binary-copy\") pod \"multus-additional-cni-plugins-xvkqz\" (UID: \"50c8a3c5-bf60-4554-bcf9-0b020c1f82ae\") " pod="openshift-multus/multus-additional-cni-plugins-xvkqz"
Jul 05 13:15:22.220009 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.219979    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9810b314-df2c-4247-a5ae-43aea8036357-run-systemd\") pod \"ovnkube-node-ht6xk\" (UID: \"9810b314-df2c-4247-a5ae-43aea8036357\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht6xk"
Jul 05 13:15:22.220009 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.219994    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9810b314-df2c-4247-a5ae-43aea8036357-host-run-ovn-kubernetes\") pod \"ovnkube-node-ht6xk\" (UID: \"9810b314-df2c-4247-a5ae-43aea8036357\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht6xk"
Jul 05 13:15:22.220009 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.220010    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9810b314-df2c-4247-a5ae-43aea8036357-run-ovn\") pod \"ovnkube-node-ht6xk\" (UID: \"9810b314-df2c-4247-a5ae-43aea8036357\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht6xk"
Jul 05 13:15:22.220728 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.220052    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/78bd57a9-2c64-42b7-8d22-c920eb84afdd-iptables-alerter-script\") pod \"iptables-alerter-t6kt6\" (UID: \"78bd57a9-2c64-42b7-8d22-c920eb84afdd\") " pod="openshift-network-operator/iptables-alerter-t6kt6"
Jul 05 13:15:22.220728 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.220089    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9810b314-df2c-4247-a5ae-43aea8036357-host-slash\") pod \"ovnkube-node-ht6xk\" (UID: \"9810b314-df2c-4247-a5ae-43aea8036357\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht6xk"
Jul 05 13:15:22.220728 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.220132    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9810b314-df2c-4247-a5ae-43aea8036357-etc-openvswitch\") pod \"ovnkube-node-ht6xk\" (UID: \"9810b314-df2c-4247-a5ae-43aea8036357\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht6xk"
Jul 05 13:15:22.220728 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.220161    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9810b314-df2c-4247-a5ae-43aea8036357-host-cni-netd\") pod \"ovnkube-node-ht6xk\" (UID: \"9810b314-df2c-4247-a5ae-43aea8036357\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht6xk"
Jul 05 13:15:22.220728 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.220185    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/50c8a3c5-bf60-4554-bcf9-0b020c1f82ae-cnibin\") pod \"multus-additional-cni-plugins-xvkqz\" (UID: \"50c8a3c5-bf60-4554-bcf9-0b020c1f82ae\") " pod="openshift-multus/multus-additional-cni-plugins-xvkqz"
Jul 05 13:15:22.220728 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.220209    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-gz97x\""
Jul 05 13:15:22.220728 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.220231    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9810b314-df2c-4247-a5ae-43aea8036357-host-kubelet\") pod \"ovnkube-node-ht6xk\" (UID: \"9810b314-df2c-4247-a5ae-43aea8036357\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht6xk"
Jul 05 13:15:22.220728 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.220360    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9810b314-df2c-4247-a5ae-43aea8036357-var-lib-openvswitch\") pod \"ovnkube-node-ht6xk\" (UID: \"9810b314-df2c-4247-a5ae-43aea8036357\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht6xk"
Jul 05 13:15:22.220728 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.220389    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9810b314-df2c-4247-a5ae-43aea8036357-run-openvswitch\") pod \"ovnkube-node-ht6xk\" (UID: \"9810b314-df2c-4247-a5ae-43aea8036357\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht6xk"
Jul 05 13:15:22.220728 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.220415    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9810b314-df2c-4247-a5ae-43aea8036357-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ht6xk\" (UID: \"9810b314-df2c-4247-a5ae-43aea8036357\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht6xk"
Jul 05 13:15:22.220728 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.220466    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9810b314-df2c-4247-a5ae-43aea8036357-ovnkube-script-lib\") pod \"ovnkube-node-ht6xk\" (UID: \"9810b314-df2c-4247-a5ae-43aea8036357\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht6xk"
Jul 05 13:15:22.220728 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.220490    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kn7gl\" (UniqueName: \"kubernetes.io/projected/9810b314-df2c-4247-a5ae-43aea8036357-kube-api-access-kn7gl\") pod \"ovnkube-node-ht6xk\" (UID: \"9810b314-df2c-4247-a5ae-43aea8036357\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht6xk"
Jul 05 13:15:22.220728 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.220530    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8vqx\" (UniqueName: \"kubernetes.io/projected/78bd57a9-2c64-42b7-8d22-c920eb84afdd-kube-api-access-z8vqx\") pod \"iptables-alerter-t6kt6\" (UID: \"78bd57a9-2c64-42b7-8d22-c920eb84afdd\") " pod="openshift-network-operator/iptables-alerter-t6kt6"
Jul 05 13:15:22.220728 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.220566    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e17e56ea-7aa6-4a13-a11c-399e00d91800-agent-certs\") pod \"konnectivity-agent-jrlbp\" (UID: \"e17e56ea-7aa6-4a13-a11c-399e00d91800\") " pod="kube-system/konnectivity-agent-jrlbp"
Jul 05 13:15:22.220728 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.220595    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/50c8a3c5-bf60-4554-bcf9-0b020c1f82ae-os-release\") pod \"multus-additional-cni-plugins-xvkqz\" (UID: \"50c8a3c5-bf60-4554-bcf9-0b020c1f82ae\") " pod="openshift-multus/multus-additional-cni-plugins-xvkqz"
Jul 05 13:15:22.221455 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.220619    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/50c8a3c5-bf60-4554-bcf9-0b020c1f82ae-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xvkqz\" (UID: \"50c8a3c5-bf60-4554-bcf9-0b020c1f82ae\") " pod="openshift-multus/multus-additional-cni-plugins-xvkqz"
Jul 05 13:15:22.221455 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.220668    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/50c8a3c5-bf60-4554-bcf9-0b020c1f82ae-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xvkqz\" (UID: \"50c8a3c5-bf60-4554-bcf9-0b020c1f82ae\") " pod="openshift-multus/multus-additional-cni-plugins-xvkqz"
Jul 05 13:15:22.221455 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.220692    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgz9n"
Jul 05 13:15:22.221455 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.220692    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9810b314-df2c-4247-a5ae-43aea8036357-systemd-units\") pod \"ovnkube-node-ht6xk\" (UID: \"9810b314-df2c-4247-a5ae-43aea8036357\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht6xk"
Jul 05 13:15:22.221719 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.221690    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9810b314-df2c-4247-a5ae-43aea8036357-host-cni-bin\") pod \"ovnkube-node-ht6xk\" (UID: \"9810b314-df2c-4247-a5ae-43aea8036357\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht6xk"
Jul 05 13:15:22.221897 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.221870    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/78bd57a9-2c64-42b7-8d22-c920eb84afdd-host-slash\") pod \"iptables-alerter-t6kt6\" (UID: \"78bd57a9-2c64-42b7-8d22-c920eb84afdd\") " pod="openshift-network-operator/iptables-alerter-t6kt6"
Jul 05 13:15:22.222013 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.221992    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9810b314-df2c-4247-a5ae-43aea8036357-host-run-netns\") pod \"ovnkube-node-ht6xk\" (UID: \"9810b314-df2c-4247-a5ae-43aea8036357\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht6xk"
Jul 05 13:15:22.222056 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.222035    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9810b314-df2c-4247-a5ae-43aea8036357-ovnkube-config\") pod \"ovnkube-node-ht6xk\" (UID: \"9810b314-df2c-4247-a5ae-43aea8036357\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht6xk"
Jul 05 13:15:22.222111 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.222095    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9810b314-df2c-4247-a5ae-43aea8036357-ovn-node-metrics-cert\") pod \"ovnkube-node-ht6xk\" (UID: \"9810b314-df2c-4247-a5ae-43aea8036357\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht6xk"
Jul 05 13:15:22.224267 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.223847    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-m9m5n"
Jul 05 13:15:22.225555 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.225399    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-qxvhb\""
Jul 05 13:15:22.226100 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.226083    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 05 13:15:22.226327 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.226309    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 05 13:15:22.226557 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.226536    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 05 13:15:22.227246 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.226752    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2bmk6"
Jul 05 13:15:22.227246 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:22.226822    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2bmk6" podUID="516bf532-d39c-49a3-a2ba-b2e7af7c66ae"
Jul 05 13:15:22.229057 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.228930    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-6xzc8\""
Jul 05 13:15:22.229057 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.229038    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 05 13:15:22.229307 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.229285    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-s9x2h"
Jul 05 13:15:22.231822 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.231802    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nll82"
Jul 05 13:15:22.231959 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:22.231879    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nll82" podUID="93717f79-abca-4163-80a4-061dabcc4d51"
Jul 05 13:15:22.232864 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.232817    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-k9dsn\""
Jul 05 13:15:22.232864 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.232837    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 05 13:15:22.232864 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.232854    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 05 13:15:22.233107 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.233089    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 05 13:15:22.239649 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.239621    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 05 13:15:22.278105 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.278083    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-48v75"
Jul 05 13:15:22.286242 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.286205    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-48v75"
Jul 05 13:15:22.310440 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.310367    2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 05 13:15:22.322988 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.322952    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e5283d97-9f47-4927-ad3f-f9f1596c1d55-etc-sysctl-d\") pod \"tuned-w88w4\" (UID: \"e5283d97-9f47-4927-ad3f-f9f1596c1d55\") " pod="openshift-cluster-node-tuning-operator/tuned-w88w4"
Jul 05 13:15:22.323165 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.322994    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e5283d97-9f47-4927-ad3f-f9f1596c1d55-lib-modules\") pod \"tuned-w88w4\" (UID: \"e5283d97-9f47-4927-ad3f-f9f1596c1d55\") " pod="openshift-cluster-node-tuning-operator/tuned-w88w4"
Jul 05 13:15:22.323165 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.323022    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5283d97-9f47-4927-ad3f-f9f1596c1d55-tmp\") pod \"tuned-w88w4\" (UID: \"e5283d97-9f47-4927-ad3f-f9f1596c1d55\") " pod="openshift-cluster-node-tuning-operator/tuned-w88w4"
Jul 05 13:15:22.323165 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.323084    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c528f627-1ea0-45b7-892c-a8e34360bcc5-multus-conf-dir\") pod \"multus-m9m5n\" (UID: \"c528f627-1ea0-45b7-892c-a8e34360bcc5\") " pod="openshift-multus/multus-m9m5n"
Jul 05 13:15:22.323165 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.323126    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/50c8a3c5-bf60-4554-bcf9-0b020c1f82ae-cni-binary-copy\") pod \"multus-additional-cni-plugins-xvkqz\" (UID: \"50c8a3c5-bf60-4554-bcf9-0b020c1f82ae\") " pod="openshift-multus/multus-additional-cni-plugins-xvkqz"
Jul 05 13:15:22.323165 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.323150    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9810b314-df2c-4247-a5ae-43aea8036357-run-systemd\") pod \"ovnkube-node-ht6xk\" (UID: \"9810b314-df2c-4247-a5ae-43aea8036357\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht6xk"
Jul 05 13:15:22.323407 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.323178    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c528f627-1ea0-45b7-892c-a8e34360bcc5-host-run-multus-certs\") pod \"multus-m9m5n\" (UID: \"c528f627-1ea0-45b7-892c-a8e34360bcc5\") " pod="openshift-multus/multus-m9m5n"
Jul 05 13:15:22.323407 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.323204    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9810b314-df2c-4247-a5ae-43aea8036357-run-ovn\") pod \"ovnkube-node-ht6xk\" (UID: \"9810b314-df2c-4247-a5ae-43aea8036357\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht6xk"
Jul 05 13:15:22.323407 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.323256    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e5283d97-9f47-4927-ad3f-f9f1596c1d55-etc-tuned\") pod \"tuned-w88w4\" (UID: \"e5283d97-9f47-4927-ad3f-f9f1596c1d55\") " pod="openshift-cluster-node-tuning-operator/tuned-w88w4"
Jul 05 13:15:22.323407 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.323263    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9810b314-df2c-4247-a5ae-43aea8036357-run-systemd\") pod \"ovnkube-node-ht6xk\" (UID: \"9810b314-df2c-4247-a5ae-43aea8036357\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht6xk"
Jul 05 13:15:22.323407 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.323281    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jpn5\" (UniqueName: \"kubernetes.io/projected/7f4539d3-5413-4b71-9c09-a9503e62c68a-kube-api-access-2jpn5\") pod \"network-metrics-daemon-49n5p\" (UID: \"7f4539d3-5413-4b71-9c09-a9503e62c68a\") " pod="openshift-multus/network-metrics-daemon-49n5p"
Jul 05 13:15:22.323407 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.323286    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9810b314-df2c-4247-a5ae-43aea8036357-run-ovn\") pod \"ovnkube-node-ht6xk\" (UID: \"9810b314-df2c-4247-a5ae-43aea8036357\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht6xk"
Jul 05 13:15:22.323407 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.323404    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c528f627-1ea0-45b7-892c-a8e34360bcc5-host-run-netns\") pod \"multus-m9m5n\" (UID: \"c528f627-1ea0-45b7-892c-a8e34360bcc5\") " pod="openshift-multus/multus-m9m5n"
Jul 05 13:15:22.323707 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.323432    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c528f627-1ea0-45b7-892c-a8e34360bcc5-host-var-lib-cni-bin\") pod \"multus-m9m5n\" (UID: \"c528f627-1ea0-45b7-892c-a8e34360bcc5\") " pod="openshift-multus/multus-m9m5n"
Jul 05 13:15:22.323707 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.323459    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/93717f79-abca-4163-80a4-061dabcc4d51-original-pull-secret\") pod \"global-pull-secret-syncer-nll82\" (UID: \"93717f79-abca-4163-80a4-061dabcc4d51\") " pod="kube-system/global-pull-secret-syncer-nll82"
Jul 05 13:15:22.323707 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.323496    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/78bd57a9-2c64-42b7-8d22-c920eb84afdd-iptables-alerter-script\") pod \"iptables-alerter-t6kt6\" (UID: \"78bd57a9-2c64-42b7-8d22-c920eb84afdd\") " pod="openshift-network-operator/iptables-alerter-t6kt6"
Jul 05 13:15:22.323707 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.323513    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9810b314-df2c-4247-a5ae-43aea8036357-etc-openvswitch\") pod \"ovnkube-node-ht6xk\" (UID: \"9810b314-df2c-4247-a5ae-43aea8036357\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht6xk"
Jul 05 13:15:22.323707 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.323534    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9810b314-df2c-4247-a5ae-43aea8036357-host-cni-netd\") pod \"ovnkube-node-ht6xk\" (UID: \"9810b314-df2c-4247-a5ae-43aea8036357\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht6xk"
Jul 05 13:15:22.323707 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.323560    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkxqm\" (UniqueName: \"kubernetes.io/projected/e5283d97-9f47-4927-ad3f-f9f1596c1d55-kube-api-access-tkxqm\") pod \"tuned-w88w4\" (UID: \"e5283d97-9f47-4927-ad3f-f9f1596c1d55\") " pod="openshift-cluster-node-tuning-operator/tuned-w88w4"
Jul 05 13:15:22.323707 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.323585    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b7e0654-df3e-4f31-9fee-402ee841d4ac-tmp-dir\") pod \"node-resolver-vsz6t\" (UID: \"6b7e0654-df3e-4f31-9fee-402ee841d4ac\") " pod="openshift-dns/node-resolver-vsz6t"
Jul 05 13:15:22.323707 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.323584    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9810b314-df2c-4247-a5ae-43aea8036357-etc-openvswitch\") pod \"ovnkube-node-ht6xk\" (UID: \"9810b314-df2c-4247-a5ae-43aea8036357\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht6xk"
Jul 05 13:15:22.323707 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.323613    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9810b314-df2c-4247-a5ae-43aea8036357-host-cni-netd\") pod \"ovnkube-node-ht6xk\" (UID: \"9810b314-df2c-4247-a5ae-43aea8036357\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht6xk"
Jul 05 13:15:22.323707 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.323618    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c528f627-1ea0-45b7-892c-a8e34360bcc5-multus-cni-dir\") pod \"multus-m9m5n\" (UID: \"c528f627-1ea0-45b7-892c-a8e34360bcc5\") " pod="openshift-multus/multus-m9m5n"
Jul 05 13:15:22.323707 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.323661    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3d69842e-9902-40bc-a7f6-0a018acc73db-host\") pod \"node-ca-s9x2h\" (UID: \"3d69842e-9902-40bc-a7f6-0a018acc73db\") " pod="openshift-image-registry/node-ca-s9x2h"
Jul 05 13:15:22.323707 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.323691    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9810b314-df2c-4247-a5ae-43aea8036357-run-openvswitch\") pod \"ovnkube-node-ht6xk\" (UID: \"9810b314-df2c-4247-a5ae-43aea8036357\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht6xk"
Jul 05 13:15:22.324316 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.323716    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9810b314-df2c-4247-a5ae-43aea8036357-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ht6xk\" (UID: \"9810b314-df2c-4247-a5ae-43aea8036357\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht6xk"
Jul 05 13:15:22.324316 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.323743    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kn7gl\" (UniqueName: \"kubernetes.io/projected/9810b314-df2c-4247-a5ae-43aea8036357-kube-api-access-kn7gl\") pod \"ovnkube-node-ht6xk\" (UID: \"9810b314-df2c-4247-a5ae-43aea8036357\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht6xk"
Jul 05 13:15:22.324316 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.323769    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e5283d97-9f47-4927-ad3f-f9f1596c1d55-etc-modprobe-d\") pod \"tuned-w88w4\" (UID: \"e5283d97-9f47-4927-ad3f-f9f1596c1d55\") " pod="openshift-cluster-node-tuning-operator/tuned-w88w4"
Jul 05 13:15:22.324316 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.323777    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9810b314-df2c-4247-a5ae-43aea8036357-run-openvswitch\") pod \"ovnkube-node-ht6xk\" (UID: \"9810b314-df2c-4247-a5ae-43aea8036357\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht6xk"
Jul 05 13:15:22.324316 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.323790    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e5283d97-9f47-4927-ad3f-f9f1596c1d55-sys\") pod \"tuned-w88w4\" (UID: \"e5283d97-9f47-4927-ad3f-f9f1596c1d55\") " pod="openshift-cluster-node-tuning-operator/tuned-w88w4"
Jul 05 13:15:22.324316 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.323800    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9810b314-df2c-4247-a5ae-43aea8036357-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ht6xk\" (UID: \"9810b314-df2c-4247-a5ae-43aea8036357\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht6xk"
Jul 05 13:15:22.324316 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.323814    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c528f627-1ea0-45b7-892c-a8e34360bcc5-system-cni-dir\") pod \"multus-m9m5n\" (UID: \"c528f627-1ea0-45b7-892c-a8e34360bcc5\") " pod="openshift-multus/multus-m9m5n"
Jul 05 13:15:22.324316 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.323838    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/50c8a3c5-bf60-4554-bcf9-0b020c1f82ae-os-release\") pod \"multus-additional-cni-plugins-xvkqz\" (UID: \"50c8a3c5-bf60-4554-bcf9-0b020c1f82ae\") " pod="openshift-multus/multus-additional-cni-plugins-xvkqz"
Jul 05 13:15:22.324316 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.323873    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/50c8a3c5-bf60-4554-bcf9-0b020c1f82ae-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xvkqz\" (UID: \"50c8a3c5-bf60-4554-bcf9-0b020c1f82ae\") " pod="openshift-multus/multus-additional-cni-plugins-xvkqz"
Jul 05 13:15:22.324316 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.323887    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/50c8a3c5-bf60-4554-bcf9-0b020c1f82ae-cni-binary-copy\") pod \"multus-additional-cni-plugins-xvkqz\" (UID: \"50c8a3c5-bf60-4554-bcf9-0b020c1f82ae\") " pod="openshift-multus/multus-additional-cni-plugins-xvkqz"
Jul 05 13:15:22.324316 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.323905    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/50c8a3c5-bf60-4554-bcf9-0b020c1f82ae-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xvkqz\" (UID: \"50c8a3c5-bf60-4554-bcf9-0b020c1f82ae\") " pod="openshift-multus/multus-additional-cni-plugins-xvkqz"
Jul 05 13:15:22.324316 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.323934    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9810b314-df2c-4247-a5ae-43aea8036357-host-cni-bin\") pod \"ovnkube-node-ht6xk\" (UID: \"9810b314-df2c-4247-a5ae-43aea8036357\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht6xk"
Jul 05 13:15:22.324316 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.323953    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/50c8a3c5-bf60-4554-bcf9-0b020c1f82ae-os-release\") pod \"multus-additional-cni-plugins-xvkqz\" (UID: \"50c8a3c5-bf60-4554-bcf9-0b020c1f82ae\") " pod="openshift-multus/multus-additional-cni-plugins-xvkqz"
Jul 05 13:15:22.324316 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.323956    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e5283d97-9f47-4927-ad3f-f9f1596c1d55-run\") pod \"tuned-w88w4\" (UID: \"e5283d97-9f47-4927-ad3f-f9f1596c1d55\") " pod="openshift-cluster-node-tuning-operator/tuned-w88w4"
Jul 05 13:15:22.324316 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.324006    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f4539d3-5413-4b71-9c09-a9503e62c68a-metrics-certs\") pod \"network-metrics-daemon-49n5p\" (UID: \"7f4539d3-5413-4b71-9c09-a9503e62c68a\") " pod="openshift-multus/network-metrics-daemon-49n5p"
Jul 05 13:15:22.325043 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.324008    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9810b314-df2c-4247-a5ae-43aea8036357-host-cni-bin\") pod \"ovnkube-node-ht6xk\" (UID: \"9810b314-df2c-4247-a5ae-43aea8036357\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht6xk"
Jul 05 13:15:22.325043 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.324046    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brlxb\" (UniqueName: \"kubernetes.io/projected/7a0f5157-6c15-4ec3-82b3-1c5dccb6e314-kube-api-access-brlxb\") pod \"aws-ebs-csi-driver-node-xgz9n\" (UID: \"7a0f5157-6c15-4ec3-82b3-1c5dccb6e314\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgz9n"
Jul 05 13:15:22.325043 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.324077    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/50c8a3c5-bf60-4554-bcf9-0b020c1f82ae-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xvkqz\" (UID: \"50c8a3c5-bf60-4554-bcf9-0b020c1f82ae\") " pod="openshift-multus/multus-additional-cni-plugins-xvkqz"
Jul 05 13:15:22.325043 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.324112    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c528f627-1ea0-45b7-892c-a8e34360bcc5-etc-kubernetes\") pod \"multus-m9m5n\" (UID: \"c528f627-1ea0-45b7-892c-a8e34360bcc5\") " pod="openshift-multus/multus-m9m5n"
Jul 05 13:15:22.325043 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.324139    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9810b314-df2c-4247-a5ae-43aea8036357-ovnkube-config\") pod \"ovnkube-node-ht6xk\" (UID: \"9810b314-df2c-4247-a5ae-43aea8036357\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht6xk"
Jul 05 13:15:22.325043 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.324162    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e5283d97-9f47-4927-ad3f-f9f1596c1d55-etc-sysconfig\") pod \"tuned-w88w4\" (UID: \"e5283d97-9f47-4927-ad3f-f9f1596c1d55\") " pod="openshift-cluster-node-tuning-operator/tuned-w88w4"
Jul 05 13:15:22.325043 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.324193    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/78bd57a9-2c64-42b7-8d22-c920eb84afdd-iptables-alerter-script\") pod \"iptables-alerter-t6kt6\" (UID: \"78bd57a9-2c64-42b7-8d22-c920eb84afdd\") " pod="openshift-network-operator/iptables-alerter-t6kt6"
Jul 05 13:15:22.325043 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.324204    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e5283d97-9f47-4927-ad3f-f9f1596c1d55-etc-sysctl-conf\") pod \"tuned-w88w4\" (UID: \"e5283d97-9f47-4927-ad3f-f9f1596c1d55\") " pod="openshift-cluster-node-tuning-operator/tuned-w88w4"
Jul 05 13:15:22.325043 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.324242    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljpvv\" (UniqueName: \"kubernetes.io/projected/6b7e0654-df3e-4f31-9fee-402ee841d4ac-kube-api-access-ljpvv\") pod \"node-resolver-vsz6t\" (UID: \"6b7e0654-df3e-4f31-9fee-402ee841d4ac\") " pod="openshift-dns/node-resolver-vsz6t"
Jul 05 13:15:22.325043 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.324268    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66gmk\" (UniqueName: \"kubernetes.io/projected/c528f627-1ea0-45b7-892c-a8e34360bcc5-kube-api-access-66gmk\") pod \"multus-m9m5n\" (UID: \"c528f627-1ea0-45b7-892c-a8e34360bcc5\") " pod="openshift-multus/multus-m9m5n"
Jul 05 13:15:22.325043 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.324338    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3d69842e-9902-40bc-a7f6-0a018acc73db-serviceca\") pod \"node-ca-s9x2h\" (UID: \"3d69842e-9902-40bc-a7f6-0a018acc73db\") " pod="openshift-image-registry/node-ca-s9x2h"
Jul 05 13:15:22.325043 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.324379    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/93717f79-abca-4163-80a4-061dabcc4d51-dbus\") pod \"global-pull-secret-syncer-nll82\" (UID: \"93717f79-abca-4163-80a4-061dabcc4d51\") " pod="kube-system/global-pull-secret-syncer-nll82"
Jul 05 13:15:22.325043 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.324399    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9810b314-df2c-4247-a5ae-43aea8036357-node-log\") pod \"ovnkube-node-ht6xk\" (UID: \"9810b314-df2c-4247-a5ae-43aea8036357\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht6xk"
Jul 05 13:15:22.325043 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.324417    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9810b314-df2c-4247-a5ae-43aea8036357-log-socket\") pod \"ovnkube-node-ht6xk\" (UID: \"9810b314-df2c-4247-a5ae-43aea8036357\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht6xk"
Jul 05 13:15:22.325043 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.324440    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9810b314-df2c-4247-a5ae-43aea8036357-env-overrides\") pod \"ovnkube-node-ht6xk\" (UID: \"9810b314-df2c-4247-a5ae-43aea8036357\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht6xk"
Jul 05 13:15:22.325043 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.324463    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e5283d97-9f47-4927-ad3f-f9f1596c1d55-etc-kubernetes\") pod \"tuned-w88w4\" (UID: \"e5283d97-9f47-4927-ad3f-f9f1596c1d55\") " pod="openshift-cluster-node-tuning-operator/tuned-w88w4"
Jul 05 13:15:22.325758 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.324469    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9810b314-df2c-4247-a5ae-43aea8036357-node-log\") pod \"ovnkube-node-ht6xk\" (UID: \"9810b314-df2c-4247-a5ae-43aea8036357\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht6xk"
Jul 05 13:15:22.325758 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.324486    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c528f627-1ea0-45b7-892c-a8e34360bcc5-hostroot\") pod \"multus-m9m5n\" (UID: \"c528f627-1ea0-45b7-892c-a8e34360bcc5\") " pod="openshift-multus/multus-m9m5n"
Jul 05 13:15:22.325758 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.324503    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9810b314-df2c-4247-a5ae-43aea8036357-log-socket\") pod \"ovnkube-node-ht6xk\" (UID: \"9810b314-df2c-4247-a5ae-43aea8036357\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht6xk"
Jul 05 13:15:22.325758 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.324530    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/50c8a3c5-bf60-4554-bcf9-0b020c1f82ae-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xvkqz\" (UID: \"50c8a3c5-bf60-4554-bcf9-0b020c1f82ae\") " pod="openshift-multus/multus-additional-cni-plugins-xvkqz"
Jul 05 13:15:22.325758 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.324572    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9810b314-df2c-4247-a5ae-43aea8036357-host-run-ovn-kubernetes\") pod \"ovnkube-node-ht6xk\" (UID: \"9810b314-df2c-4247-a5ae-43aea8036357\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht6xk"
Jul 05 13:15:22.325758 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.324581    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/50c8a3c5-bf60-4554-bcf9-0b020c1f82ae-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xvkqz\" (UID: \"50c8a3c5-bf60-4554-bcf9-0b020c1f82ae\") " pod="openshift-multus/multus-additional-cni-plugins-xvkqz"
Jul 05 13:15:22.325758 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.324594    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c528f627-1ea0-45b7-892c-a8e34360bcc5-host-run-k8s-cni-cncf-io\") pod \"multus-m9m5n\" (UID: \"c528f627-1ea0-45b7-892c-a8e34360bcc5\") " pod="openshift-multus/multus-m9m5n"
Jul 05 13:15:22.325758 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.324617    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfdtd\" (UniqueName: \"kubernetes.io/projected/516bf532-d39c-49a3-a2ba-b2e7af7c66ae-kube-api-access-cfdtd\") pod \"network-check-target-2bmk6\" (UID: \"516bf532-d39c-49a3-a2ba-b2e7af7c66ae\") " pod="openshift-network-diagnostics/network-check-target-2bmk6"
Jul 05 13:15:22.325758 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.324704    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9810b314-df2c-4247-a5ae-43aea8036357-ovnkube-config\") pod \"ovnkube-node-ht6xk\" (UID: \"9810b314-df2c-4247-a5ae-43aea8036357\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht6xk"
Jul 05 13:15:22.325758 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.324761    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9810b314-df2c-4247-a5ae-43aea8036357-host-run-ovn-kubernetes\") pod \"ovnkube-node-ht6xk\" (UID: \"9810b314-df2c-4247-a5ae-43aea8036357\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht6xk"
Jul 05 13:15:22.325758 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.324792    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7a0f5157-6c15-4ec3-82b3-1c5dccb6e314-device-dir\") pod \"aws-ebs-csi-driver-node-xgz9n\" (UID: \"7a0f5157-6c15-4ec3-82b3-1c5dccb6e314\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgz9n"
Jul 05 13:15:22.325758 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.324819    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9810b314-df2c-4247-a5ae-43aea8036357-host-slash\") pod \"ovnkube-node-ht6xk\" (UID: \"9810b314-df2c-4247-a5ae-43aea8036357\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht6xk"
Jul 05 13:15:22.325758 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.324847    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6b7e0654-df3e-4f31-9fee-402ee841d4ac-hosts-file\") pod \"node-resolver-vsz6t\" (UID: \"6b7e0654-df3e-4f31-9fee-402ee841d4ac\") " pod="openshift-dns/node-resolver-vsz6t"
Jul 05 13:15:22.325758 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.324856    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9810b314-df2c-4247-a5ae-43aea8036357-host-slash\") pod \"ovnkube-node-ht6xk\" (UID: \"9810b314-df2c-4247-a5ae-43aea8036357\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht6xk"
Jul 05 13:15:22.325758 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.324870    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7a0f5157-6c15-4ec3-82b3-1c5dccb6e314-etc-selinux\") pod \"aws-ebs-csi-driver-node-xgz9n\" (UID: \"7a0f5157-6c15-4ec3-82b3-1c5dccb6e314\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgz9n"
Jul 05 13:15:22.325758 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.324893    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c528f627-1ea0-45b7-892c-a8e34360bcc5-cnibin\") pod \"multus-m9m5n\" (UID: \"c528f627-1ea0-45b7-892c-a8e34360bcc5\") " pod="openshift-multus/multus-m9m5n"
Jul 05 13:15:22.326384 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.324915    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9810b314-df2c-4247-a5ae-43aea8036357-env-overrides\") pod \"ovnkube-node-ht6xk\" (UID: \"9810b314-df2c-4247-a5ae-43aea8036357\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht6xk"
Jul 05 13:15:22.326384 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.324958    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c528f627-1ea0-45b7-892c-a8e34360bcc5-os-release\") pod \"multus-m9m5n\" (UID: \"c528f627-1ea0-45b7-892c-a8e34360bcc5\") " pod="openshift-multus/multus-m9m5n"
Jul 05 13:15:22.326384 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.324986    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlhr2\" (UniqueName: \"kubernetes.io/projected/3d69842e-9902-40bc-a7f6-0a018acc73db-kube-api-access-zlhr2\") pod \"node-ca-s9x2h\" (UID: \"3d69842e-9902-40bc-a7f6-0a018acc73db\") " pod="openshift-image-registry/node-ca-s9x2h"
Jul 05 13:15:22.326384 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.325015    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/50c8a3c5-bf60-4554-bcf9-0b020c1f82ae-cnibin\") pod \"multus-additional-cni-plugins-xvkqz\" (UID: \"50c8a3c5-bf60-4554-bcf9-0b020c1f82ae\") " pod="openshift-multus/multus-additional-cni-plugins-xvkqz"
Jul 05 13:15:22.326384 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.325034    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9810b314-df2c-4247-a5ae-43aea8036357-host-kubelet\") pod \"ovnkube-node-ht6xk\" (UID: \"9810b314-df2c-4247-a5ae-43aea8036357\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht6xk"
Jul 05 13:15:22.326384 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.325041    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/50c8a3c5-bf60-4554-bcf9-0b020c1f82ae-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xvkqz\" (UID: \"50c8a3c5-bf60-4554-bcf9-0b020c1f82ae\") " pod="openshift-multus/multus-additional-cni-plugins-xvkqz"
Jul 05 13:15:22.326384 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.325051    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9810b314-df2c-4247-a5ae-43aea8036357-var-lib-openvswitch\") pod \"ovnkube-node-ht6xk\" (UID: \"9810b314-df2c-4247-a5ae-43aea8036357\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht6xk"
Jul 05 13:15:22.326384 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.325062    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/50c8a3c5-bf60-4554-bcf9-0b020c1f82ae-cnibin\") pod \"multus-additional-cni-plugins-xvkqz\" (UID: \"50c8a3c5-bf60-4554-bcf9-0b020c1f82ae\") " pod="openshift-multus/multus-additional-cni-plugins-xvkqz"
Jul 05 13:15:22.326384 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.325074    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9810b314-df2c-4247-a5ae-43aea8036357-ovnkube-script-lib\") pod \"ovnkube-node-ht6xk\" (UID: \"9810b314-df2c-4247-a5ae-43aea8036357\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht6xk"
Jul 05 13:15:22.326384 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.325097    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7a0f5157-6c15-4ec3-82b3-1c5dccb6e314-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xgz9n\" (UID: \"7a0f5157-6c15-4ec3-82b3-1c5dccb6e314\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgz9n"
Jul 05 13:15:22.326384 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.325101    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9810b314-df2c-4247-a5ae-43aea8036357-host-kubelet\") pod \"ovnkube-node-ht6xk\" (UID: \"9810b314-df2c-4247-a5ae-43aea8036357\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht6xk"
Jul 05 13:15:22.326384 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.325107    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9810b314-df2c-4247-a5ae-43aea8036357-var-lib-openvswitch\") pod \"ovnkube-node-ht6xk\" (UID: \"9810b314-df2c-4247-a5ae-43aea8036357\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht6xk"
Jul 05 13:15:22.326384 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.325120    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7a0f5157-6c15-4ec3-82b3-1c5dccb6e314-socket-dir\") pod \"aws-ebs-csi-driver-node-xgz9n\" (UID: \"7a0f5157-6c15-4ec3-82b3-1c5dccb6e314\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgz9n"
Jul 05 13:15:22.326384 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.325142    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c528f627-1ea0-45b7-892c-a8e34360bcc5-cni-binary-copy\") pod \"multus-m9m5n\" (UID: \"c528f627-1ea0-45b7-892c-a8e34360bcc5\") " pod="openshift-multus/multus-m9m5n"
Jul 05 13:15:22.326384 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.325165    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8vqx\" (UniqueName: \"kubernetes.io/projected/78bd57a9-2c64-42b7-8d22-c920eb84afdd-kube-api-access-z8vqx\") pod \"iptables-alerter-t6kt6\" (UID: \"78bd57a9-2c64-42b7-8d22-c920eb84afdd\") " pod="openshift-network-operator/iptables-alerter-t6kt6"
Jul 05 13:15:22.326384 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.325194    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e17e56ea-7aa6-4a13-a11c-399e00d91800-agent-certs\") pod \"konnectivity-agent-jrlbp\" (UID: \"e17e56ea-7aa6-4a13-a11c-399e00d91800\") " pod="kube-system/konnectivity-agent-jrlbp"
Jul 05 13:15:22.327094 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.325245    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9810b314-df2c-4247-a5ae-43aea8036357-systemd-units\") pod \"ovnkube-node-ht6xk\" (UID: \"9810b314-df2c-4247-a5ae-43aea8036357\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht6xk"
Jul 05 13:15:22.327094 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.325269    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7a0f5157-6c15-4ec3-82b3-1c5dccb6e314-registration-dir\") pod \"aws-ebs-csi-driver-node-xgz9n\" (UID: \"7a0f5157-6c15-4ec3-82b3-1c5dccb6e314\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgz9n"
Jul 05 13:15:22.327094 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.325315    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7a0f5157-6c15-4ec3-82b3-1c5dccb6e314-sys-fs\") pod \"aws-ebs-csi-driver-node-xgz9n\" (UID: \"7a0f5157-6c15-4ec3-82b3-1c5dccb6e314\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgz9n"
Jul 05 13:15:22.327094 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.325337    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c528f627-1ea0-45b7-892c-a8e34360bcc5-host-var-lib-cni-multus\") pod \"multus-m9m5n\" (UID: \"c528f627-1ea0-45b7-892c-a8e34360bcc5\") " pod="openshift-multus/multus-m9m5n"
Jul 05 13:15:22.327094 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.325360    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c528f627-1ea0-45b7-892c-a8e34360bcc5-multus-daemon-config\") pod \"multus-m9m5n\" (UID: \"c528f627-1ea0-45b7-892c-a8e34360bcc5\") " pod="openshift-multus/multus-m9m5n"
Jul 05 13:15:22.327094 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.325402    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9810b314-df2c-4247-a5ae-43aea8036357-systemd-units\") pod \"ovnkube-node-ht6xk\" (UID: \"9810b314-df2c-4247-a5ae-43aea8036357\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht6xk"
Jul 05 13:15:22.327094 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.325419    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/78bd57a9-2c64-42b7-8d22-c920eb84afdd-host-slash\") pod \"iptables-alerter-t6kt6\" (UID: \"78bd57a9-2c64-42b7-8d22-c920eb84afdd\") " pod="openshift-network-operator/iptables-alerter-t6kt6"
Jul 05 13:15:22.327094 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.325515    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9810b314-df2c-4247-a5ae-43aea8036357-host-run-netns\") pod \"ovnkube-node-ht6xk\" (UID: \"9810b314-df2c-4247-a5ae-43aea8036357\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht6xk"
Jul 05 13:15:22.327094 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.325524    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/78bd57a9-2c64-42b7-8d22-c920eb84afdd-host-slash\") pod \"iptables-alerter-t6kt6\" (UID: \"78bd57a9-2c64-42b7-8d22-c920eb84afdd\") " pod="openshift-network-operator/iptables-alerter-t6kt6"
Jul 05 13:15:22.327094 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.325539    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9810b314-df2c-4247-a5ae-43aea8036357-ovn-node-metrics-cert\") pod \"ovnkube-node-ht6xk\" (UID: \"9810b314-df2c-4247-a5ae-43aea8036357\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht6xk"
Jul 05 13:15:22.327094 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.325574    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e5283d97-9f47-4927-ad3f-f9f1596c1d55-etc-systemd\") pod \"tuned-w88w4\" (UID: \"e5283d97-9f47-4927-ad3f-f9f1596c1d55\") " pod="openshift-cluster-node-tuning-operator/tuned-w88w4"
Jul 05 13:15:22.327094 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.325577    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9810b314-df2c-4247-a5ae-43aea8036357-host-run-netns\") pod \"ovnkube-node-ht6xk\" (UID: \"9810b314-df2c-4247-a5ae-43aea8036357\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht6xk"
Jul 05 13:15:22.327094 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.325596    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e5283d97-9f47-4927-ad3f-f9f1596c1d55-var-lib-kubelet\") pod \"tuned-w88w4\" (UID: \"e5283d97-9f47-4927-ad3f-f9f1596c1d55\") " pod="openshift-cluster-node-tuning-operator/tuned-w88w4"
Jul 05 13:15:22.327094 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.325581    2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 05 13:15:22.327094 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.325624    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c528f627-1ea0-45b7-892c-a8e34360bcc5-multus-socket-dir-parent\") pod \"multus-m9m5n\" (UID: \"c528f627-1ea0-45b7-892c-a8e34360bcc5\") " pod="openshift-multus/multus-m9m5n"
Jul 05 13:15:22.327094 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.325650    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/93717f79-abca-4163-80a4-061dabcc4d51-kubelet-config\") pod \"global-pull-secret-syncer-nll82\" (UID: \"93717f79-abca-4163-80a4-061dabcc4d51\") " pod="kube-system/global-pull-secret-syncer-nll82"
Jul 05 13:15:22.328020 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.325674    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e17e56ea-7aa6-4a13-a11c-399e00d91800-konnectivity-ca\") pod \"konnectivity-agent-jrlbp\" (UID: \"e17e56ea-7aa6-4a13-a11c-399e00d91800\") " pod="kube-system/konnectivity-agent-jrlbp"
Jul 05 13:15:22.328020 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.325603    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9810b314-df2c-4247-a5ae-43aea8036357-ovnkube-script-lib\") pod \"ovnkube-node-ht6xk\" (UID: \"9810b314-df2c-4247-a5ae-43aea8036357\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht6xk"
Jul 05 13:15:22.328020 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.325710    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/50c8a3c5-bf60-4554-bcf9-0b020c1f82ae-system-cni-dir\") pod \"multus-additional-cni-plugins-xvkqz\" (UID: \"50c8a3c5-bf60-4554-bcf9-0b020c1f82ae\") " pod="openshift-multus/multus-additional-cni-plugins-xvkqz"
Jul 05 13:15:22.328020 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.325824    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/50c8a3c5-bf60-4554-bcf9-0b020c1f82ae-system-cni-dir\") pod \"multus-additional-cni-plugins-xvkqz\" (UID: \"50c8a3c5-bf60-4554-bcf9-0b020c1f82ae\") " pod="openshift-multus/multus-additional-cni-plugins-xvkqz"
Jul 05 13:15:22.328020 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.325818    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmjxh\" (UniqueName: \"kubernetes.io/projected/50c8a3c5-bf60-4554-bcf9-0b020c1f82ae-kube-api-access-hmjxh\") pod \"multus-additional-cni-plugins-xvkqz\" (UID: \"50c8a3c5-bf60-4554-bcf9-0b020c1f82ae\") " pod="openshift-multus/multus-additional-cni-plugins-xvkqz"
Jul 05 13:15:22.328020 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.325878    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e5283d97-9f47-4927-ad3f-f9f1596c1d55-host\") pod \"tuned-w88w4\" (UID: \"e5283d97-9f47-4927-ad3f-f9f1596c1d55\") " pod="openshift-cluster-node-tuning-operator/tuned-w88w4"
Jul 05 13:15:22.328020 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.325920    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c528f627-1ea0-45b7-892c-a8e34360bcc5-host-var-lib-kubelet\") pod \"multus-m9m5n\" (UID: \"c528f627-1ea0-45b7-892c-a8e34360bcc5\") " pod="openshift-multus/multus-m9m5n"
Jul 05 13:15:22.328020 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.326174    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e17e56ea-7aa6-4a13-a11c-399e00d91800-konnectivity-ca\") pod \"konnectivity-agent-jrlbp\" (UID: \"e17e56ea-7aa6-4a13-a11c-399e00d91800\") " pod="kube-system/konnectivity-agent-jrlbp"
Jul 05 13:15:22.329436 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.329410    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9810b314-df2c-4247-a5ae-43aea8036357-ovn-node-metrics-cert\") pod \"ovnkube-node-ht6xk\" (UID: \"9810b314-df2c-4247-a5ae-43aea8036357\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht6xk"
Jul 05 13:15:22.329583 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.329536    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e17e56ea-7aa6-4a13-a11c-399e00d91800-agent-certs\") pod \"konnectivity-agent-jrlbp\" (UID: \"e17e56ea-7aa6-4a13-a11c-399e00d91800\") " pod="kube-system/konnectivity-agent-jrlbp"
Jul 05 13:15:22.332806 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.332768    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kn7gl\" (UniqueName: \"kubernetes.io/projected/9810b314-df2c-4247-a5ae-43aea8036357-kube-api-access-kn7gl\") pod \"ovnkube-node-ht6xk\" (UID: \"9810b314-df2c-4247-a5ae-43aea8036357\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht6xk"
Jul 05 13:15:22.333722 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.333697    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmjxh\" (UniqueName: \"kubernetes.io/projected/50c8a3c5-bf60-4554-bcf9-0b020c1f82ae-kube-api-access-hmjxh\") pod \"multus-additional-cni-plugins-xvkqz\" (UID: \"50c8a3c5-bf60-4554-bcf9-0b020c1f82ae\") " pod="openshift-multus/multus-additional-cni-plugins-xvkqz"
Jul 05 13:15:22.334030 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.334007    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8vqx\" (UniqueName: \"kubernetes.io/projected/78bd57a9-2c64-42b7-8d22-c920eb84afdd-kube-api-access-z8vqx\") pod \"iptables-alerter-t6kt6\" (UID: \"78bd57a9-2c64-42b7-8d22-c920eb84afdd\") " pod="openshift-network-operator/iptables-alerter-t6kt6"
Jul 05 13:15:22.349541 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.349486    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-239.ec2.internal" event={"ID":"18b0ee83163856176658dd62eef90454","Type":"ContainerStarted","Data":"44311e2dc053b5276ec293cca912cb65d4f5af97e8527b72ce5fe1efd1deaa2e"}
Jul 05 13:15:22.350722 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.350696    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-239.ec2.internal" event={"ID":"accb531ad4f6f6ba026b8fe327ce0ae5","Type":"ContainerStarted","Data":"11bbcdeaf9db6798f76f671827e11aae9ab7e7e6fc4ac5ee4619a053d5acd332"}
Jul 05 13:15:22.426857 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.426824    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c528f627-1ea0-45b7-892c-a8e34360bcc5-host-run-k8s-cni-cncf-io\") pod \"multus-m9m5n\" (UID: \"c528f627-1ea0-45b7-892c-a8e34360bcc5\") " pod="openshift-multus/multus-m9m5n"
Jul 05 13:15:22.426857 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.426859    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfdtd\" (UniqueName: \"kubernetes.io/projected/516bf532-d39c-49a3-a2ba-b2e7af7c66ae-kube-api-access-cfdtd\") pod \"network-check-target-2bmk6\" (UID: \"516bf532-d39c-49a3-a2ba-b2e7af7c66ae\") " pod="openshift-network-diagnostics/network-check-target-2bmk6"
Jul 05 13:15:22.426857 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.426877    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7a0f5157-6c15-4ec3-82b3-1c5dccb6e314-device-dir\") pod \"aws-ebs-csi-driver-node-xgz9n\" (UID: \"7a0f5157-6c15-4ec3-82b3-1c5dccb6e314\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgz9n"
Jul 05 13:15:22.427175 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.426900    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6b7e0654-df3e-4f31-9fee-402ee841d4ac-hosts-file\") pod \"node-resolver-vsz6t\" (UID: \"6b7e0654-df3e-4f31-9fee-402ee841d4ac\") " pod="openshift-dns/node-resolver-vsz6t"
Jul 05 13:15:22.427175 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.426922    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7a0f5157-6c15-4ec3-82b3-1c5dccb6e314-etc-selinux\") pod \"aws-ebs-csi-driver-node-xgz9n\" (UID: \"7a0f5157-6c15-4ec3-82b3-1c5dccb6e314\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgz9n"
Jul 05 13:15:22.427175 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.426948    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c528f627-1ea0-45b7-892c-a8e34360bcc5-cnibin\") pod \"multus-m9m5n\" (UID: \"c528f627-1ea0-45b7-892c-a8e34360bcc5\") " pod="openshift-multus/multus-m9m5n"
Jul 05 13:15:22.427175 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.426950    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c528f627-1ea0-45b7-892c-a8e34360bcc5-host-run-k8s-cni-cncf-io\") pod \"multus-m9m5n\" (UID: \"c528f627-1ea0-45b7-892c-a8e34360bcc5\") " pod="openshift-multus/multus-m9m5n"
Jul 05 13:15:22.427175 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.426971    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c528f627-1ea0-45b7-892c-a8e34360bcc5-os-release\") pod \"multus-m9m5n\" (UID: \"c528f627-1ea0-45b7-892c-a8e34360bcc5\") " pod="openshift-multus/multus-m9m5n"
Jul 05 13:15:22.427175 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.427016    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7a0f5157-6c15-4ec3-82b3-1c5dccb6e314-device-dir\") pod \"aws-ebs-csi-driver-node-xgz9n\" (UID: \"7a0f5157-6c15-4ec3-82b3-1c5dccb6e314\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgz9n"
Jul 05 13:15:22.427175 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.427018    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c528f627-1ea0-45b7-892c-a8e34360bcc5-cnibin\") pod \"multus-m9m5n\" (UID: \"c528f627-1ea0-45b7-892c-a8e34360bcc5\") " pod="openshift-multus/multus-m9m5n"
Jul 05 13:15:22.427175 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.427042    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c528f627-1ea0-45b7-892c-a8e34360bcc5-os-release\") pod \"multus-m9m5n\" (UID: \"c528f627-1ea0-45b7-892c-a8e34360bcc5\") " pod="openshift-multus/multus-m9m5n"
Jul 05 13:15:22.427175 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.427044    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlhr2\" (UniqueName: \"kubernetes.io/projected/3d69842e-9902-40bc-a7f6-0a018acc73db-kube-api-access-zlhr2\") pod \"node-ca-s9x2h\" (UID: \"3d69842e-9902-40bc-a7f6-0a018acc73db\") " pod="openshift-image-registry/node-ca-s9x2h"
Jul 05 13:15:22.427175 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.427078    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6b7e0654-df3e-4f31-9fee-402ee841d4ac-hosts-file\") pod \"node-resolver-vsz6t\" (UID: \"6b7e0654-df3e-4f31-9fee-402ee841d4ac\") " pod="openshift-dns/node-resolver-vsz6t"
Jul 05 13:15:22.427175 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.427087    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7a0f5157-6c15-4ec3-82b3-1c5dccb6e314-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xgz9n\" (UID: \"7a0f5157-6c15-4ec3-82b3-1c5dccb6e314\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgz9n"
Jul 05 13:15:22.427175 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.427089    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7a0f5157-6c15-4ec3-82b3-1c5dccb6e314-etc-selinux\") pod \"aws-ebs-csi-driver-node-xgz9n\" (UID: \"7a0f5157-6c15-4ec3-82b3-1c5dccb6e314\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgz9n"
Jul 05 13:15:22.427175 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.427115    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7a0f5157-6c15-4ec3-82b3-1c5dccb6e314-socket-dir\") pod \"aws-ebs-csi-driver-node-xgz9n\" (UID: \"7a0f5157-6c15-4ec3-82b3-1c5dccb6e314\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgz9n"
Jul 05 13:15:22.427175 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.427138    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c528f627-1ea0-45b7-892c-a8e34360bcc5-cni-binary-copy\") pod \"multus-m9m5n\" (UID: \"c528f627-1ea0-45b7-892c-a8e34360bcc5\") " pod="openshift-multus/multus-m9m5n"
Jul 05 13:15:22.427175 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.427159    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7a0f5157-6c15-4ec3-82b3-1c5dccb6e314-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xgz9n\" (UID: \"7a0f5157-6c15-4ec3-82b3-1c5dccb6e314\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgz9n"
Jul 05 13:15:22.427175 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.427164    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7a0f5157-6c15-4ec3-82b3-1c5dccb6e314-registration-dir\") pod \"aws-ebs-csi-driver-node-xgz9n\" (UID: \"7a0f5157-6c15-4ec3-82b3-1c5dccb6e314\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgz9n"
Jul 05 13:15:22.427993 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.427199    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7a0f5157-6c15-4ec3-82b3-1c5dccb6e314-sys-fs\") pod \"aws-ebs-csi-driver-node-xgz9n\" (UID: \"7a0f5157-6c15-4ec3-82b3-1c5dccb6e314\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgz9n"
Jul 05 13:15:22.427993 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.427212    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7a0f5157-6c15-4ec3-82b3-1c5dccb6e314-registration-dir\") pod \"aws-ebs-csi-driver-node-xgz9n\" (UID: \"7a0f5157-6c15-4ec3-82b3-1c5dccb6e314\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgz9n"
Jul 05 13:15:22.427993 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.427243    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c528f627-1ea0-45b7-892c-a8e34360bcc5-host-var-lib-cni-multus\") pod \"multus-m9m5n\" (UID: \"c528f627-1ea0-45b7-892c-a8e34360bcc5\") " pod="openshift-multus/multus-m9m5n"
Jul 05 13:15:22.427993 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.427280    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7a0f5157-6c15-4ec3-82b3-1c5dccb6e314-sys-fs\") pod \"aws-ebs-csi-driver-node-xgz9n\" (UID: \"7a0f5157-6c15-4ec3-82b3-1c5dccb6e314\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgz9n"
Jul 05 13:15:22.427993 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.427280    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c528f627-1ea0-45b7-892c-a8e34360bcc5-multus-daemon-config\") pod \"multus-m9m5n\" (UID: \"c528f627-1ea0-45b7-892c-a8e34360bcc5\") " pod="openshift-multus/multus-m9m5n"
Jul 05 13:15:22.427993 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.427305    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7a0f5157-6c15-4ec3-82b3-1c5dccb6e314-socket-dir\") pod \"aws-ebs-csi-driver-node-xgz9n\" (UID: \"7a0f5157-6c15-4ec3-82b3-1c5dccb6e314\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgz9n"
Jul 05 13:15:22.427993 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.427315    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e5283d97-9f47-4927-ad3f-f9f1596c1d55-etc-systemd\") pod \"tuned-w88w4\" (UID: \"e5283d97-9f47-4927-ad3f-f9f1596c1d55\") " pod="openshift-cluster-node-tuning-operator/tuned-w88w4"
Jul 05 13:15:22.427993 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.427340    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c528f627-1ea0-45b7-892c-a8e34360bcc5-host-var-lib-cni-multus\") pod \"multus-m9m5n\" (UID: \"c528f627-1ea0-45b7-892c-a8e34360bcc5\") " pod="openshift-multus/multus-m9m5n"
Jul 05 13:15:22.427993 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.427344    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e5283d97-9f47-4927-ad3f-f9f1596c1d55-var-lib-kubelet\") pod \"tuned-w88w4\" (UID: \"e5283d97-9f47-4927-ad3f-f9f1596c1d55\") " pod="openshift-cluster-node-tuning-operator/tuned-w88w4"
Jul 05 13:15:22.427993 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.427388    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c528f627-1ea0-45b7-892c-a8e34360bcc5-multus-socket-dir-parent\") pod \"multus-m9m5n\" (UID: \"c528f627-1ea0-45b7-892c-a8e34360bcc5\") " pod="openshift-multus/multus-m9m5n"
Jul 05 13:15:22.427993 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.427390    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e5283d97-9f47-4927-ad3f-f9f1596c1d55-var-lib-kubelet\") pod \"tuned-w88w4\" (UID: \"e5283d97-9f47-4927-ad3f-f9f1596c1d55\") " pod="openshift-cluster-node-tuning-operator/tuned-w88w4"
Jul 05 13:15:22.427993 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.427421    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/93717f79-abca-4163-80a4-061dabcc4d51-kubelet-config\") pod \"global-pull-secret-syncer-nll82\" (UID: \"93717f79-abca-4163-80a4-061dabcc4d51\") " pod="kube-system/global-pull-secret-syncer-nll82"
Jul 05 13:15:22.427993 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.427447    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e5283d97-9f47-4927-ad3f-f9f1596c1d55-etc-systemd\") pod \"tuned-w88w4\" (UID: \"e5283d97-9f47-4927-ad3f-f9f1596c1d55\") " pod="openshift-cluster-node-tuning-operator/tuned-w88w4"
Jul 05 13:15:22.427993 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.427449    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e5283d97-9f47-4927-ad3f-f9f1596c1d55-host\") pod \"tuned-w88w4\" (UID: \"e5283d97-9f47-4927-ad3f-f9f1596c1d55\") " pod="openshift-cluster-node-tuning-operator/tuned-w88w4"
Jul 05 13:15:22.427993 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.427475    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c528f627-1ea0-45b7-892c-a8e34360bcc5-multus-socket-dir-parent\") pod \"multus-m9m5n\" (UID: \"c528f627-1ea0-45b7-892c-a8e34360bcc5\") " pod="openshift-multus/multus-m9m5n"
Jul 05 13:15:22.427993 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.427499    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c528f627-1ea0-45b7-892c-a8e34360bcc5-host-var-lib-kubelet\") pod \"multus-m9m5n\" (UID: \"c528f627-1ea0-45b7-892c-a8e34360bcc5\") " pod="openshift-multus/multus-m9m5n"
Jul 05 13:15:22.428760 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.427506    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/93717f79-abca-4163-80a4-061dabcc4d51-kubelet-config\") pod \"global-pull-secret-syncer-nll82\" (UID: \"93717f79-abca-4163-80a4-061dabcc4d51\") " pod="kube-system/global-pull-secret-syncer-nll82"
Jul 05 13:15:22.428760 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.427524    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e5283d97-9f47-4927-ad3f-f9f1596c1d55-etc-sysctl-d\") pod \"tuned-w88w4\" (UID: \"e5283d97-9f47-4927-ad3f-f9f1596c1d55\") " pod="openshift-cluster-node-tuning-operator/tuned-w88w4"
Jul 05 13:15:22.428760 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.427546    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e5283d97-9f47-4927-ad3f-f9f1596c1d55-lib-modules\") pod \"tuned-w88w4\" (UID: \"e5283d97-9f47-4927-ad3f-f9f1596c1d55\") " pod="openshift-cluster-node-tuning-operator/tuned-w88w4"
Jul 05 13:15:22.428760 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.427559    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c528f627-1ea0-45b7-892c-a8e34360bcc5-host-var-lib-kubelet\") pod \"multus-m9m5n\" (UID: \"c528f627-1ea0-45b7-892c-a8e34360bcc5\") " pod="openshift-multus/multus-m9m5n"
Jul 05 13:15:22.428760 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.427567    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5283d97-9f47-4927-ad3f-f9f1596c1d55-tmp\") pod \"tuned-w88w4\" (UID: \"e5283d97-9f47-4927-ad3f-f9f1596c1d55\") " pod="openshift-cluster-node-tuning-operator/tuned-w88w4"
Jul 05 13:15:22.428760 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.427567    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e5283d97-9f47-4927-ad3f-f9f1596c1d55-host\") pod \"tuned-w88w4\" (UID: \"e5283d97-9f47-4927-ad3f-f9f1596c1d55\") " pod="openshift-cluster-node-tuning-operator/tuned-w88w4"
Jul 05 13:15:22.428760 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.427609    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c528f627-1ea0-45b7-892c-a8e34360bcc5-multus-conf-dir\") pod \"multus-m9m5n\" (UID: \"c528f627-1ea0-45b7-892c-a8e34360bcc5\") " pod="openshift-multus/multus-m9m5n"
Jul 05 13:15:22.428760 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.427638    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c528f627-1ea0-45b7-892c-a8e34360bcc5-host-run-multus-certs\") pod \"multus-m9m5n\" (UID: \"c528f627-1ea0-45b7-892c-a8e34360bcc5\") " pod="openshift-multus/multus-m9m5n"
Jul 05 13:15:22.428760 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.427663    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e5283d97-9f47-4927-ad3f-f9f1596c1d55-etc-tuned\") pod \"tuned-w88w4\" (UID: \"e5283d97-9f47-4927-ad3f-f9f1596c1d55\") " pod="openshift-cluster-node-tuning-operator/tuned-w88w4"
Jul 05 13:15:22.428760 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.427670    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e5283d97-9f47-4927-ad3f-f9f1596c1d55-etc-sysctl-d\") pod \"tuned-w88w4\" (UID: \"e5283d97-9f47-4927-ad3f-f9f1596c1d55\") " pod="openshift-cluster-node-tuning-operator/tuned-w88w4"
Jul 05 13:15:22.428760 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.427678    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e5283d97-9f47-4927-ad3f-f9f1596c1d55-lib-modules\") pod \"tuned-w88w4\" (UID: \"e5283d97-9f47-4927-ad3f-f9f1596c1d55\") " pod="openshift-cluster-node-tuning-operator/tuned-w88w4"
Jul 05 13:15:22.428760 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.427688    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jpn5\" (UniqueName: \"kubernetes.io/projected/7f4539d3-5413-4b71-9c09-a9503e62c68a-kube-api-access-2jpn5\") pod \"network-metrics-daemon-49n5p\" (UID: \"7f4539d3-5413-4b71-9c09-a9503e62c68a\") " pod="openshift-multus/network-metrics-daemon-49n5p"
Jul 05 13:15:22.428760 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.427695    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c528f627-1ea0-45b7-892c-a8e34360bcc5-multus-conf-dir\") pod \"multus-m9m5n\" (UID: \"c528f627-1ea0-45b7-892c-a8e34360bcc5\") " pod="openshift-multus/multus-m9m5n"
Jul 05 13:15:22.428760 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.427711    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c528f627-1ea0-45b7-892c-a8e34360bcc5-host-run-netns\") pod \"multus-m9m5n\" (UID: \"c528f627-1ea0-45b7-892c-a8e34360bcc5\") " pod="openshift-multus/multus-m9m5n"
Jul 05 13:15:22.428760 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.427719    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c528f627-1ea0-45b7-892c-a8e34360bcc5-host-run-multus-certs\") pod \"multus-m9m5n\" (UID: \"c528f627-1ea0-45b7-892c-a8e34360bcc5\") " pod="openshift-multus/multus-m9m5n"
Jul 05 13:15:22.428760 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.427748    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c528f627-1ea0-45b7-892c-a8e34360bcc5-host-var-lib-cni-bin\") pod \"multus-m9m5n\" (UID: \"c528f627-1ea0-45b7-892c-a8e34360bcc5\") " pod="openshift-multus/multus-m9m5n"
Jul 05 13:15:22.428760 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.427759    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c528f627-1ea0-45b7-892c-a8e34360bcc5-host-run-netns\") pod \"multus-m9m5n\" (UID: \"c528f627-1ea0-45b7-892c-a8e34360bcc5\") " pod="openshift-multus/multus-m9m5n"
Jul 05 13:15:22.429568 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.427759    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c528f627-1ea0-45b7-892c-a8e34360bcc5-cni-binary-copy\") pod \"multus-m9m5n\" (UID: \"c528f627-1ea0-45b7-892c-a8e34360bcc5\") " pod="openshift-multus/multus-m9m5n"
Jul 05 13:15:22.429568 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.427778    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/93717f79-abca-4163-80a4-061dabcc4d51-original-pull-secret\") pod \"global-pull-secret-syncer-nll82\" (UID: \"93717f79-abca-4163-80a4-061dabcc4d51\") " pod="kube-system/global-pull-secret-syncer-nll82"
Jul 05 13:15:22.429568 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.427806    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkxqm\" (UniqueName: \"kubernetes.io/projected/e5283d97-9f47-4927-ad3f-f9f1596c1d55-kube-api-access-tkxqm\") pod \"tuned-w88w4\" (UID: \"e5283d97-9f47-4927-ad3f-f9f1596c1d55\") " pod="openshift-cluster-node-tuning-operator/tuned-w88w4"
Jul 05 13:15:22.429568 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.427811    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c528f627-1ea0-45b7-892c-a8e34360bcc5-host-var-lib-cni-bin\") pod \"multus-m9m5n\" (UID: \"c528f627-1ea0-45b7-892c-a8e34360bcc5\") " pod="openshift-multus/multus-m9m5n"
Jul 05 13:15:22.429568 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.427830    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b7e0654-df3e-4f31-9fee-402ee841d4ac-tmp-dir\") pod \"node-resolver-vsz6t\" (UID: \"6b7e0654-df3e-4f31-9fee-402ee841d4ac\") " pod="openshift-dns/node-resolver-vsz6t"
Jul 05 13:15:22.429568 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.427853    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c528f627-1ea0-45b7-892c-a8e34360bcc5-multus-cni-dir\") pod \"multus-m9m5n\" (UID: \"c528f627-1ea0-45b7-892c-a8e34360bcc5\") " pod="openshift-multus/multus-m9m5n"
Jul 05 13:15:22.429568 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.427874    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3d69842e-9902-40bc-a7f6-0a018acc73db-host\") pod \"node-ca-s9x2h\" (UID: \"3d69842e-9902-40bc-a7f6-0a018acc73db\") " pod="openshift-image-registry/node-ca-s9x2h"
Jul 05 13:15:22.429568 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:22.427898    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 05 13:15:22.429568 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:22.427968    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93717f79-abca-4163-80a4-061dabcc4d51-original-pull-secret podName:93717f79-abca-4163-80a4-061dabcc4d51 nodeName:}" failed. No retries permitted until 2026-07-05 13:15:22.927947664 +0000 UTC m=+3.021833282 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/93717f79-abca-4163-80a4-061dabcc4d51-original-pull-secret") pod "global-pull-secret-syncer-nll82" (UID: "93717f79-abca-4163-80a4-061dabcc4d51") : object "kube-system"/"original-pull-secret" not registered
Jul 05 13:15:22.429568 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.427986    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e5283d97-9f47-4927-ad3f-f9f1596c1d55-etc-modprobe-d\") pod \"tuned-w88w4\" (UID: \"e5283d97-9f47-4927-ad3f-f9f1596c1d55\") " pod="openshift-cluster-node-tuning-operator/tuned-w88w4"
Jul 05 13:15:22.429568 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.428138    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c528f627-1ea0-45b7-892c-a8e34360bcc5-multus-cni-dir\") pod \"multus-m9m5n\" (UID: \"c528f627-1ea0-45b7-892c-a8e34360bcc5\") " pod="openshift-multus/multus-m9m5n"
Jul 05 13:15:22.429568 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.427902    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e5283d97-9f47-4927-ad3f-f9f1596c1d55-etc-modprobe-d\") pod \"tuned-w88w4\" (UID: \"e5283d97-9f47-4927-ad3f-f9f1596c1d55\") " pod="openshift-cluster-node-tuning-operator/tuned-w88w4"
Jul 05 13:15:22.429568 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.428176    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e5283d97-9f47-4927-ad3f-f9f1596c1d55-sys\") pod \"tuned-w88w4\" (UID: \"e5283d97-9f47-4927-ad3f-f9f1596c1d55\") " pod="openshift-cluster-node-tuning-operator/tuned-w88w4"
Jul 05 13:15:22.429568 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.428186    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3d69842e-9902-40bc-a7f6-0a018acc73db-host\") pod \"node-ca-s9x2h\" (UID: \"3d69842e-9902-40bc-a7f6-0a018acc73db\") " pod="openshift-image-registry/node-ca-s9x2h"
Jul 05 13:15:22.429568 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.428194    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c528f627-1ea0-45b7-892c-a8e34360bcc5-multus-daemon-config\") pod \"multus-m9m5n\" (UID: \"c528f627-1ea0-45b7-892c-a8e34360bcc5\") " pod="openshift-multus/multus-m9m5n"
Jul 05 13:15:22.429568 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.428197    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c528f627-1ea0-45b7-892c-a8e34360bcc5-system-cni-dir\") pod \"multus-m9m5n\" (UID: \"c528f627-1ea0-45b7-892c-a8e34360bcc5\") " pod="openshift-multus/multus-m9m5n"
Jul 05 13:15:22.430343 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.428256    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e5283d97-9f47-4927-ad3f-f9f1596c1d55-run\") pod \"tuned-w88w4\" (UID: \"e5283d97-9f47-4927-ad3f-f9f1596c1d55\") " pod="openshift-cluster-node-tuning-operator/tuned-w88w4"
Jul 05 13:15:22.430343 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.428267    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e5283d97-9f47-4927-ad3f-f9f1596c1d55-sys\") pod \"tuned-w88w4\" (UID: \"e5283d97-9f47-4927-ad3f-f9f1596c1d55\") " pod="openshift-cluster-node-tuning-operator/tuned-w88w4"
Jul 05 13:15:22.430343 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.428281    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f4539d3-5413-4b71-9c09-a9503e62c68a-metrics-certs\") pod \"network-metrics-daemon-49n5p\" (UID: \"7f4539d3-5413-4b71-9c09-a9503e62c68a\") " pod="openshift-multus/network-metrics-daemon-49n5p"
Jul 05 13:15:22.430343 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.428307    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c528f627-1ea0-45b7-892c-a8e34360bcc5-system-cni-dir\") pod \"multus-m9m5n\" (UID: \"c528f627-1ea0-45b7-892c-a8e34360bcc5\") " pod="openshift-multus/multus-m9m5n"
Jul 05 13:15:22.430343 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.428307    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brlxb\" (UniqueName: \"kubernetes.io/projected/7a0f5157-6c15-4ec3-82b3-1c5dccb6e314-kube-api-access-brlxb\") pod \"aws-ebs-csi-driver-node-xgz9n\" (UID: \"7a0f5157-6c15-4ec3-82b3-1c5dccb6e314\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgz9n"
Jul 05 13:15:22.430343 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.428382    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c528f627-1ea0-45b7-892c-a8e34360bcc5-etc-kubernetes\") pod \"multus-m9m5n\" (UID: \"c528f627-1ea0-45b7-892c-a8e34360bcc5\") " pod="openshift-multus/multus-m9m5n"
Jul 05 13:15:22.430343 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.428389    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c528f627-1ea0-45b7-892c-a8e34360bcc5-etc-kubernetes\") pod \"multus-m9m5n\" (UID: \"c528f627-1ea0-45b7-892c-a8e34360bcc5\") " pod="openshift-multus/multus-m9m5n"
Jul 05 13:15:22.430343 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.428196    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b7e0654-df3e-4f31-9fee-402ee841d4ac-tmp-dir\") pod \"node-resolver-vsz6t\" (UID: \"6b7e0654-df3e-4f31-9fee-402ee841d4ac\") " pod="openshift-dns/node-resolver-vsz6t"
Jul 05 13:15:22.430343 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.428412    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e5283d97-9f47-4927-ad3f-f9f1596c1d55-etc-sysconfig\") pod \"tuned-w88w4\" (UID: \"e5283d97-9f47-4927-ad3f-f9f1596c1d55\") " pod="openshift-cluster-node-tuning-operator/tuned-w88w4"
Jul 05 13:15:22.430343 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.428437    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e5283d97-9f47-4927-ad3f-f9f1596c1d55-etc-sysctl-conf\") pod \"tuned-w88w4\" (UID: \"e5283d97-9f47-4927-ad3f-f9f1596c1d55\") " pod="openshift-cluster-node-tuning-operator/tuned-w88w4"
Jul 05 13:15:22.430343 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.428462    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljpvv\" (UniqueName: \"kubernetes.io/projected/6b7e0654-df3e-4f31-9fee-402ee841d4ac-kube-api-access-ljpvv\") pod \"node-resolver-vsz6t\" (UID: \"6b7e0654-df3e-4f31-9fee-402ee841d4ac\") " pod="openshift-dns/node-resolver-vsz6t"
Jul 05 13:15:22.430343 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:22.428472    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 05 13:15:22.430343 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.428488    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66gmk\" (UniqueName: \"kubernetes.io/projected/c528f627-1ea0-45b7-892c-a8e34360bcc5-kube-api-access-66gmk\") pod \"multus-m9m5n\" (UID: \"c528f627-1ea0-45b7-892c-a8e34360bcc5\") " pod="openshift-multus/multus-m9m5n"
Jul 05 13:15:22.430343 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.428471    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e5283d97-9f47-4927-ad3f-f9f1596c1d55-run\") pod \"tuned-w88w4\" (UID: \"e5283d97-9f47-4927-ad3f-f9f1596c1d55\") " pod="openshift-cluster-node-tuning-operator/tuned-w88w4"
Jul 05 13:15:22.430343 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:22.428517    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f4539d3-5413-4b71-9c09-a9503e62c68a-metrics-certs podName:7f4539d3-5413-4b71-9c09-a9503e62c68a nodeName:}" failed. No retries permitted until 2026-07-05 13:15:22.928502109 +0000 UTC m=+3.022387740 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7f4539d3-5413-4b71-9c09-a9503e62c68a-metrics-certs") pod "network-metrics-daemon-49n5p" (UID: "7f4539d3-5413-4b71-9c09-a9503e62c68a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 05 13:15:22.430343 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.428509    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e5283d97-9f47-4927-ad3f-f9f1596c1d55-etc-sysconfig\") pod \"tuned-w88w4\" (UID: \"e5283d97-9f47-4927-ad3f-f9f1596c1d55\") " pod="openshift-cluster-node-tuning-operator/tuned-w88w4"
Jul 05 13:15:22.430999 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.428533    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3d69842e-9902-40bc-a7f6-0a018acc73db-serviceca\") pod \"node-ca-s9x2h\" (UID: \"3d69842e-9902-40bc-a7f6-0a018acc73db\") " pod="openshift-image-registry/node-ca-s9x2h"
Jul 05 13:15:22.430999 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.428559    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/93717f79-abca-4163-80a4-061dabcc4d51-dbus\") pod \"global-pull-secret-syncer-nll82\" (UID: \"93717f79-abca-4163-80a4-061dabcc4d51\") " pod="kube-system/global-pull-secret-syncer-nll82"
Jul 05 13:15:22.430999 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.428594    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e5283d97-9f47-4927-ad3f-f9f1596c1d55-etc-kubernetes\") pod \"tuned-w88w4\" (UID: \"e5283d97-9f47-4927-ad3f-f9f1596c1d55\") " pod="openshift-cluster-node-tuning-operator/tuned-w88w4"
Jul 05 13:15:22.430999 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.428617    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c528f627-1ea0-45b7-892c-a8e34360bcc5-hostroot\") pod \"multus-m9m5n\" (UID: \"c528f627-1ea0-45b7-892c-a8e34360bcc5\") " pod="openshift-multus/multus-m9m5n"
Jul 05 13:15:22.430999 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.428626    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e5283d97-9f47-4927-ad3f-f9f1596c1d55-etc-sysctl-conf\") pod \"tuned-w88w4\" (UID: \"e5283d97-9f47-4927-ad3f-f9f1596c1d55\") " pod="openshift-cluster-node-tuning-operator/tuned-w88w4"
Jul 05 13:15:22.430999 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.428699    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/93717f79-abca-4163-80a4-061dabcc4d51-dbus\") pod \"global-pull-secret-syncer-nll82\" (UID: \"93717f79-abca-4163-80a4-061dabcc4d51\") " pod="kube-system/global-pull-secret-syncer-nll82"
Jul 05 13:15:22.430999 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.428701    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e5283d97-9f47-4927-ad3f-f9f1596c1d55-etc-kubernetes\") pod \"tuned-w88w4\" (UID: \"e5283d97-9f47-4927-ad3f-f9f1596c1d55\") " pod="openshift-cluster-node-tuning-operator/tuned-w88w4"
Jul 05 13:15:22.430999 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.428767    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c528f627-1ea0-45b7-892c-a8e34360bcc5-hostroot\") pod \"multus-m9m5n\" (UID: \"c528f627-1ea0-45b7-892c-a8e34360bcc5\") " pod="openshift-multus/multus-m9m5n"
Jul 05 13:15:22.430999 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.429048    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3d69842e-9902-40bc-a7f6-0a018acc73db-serviceca\") pod \"node-ca-s9x2h\" (UID: \"3d69842e-9902-40bc-a7f6-0a018acc73db\") " pod="openshift-image-registry/node-ca-s9x2h"
Jul 05 13:15:22.430999 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.430391    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e5283d97-9f47-4927-ad3f-f9f1596c1d55-etc-tuned\") pod \"tuned-w88w4\" (UID: \"e5283d97-9f47-4927-ad3f-f9f1596c1d55\") " pod="openshift-cluster-node-tuning-operator/tuned-w88w4"
Jul 05 13:15:22.430999 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.430645    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5283d97-9f47-4927-ad3f-f9f1596c1d55-tmp\") pod \"tuned-w88w4\" (UID: \"e5283d97-9f47-4927-ad3f-f9f1596c1d55\") " pod="openshift-cluster-node-tuning-operator/tuned-w88w4"
Jul 05 13:15:22.434348 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:22.434325    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 05 13:15:22.434348 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:22.434349    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 05 13:15:22.434530 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:22.434362    2563 projected.go:196] Error preparing data for projected volume kube-api-access-cfdtd for pod openshift-network-diagnostics/network-check-target-2bmk6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 05 13:15:22.434530 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:22.434427    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/516bf532-d39c-49a3-a2ba-b2e7af7c66ae-kube-api-access-cfdtd podName:516bf532-d39c-49a3-a2ba-b2e7af7c66ae nodeName:}" failed. No retries permitted until 2026-07-05 13:15:22.934409544 +0000 UTC m=+3.028295162 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-cfdtd" (UniqueName: "kubernetes.io/projected/516bf532-d39c-49a3-a2ba-b2e7af7c66ae-kube-api-access-cfdtd") pod "network-check-target-2bmk6" (UID: "516bf532-d39c-49a3-a2ba-b2e7af7c66ae") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 05 13:15:22.436490 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.436435    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlhr2\" (UniqueName: \"kubernetes.io/projected/3d69842e-9902-40bc-a7f6-0a018acc73db-kube-api-access-zlhr2\") pod \"node-ca-s9x2h\" (UID: \"3d69842e-9902-40bc-a7f6-0a018acc73db\") " pod="openshift-image-registry/node-ca-s9x2h"
Jul 05 13:15:22.437443 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.437419    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljpvv\" (UniqueName: \"kubernetes.io/projected/6b7e0654-df3e-4f31-9fee-402ee841d4ac-kube-api-access-ljpvv\") pod \"node-resolver-vsz6t\" (UID: \"6b7e0654-df3e-4f31-9fee-402ee841d4ac\") " pod="openshift-dns/node-resolver-vsz6t"
Jul 05 13:15:22.437705 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.437656    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jpn5\" (UniqueName: \"kubernetes.io/projected/7f4539d3-5413-4b71-9c09-a9503e62c68a-kube-api-access-2jpn5\") pod \"network-metrics-daemon-49n5p\" (UID: \"7f4539d3-5413-4b71-9c09-a9503e62c68a\") " pod="openshift-multus/network-metrics-daemon-49n5p"
Jul 05 13:15:22.438117 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.438089    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkxqm\" (UniqueName: \"kubernetes.io/projected/e5283d97-9f47-4927-ad3f-f9f1596c1d55-kube-api-access-tkxqm\") pod \"tuned-w88w4\" (UID: \"e5283d97-9f47-4927-ad3f-f9f1596c1d55\") " pod="openshift-cluster-node-tuning-operator/tuned-w88w4"
Jul 05 13:15:22.438305 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.438285    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-66gmk\" (UniqueName: \"kubernetes.io/projected/c528f627-1ea0-45b7-892c-a8e34360bcc5-kube-api-access-66gmk\") pod \"multus-m9m5n\" (UID: \"c528f627-1ea0-45b7-892c-a8e34360bcc5\") " pod="openshift-multus/multus-m9m5n"
Jul 05 13:15:22.438694 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.438677    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-brlxb\" (UniqueName: \"kubernetes.io/projected/7a0f5157-6c15-4ec3-82b3-1c5dccb6e314-kube-api-access-brlxb\") pod \"aws-ebs-csi-driver-node-xgz9n\" (UID: \"7a0f5157-6c15-4ec3-82b3-1c5dccb6e314\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgz9n"
Jul 05 13:15:22.522964 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.522927    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xvkqz"
Jul 05 13:15:22.524999 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.524979    2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 05 13:15:22.530942 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.530918    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ht6xk"
Jul 05 13:15:22.542892 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.542862    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-t6kt6"
Jul 05 13:15:22.550102 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.550082    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jrlbp"
Jul 05 13:15:22.557072 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.557039    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-w88w4"
Jul 05 13:15:22.564167 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.564146    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vsz6t"
Jul 05 13:15:22.571045 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.571023    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgz9n"
Jul 05 13:15:22.577883 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.577865    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-m9m5n"
Jul 05 13:15:22.582671 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.582653    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-s9x2h"
Jul 05 13:15:22.932028 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.931932    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/93717f79-abca-4163-80a4-061dabcc4d51-original-pull-secret\") pod \"global-pull-secret-syncer-nll82\" (UID: \"93717f79-abca-4163-80a4-061dabcc4d51\") " pod="kube-system/global-pull-secret-syncer-nll82"
Jul 05 13:15:22.932028 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:22.931975    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f4539d3-5413-4b71-9c09-a9503e62c68a-metrics-certs\") pod \"network-metrics-daemon-49n5p\" (UID: \"7f4539d3-5413-4b71-9c09-a9503e62c68a\") " pod="openshift-multus/network-metrics-daemon-49n5p"
Jul 05 13:15:22.932288 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:22.932111    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 05 13:15:22.932288 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:22.932178    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93717f79-abca-4163-80a4-061dabcc4d51-original-pull-secret podName:93717f79-abca-4163-80a4-061dabcc4d51 nodeName:}" failed. No retries permitted until 2026-07-05 13:15:23.932164921 +0000 UTC m=+4.026050529 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/93717f79-abca-4163-80a4-061dabcc4d51-original-pull-secret") pod "global-pull-secret-syncer-nll82" (UID: "93717f79-abca-4163-80a4-061dabcc4d51") : object "kube-system"/"original-pull-secret" not registered
Jul 05 13:15:22.932288 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:22.932111    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 05 13:15:22.932288 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:22.932270    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f4539d3-5413-4b71-9c09-a9503e62c68a-metrics-certs podName:7f4539d3-5413-4b71-9c09-a9503e62c68a nodeName:}" failed. No retries permitted until 2026-07-05 13:15:23.932252712 +0000 UTC m=+4.026138321 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7f4539d3-5413-4b71-9c09-a9503e62c68a-metrics-certs") pod "network-metrics-daemon-49n5p" (UID: "7f4539d3-5413-4b71-9c09-a9503e62c68a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 05 13:15:23.033230 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:23.033180    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfdtd\" (UniqueName: \"kubernetes.io/projected/516bf532-d39c-49a3-a2ba-b2e7af7c66ae-kube-api-access-cfdtd\") pod \"network-check-target-2bmk6\" (UID: \"516bf532-d39c-49a3-a2ba-b2e7af7c66ae\") " pod="openshift-network-diagnostics/network-check-target-2bmk6"
Jul 05 13:15:23.033419 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:23.033359    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 05 13:15:23.033419 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:23.033379    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 05 13:15:23.033419 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:23.033389    2563 projected.go:196] Error preparing data for projected volume kube-api-access-cfdtd for pod openshift-network-diagnostics/network-check-target-2bmk6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 05 13:15:23.033578 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:23.033452    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/516bf532-d39c-49a3-a2ba-b2e7af7c66ae-kube-api-access-cfdtd podName:516bf532-d39c-49a3-a2ba-b2e7af7c66ae nodeName:}" failed. No retries permitted until 2026-07-05 13:15:24.033432053 +0000 UTC m=+4.127317663 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-cfdtd" (UniqueName: "kubernetes.io/projected/516bf532-d39c-49a3-a2ba-b2e7af7c66ae-kube-api-access-cfdtd") pod "network-check-target-2bmk6" (UID: "516bf532-d39c-49a3-a2ba-b2e7af7c66ae") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 05 13:15:23.186781 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:23.186751    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5283d97_9f47_4927_ad3f_f9f1596c1d55.slice/crio-afd731ee806ddbb699b57999c2a2c33f763cabbb2938c539f5c8eb4de1b0bd26 WatchSource:0}: Error finding container afd731ee806ddbb699b57999c2a2c33f763cabbb2938c539f5c8eb4de1b0bd26: Status 404 returned error can't find the container with id afd731ee806ddbb699b57999c2a2c33f763cabbb2938c539f5c8eb4de1b0bd26
Jul 05 13:15:23.192165 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:23.192139    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc528f627_1ea0_45b7_892c_a8e34360bcc5.slice/crio-7464f37b0ce32ec5ec5f3f7832ec3af4d334da148dad80ba8581b10ac6d2355c WatchSource:0}: Error finding container 7464f37b0ce32ec5ec5f3f7832ec3af4d334da148dad80ba8581b10ac6d2355c: Status 404 returned error can't find the container with id 7464f37b0ce32ec5ec5f3f7832ec3af4d334da148dad80ba8581b10ac6d2355c
Jul 05 13:15:23.193336 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:23.193300    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50c8a3c5_bf60_4554_bcf9_0b020c1f82ae.slice/crio-9517cd010e210003d2ca06aee78e3db34a885bd2d27e9caea6ee39a9c6e58daf WatchSource:0}: Error finding container 9517cd010e210003d2ca06aee78e3db34a885bd2d27e9caea6ee39a9c6e58daf: Status 404 returned error can't find the container with id 9517cd010e210003d2ca06aee78e3db34a885bd2d27e9caea6ee39a9c6e58daf
Jul 05 13:15:23.194381 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:23.194343    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9810b314_df2c_4247_a5ae_43aea8036357.slice/crio-ef054d773116a52e6ae398c11998c8c4f9b1fa4e7352c4028e84f3441534f1c2 WatchSource:0}: Error finding container ef054d773116a52e6ae398c11998c8c4f9b1fa4e7352c4028e84f3441534f1c2: Status 404 returned error can't find the container with id ef054d773116a52e6ae398c11998c8c4f9b1fa4e7352c4028e84f3441534f1c2
Jul 05 13:15:23.195043 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:23.194829    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a0f5157_6c15_4ec3_82b3_1c5dccb6e314.slice/crio-7cb37b2c1109011ab4a9a20bd36cf29bc784cf8334434f7e9275b97955e17b3c WatchSource:0}: Error finding container 7cb37b2c1109011ab4a9a20bd36cf29bc784cf8334434f7e9275b97955e17b3c: Status 404 returned error can't find the container with id 7cb37b2c1109011ab4a9a20bd36cf29bc784cf8334434f7e9275b97955e17b3c
Jul 05 13:15:23.196040 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:23.195869    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d69842e_9902_40bc_a7f6_0a018acc73db.slice/crio-27dd629f938ca7bb11f01d843dbc58021f2e7a25de941c92648fff9266802bcf WatchSource:0}: Error finding container 27dd629f938ca7bb11f01d843dbc58021f2e7a25de941c92648fff9266802bcf: Status 404 returned error can't find the container with id 27dd629f938ca7bb11f01d843dbc58021f2e7a25de941c92648fff9266802bcf
Jul 05 13:15:23.198016 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:23.197952    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b7e0654_df3e_4f31_9fee_402ee841d4ac.slice/crio-9093b982fc51a54acfd41a1cf9390f0c4cf1d3f52fb630fa422f96a900f3eb6e WatchSource:0}: Error finding container 9093b982fc51a54acfd41a1cf9390f0c4cf1d3f52fb630fa422f96a900f3eb6e: Status 404 returned error can't find the container with id 9093b982fc51a54acfd41a1cf9390f0c4cf1d3f52fb630fa422f96a900f3eb6e
Jul 05 13:15:23.198654 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:23.198239    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78bd57a9_2c64_42b7_8d22_c920eb84afdd.slice/crio-f986e6bdb314a6e9a54057d8cee7910e2b7535730b78326e529888a9b77a2b03 WatchSource:0}: Error finding container f986e6bdb314a6e9a54057d8cee7910e2b7535730b78326e529888a9b77a2b03: Status 404 returned error can't find the container with id f986e6bdb314a6e9a54057d8cee7910e2b7535730b78326e529888a9b77a2b03
Jul 05 13:15:23.289551 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:23.289344    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-04 13:10:22 +0000 UTC" deadline="2028-03-11 19:11:34.078806762 +0000 UTC"
Jul 05 13:15:23.289551 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:23.289547    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14765h56m10.789263612s"
Jul 05 13:15:23.342808 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:23.342778    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nll82"
Jul 05 13:15:23.342986 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:23.342903    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nll82" podUID="93717f79-abca-4163-80a4-061dabcc4d51"
Jul 05 13:15:23.353830 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:23.353796    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-w88w4" event={"ID":"e5283d97-9f47-4927-ad3f-f9f1596c1d55","Type":"ContainerStarted","Data":"afd731ee806ddbb699b57999c2a2c33f763cabbb2938c539f5c8eb4de1b0bd26"}
Jul 05 13:15:23.357323 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:23.357291    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-239.ec2.internal" event={"ID":"accb531ad4f6f6ba026b8fe327ce0ae5","Type":"ContainerStarted","Data":"71cddd513f46f9eafd283ca4f81df0b6efb7ea0b2f109a23b105a332bc38cb98"}
Jul 05 13:15:23.359394 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:23.359360    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vsz6t" event={"ID":"6b7e0654-df3e-4f31-9fee-402ee841d4ac","Type":"ContainerStarted","Data":"9093b982fc51a54acfd41a1cf9390f0c4cf1d3f52fb630fa422f96a900f3eb6e"}
Jul 05 13:15:23.360493 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:23.360461    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xvkqz" event={"ID":"50c8a3c5-bf60-4554-bcf9-0b020c1f82ae","Type":"ContainerStarted","Data":"9517cd010e210003d2ca06aee78e3db34a885bd2d27e9caea6ee39a9c6e58daf"}
Jul 05 13:15:23.361578 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:23.361557    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ht6xk" event={"ID":"9810b314-df2c-4247-a5ae-43aea8036357","Type":"ContainerStarted","Data":"ef054d773116a52e6ae398c11998c8c4f9b1fa4e7352c4028e84f3441534f1c2"}
Jul 05 13:15:23.362673 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:23.362646    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgz9n" event={"ID":"7a0f5157-6c15-4ec3-82b3-1c5dccb6e314","Type":"ContainerStarted","Data":"7cb37b2c1109011ab4a9a20bd36cf29bc784cf8334434f7e9275b97955e17b3c"}
Jul 05 13:15:23.363653 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:23.363634    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-m9m5n" event={"ID":"c528f627-1ea0-45b7-892c-a8e34360bcc5","Type":"ContainerStarted","Data":"7464f37b0ce32ec5ec5f3f7832ec3af4d334da148dad80ba8581b10ac6d2355c"}
Jul 05 13:15:23.364675 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:23.364652    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jrlbp" event={"ID":"e17e56ea-7aa6-4a13-a11c-399e00d91800","Type":"ContainerStarted","Data":"95e10105f230c1aac1de3a2eb9aea0034a490bf0d682a4ff7f5da215682565f5"}
Jul 05 13:15:23.365722 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:23.365697    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-t6kt6" event={"ID":"78bd57a9-2c64-42b7-8d22-c920eb84afdd","Type":"ContainerStarted","Data":"f986e6bdb314a6e9a54057d8cee7910e2b7535730b78326e529888a9b77a2b03"}
Jul 05 13:15:23.366798 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:23.366779    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-s9x2h" event={"ID":"3d69842e-9902-40bc-a7f6-0a018acc73db","Type":"ContainerStarted","Data":"27dd629f938ca7bb11f01d843dbc58021f2e7a25de941c92648fff9266802bcf"}
Jul 05 13:15:23.940547 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:23.940508    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/93717f79-abca-4163-80a4-061dabcc4d51-original-pull-secret\") pod \"global-pull-secret-syncer-nll82\" (UID: \"93717f79-abca-4163-80a4-061dabcc4d51\") " pod="kube-system/global-pull-secret-syncer-nll82"
Jul 05 13:15:23.940739 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:23.940573    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f4539d3-5413-4b71-9c09-a9503e62c68a-metrics-certs\") pod \"network-metrics-daemon-49n5p\" (UID: \"7f4539d3-5413-4b71-9c09-a9503e62c68a\") " pod="openshift-multus/network-metrics-daemon-49n5p"
Jul 05 13:15:23.940739 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:23.940723    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 05 13:15:23.940856 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:23.940787    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f4539d3-5413-4b71-9c09-a9503e62c68a-metrics-certs podName:7f4539d3-5413-4b71-9c09-a9503e62c68a nodeName:}" failed. No retries permitted until 2026-07-05 13:15:25.940768818 +0000 UTC m=+6.034654427 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7f4539d3-5413-4b71-9c09-a9503e62c68a-metrics-certs") pod "network-metrics-daemon-49n5p" (UID: "7f4539d3-5413-4b71-9c09-a9503e62c68a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 05 13:15:23.941203 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:23.941180    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 05 13:15:23.941325 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:23.941258    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93717f79-abca-4163-80a4-061dabcc4d51-original-pull-secret podName:93717f79-abca-4163-80a4-061dabcc4d51 nodeName:}" failed. No retries permitted until 2026-07-05 13:15:25.941241244 +0000 UTC m=+6.035126860 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/93717f79-abca-4163-80a4-061dabcc4d51-original-pull-secret") pod "global-pull-secret-syncer-nll82" (UID: "93717f79-abca-4163-80a4-061dabcc4d51") : object "kube-system"/"original-pull-secret" not registered
Jul 05 13:15:24.041127 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:24.041084    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfdtd\" (UniqueName: \"kubernetes.io/projected/516bf532-d39c-49a3-a2ba-b2e7af7c66ae-kube-api-access-cfdtd\") pod \"network-check-target-2bmk6\" (UID: \"516bf532-d39c-49a3-a2ba-b2e7af7c66ae\") " pod="openshift-network-diagnostics/network-check-target-2bmk6"
Jul 05 13:15:24.041339 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:24.041287    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 05 13:15:24.041339 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:24.041309    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 05 13:15:24.041339 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:24.041321    2563 projected.go:196] Error preparing data for projected volume kube-api-access-cfdtd for pod openshift-network-diagnostics/network-check-target-2bmk6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 05 13:15:24.041504 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:24.041384    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/516bf532-d39c-49a3-a2ba-b2e7af7c66ae-kube-api-access-cfdtd podName:516bf532-d39c-49a3-a2ba-b2e7af7c66ae nodeName:}" failed. No retries permitted until 2026-07-05 13:15:26.041364285 +0000 UTC m=+6.135249907 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-cfdtd" (UniqueName: "kubernetes.io/projected/516bf532-d39c-49a3-a2ba-b2e7af7c66ae-kube-api-access-cfdtd") pod "network-check-target-2bmk6" (UID: "516bf532-d39c-49a3-a2ba-b2e7af7c66ae") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 05 13:15:24.290718 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:24.290627    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-04 13:10:22 +0000 UTC" deadline="2028-02-06 20:39:19.832843924 +0000 UTC"
Jul 05 13:15:24.290718 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:24.290670    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13951h23m55.542180814s"
Jul 05 13:15:24.345846 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:24.345618    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2bmk6"
Jul 05 13:15:24.345846 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:24.345746    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2bmk6" podUID="516bf532-d39c-49a3-a2ba-b2e7af7c66ae"
Jul 05 13:15:24.346176 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:24.346156    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-49n5p"
Jul 05 13:15:24.346308 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:24.346282    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-49n5p" podUID="7f4539d3-5413-4b71-9c09-a9503e62c68a"
Jul 05 13:15:24.399322 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:24.399280    2563 generic.go:356] "Generic (PLEG): container finished" podID="18b0ee83163856176658dd62eef90454" containerID="e9aeb7fa6637df599373fa447e2a534461819cf4932161a228ff919bca8666c8" exitCode=0
Jul 05 13:15:24.399886 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:24.399864    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-239.ec2.internal" event={"ID":"18b0ee83163856176658dd62eef90454","Type":"ContainerDied","Data":"e9aeb7fa6637df599373fa447e2a534461819cf4932161a228ff919bca8666c8"}
Jul 05 13:15:24.419523 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:24.419468    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-239.ec2.internal" podStartSLOduration=3.419445626 podStartE2EDuration="3.419445626s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 13:15:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:15:23.37215922 +0000 UTC m=+3.466044880" watchObservedRunningTime="2026-07-05 13:15:24.419445626 +0000 UTC m=+4.513331252"
Jul 05 13:15:25.343105 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:25.343075    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nll82"
Jul 05 13:15:25.343613 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:25.343201    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nll82" podUID="93717f79-abca-4163-80a4-061dabcc4d51"
Jul 05 13:15:25.419458 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:25.419379    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-239.ec2.internal" event={"ID":"18b0ee83163856176658dd62eef90454","Type":"ContainerStarted","Data":"f182290c05bca1e655480623300cc73de31e243b5aaf0ce4c3e6c2e055471dd4"}
Jul 05 13:15:25.960504 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:25.960470    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/93717f79-abca-4163-80a4-061dabcc4d51-original-pull-secret\") pod \"global-pull-secret-syncer-nll82\" (UID: \"93717f79-abca-4163-80a4-061dabcc4d51\") " pod="kube-system/global-pull-secret-syncer-nll82"
Jul 05 13:15:25.960690 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:25.960526    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f4539d3-5413-4b71-9c09-a9503e62c68a-metrics-certs\") pod \"network-metrics-daemon-49n5p\" (UID: \"7f4539d3-5413-4b71-9c09-a9503e62c68a\") " pod="openshift-multus/network-metrics-daemon-49n5p"
Jul 05 13:15:25.960764 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:25.960707    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 05 13:15:25.960828 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:25.960783    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f4539d3-5413-4b71-9c09-a9503e62c68a-metrics-certs podName:7f4539d3-5413-4b71-9c09-a9503e62c68a nodeName:}" failed. No retries permitted until 2026-07-05 13:15:29.960757774 +0000 UTC m=+10.054643391 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7f4539d3-5413-4b71-9c09-a9503e62c68a-metrics-certs") pod "network-metrics-daemon-49n5p" (UID: "7f4539d3-5413-4b71-9c09-a9503e62c68a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 05 13:15:25.960952 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:25.960933    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 05 13:15:25.961028 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:25.961017    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93717f79-abca-4163-80a4-061dabcc4d51-original-pull-secret podName:93717f79-abca-4163-80a4-061dabcc4d51 nodeName:}" failed. No retries permitted until 2026-07-05 13:15:29.9609898 +0000 UTC m=+10.054875408 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/93717f79-abca-4163-80a4-061dabcc4d51-original-pull-secret") pod "global-pull-secret-syncer-nll82" (UID: "93717f79-abca-4163-80a4-061dabcc4d51") : object "kube-system"/"original-pull-secret" not registered
Jul 05 13:15:26.062146 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:26.061502    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfdtd\" (UniqueName: \"kubernetes.io/projected/516bf532-d39c-49a3-a2ba-b2e7af7c66ae-kube-api-access-cfdtd\") pod \"network-check-target-2bmk6\" (UID: \"516bf532-d39c-49a3-a2ba-b2e7af7c66ae\") " pod="openshift-network-diagnostics/network-check-target-2bmk6"
Jul 05 13:15:26.062146 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:26.061679    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 05 13:15:26.062146 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:26.061701    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 05 13:15:26.062146 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:26.061714    2563 projected.go:196] Error preparing data for projected volume kube-api-access-cfdtd for pod openshift-network-diagnostics/network-check-target-2bmk6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 05 13:15:26.062146 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:26.061782    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/516bf532-d39c-49a3-a2ba-b2e7af7c66ae-kube-api-access-cfdtd podName:516bf532-d39c-49a3-a2ba-b2e7af7c66ae nodeName:}" failed. No retries permitted until 2026-07-05 13:15:30.061763556 +0000 UTC m=+10.155649164 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-cfdtd" (UniqueName: "kubernetes.io/projected/516bf532-d39c-49a3-a2ba-b2e7af7c66ae-kube-api-access-cfdtd") pod "network-check-target-2bmk6" (UID: "516bf532-d39c-49a3-a2ba-b2e7af7c66ae") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 05 13:15:26.343021 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:26.342945    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-49n5p"
Jul 05 13:15:26.343166 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:26.343095    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-49n5p" podUID="7f4539d3-5413-4b71-9c09-a9503e62c68a"
Jul 05 13:15:26.343634 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:26.343566    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2bmk6"
Jul 05 13:15:26.343712 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:26.343664    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2bmk6" podUID="516bf532-d39c-49a3-a2ba-b2e7af7c66ae"
Jul 05 13:15:27.343328 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:27.343293    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nll82"
Jul 05 13:15:27.343723 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:27.343490    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nll82" podUID="93717f79-abca-4163-80a4-061dabcc4d51"
Jul 05 13:15:28.343017 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:28.342984    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-49n5p"
Jul 05 13:15:28.343192 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:28.342996    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2bmk6"
Jul 05 13:15:28.343192 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:28.343127    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-49n5p" podUID="7f4539d3-5413-4b71-9c09-a9503e62c68a"
Jul 05 13:15:28.343360 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:28.343186    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2bmk6" podUID="516bf532-d39c-49a3-a2ba-b2e7af7c66ae"
Jul 05 13:15:29.343052 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:29.343018    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nll82"
Jul 05 13:15:29.343207 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:29.343160    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nll82" podUID="93717f79-abca-4163-80a4-061dabcc4d51"
Jul 05 13:15:29.996776 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:29.996731    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/93717f79-abca-4163-80a4-061dabcc4d51-original-pull-secret\") pod \"global-pull-secret-syncer-nll82\" (UID: \"93717f79-abca-4163-80a4-061dabcc4d51\") " pod="kube-system/global-pull-secret-syncer-nll82"
Jul 05 13:15:29.997273 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:29.996797    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f4539d3-5413-4b71-9c09-a9503e62c68a-metrics-certs\") pod \"network-metrics-daemon-49n5p\" (UID: \"7f4539d3-5413-4b71-9c09-a9503e62c68a\") " pod="openshift-multus/network-metrics-daemon-49n5p"
Jul 05 13:15:29.997273 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:29.996948    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 05 13:15:29.997273 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:29.997014    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f4539d3-5413-4b71-9c09-a9503e62c68a-metrics-certs podName:7f4539d3-5413-4b71-9c09-a9503e62c68a nodeName:}" failed. No retries permitted until 2026-07-05 13:15:37.996994429 +0000 UTC m=+18.090880045 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7f4539d3-5413-4b71-9c09-a9503e62c68a-metrics-certs") pod "network-metrics-daemon-49n5p" (UID: "7f4539d3-5413-4b71-9c09-a9503e62c68a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 05 13:15:29.997458 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:29.997432    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 05 13:15:29.997509 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:29.997490    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93717f79-abca-4163-80a4-061dabcc4d51-original-pull-secret podName:93717f79-abca-4163-80a4-061dabcc4d51 nodeName:}" failed. No retries permitted until 2026-07-05 13:15:37.997474322 +0000 UTC m=+18.091359940 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/93717f79-abca-4163-80a4-061dabcc4d51-original-pull-secret") pod "global-pull-secret-syncer-nll82" (UID: "93717f79-abca-4163-80a4-061dabcc4d51") : object "kube-system"/"original-pull-secret" not registered
Jul 05 13:15:30.098151 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:30.098114    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfdtd\" (UniqueName: \"kubernetes.io/projected/516bf532-d39c-49a3-a2ba-b2e7af7c66ae-kube-api-access-cfdtd\") pod \"network-check-target-2bmk6\" (UID: \"516bf532-d39c-49a3-a2ba-b2e7af7c66ae\") " pod="openshift-network-diagnostics/network-check-target-2bmk6"
Jul 05 13:15:30.098335 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:30.098267    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 05 13:15:30.098335 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:30.098287    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 05 13:15:30.098335 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:30.098299    2563 projected.go:196] Error preparing data for projected volume kube-api-access-cfdtd for pod openshift-network-diagnostics/network-check-target-2bmk6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 05 13:15:30.098511 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:30.098359    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/516bf532-d39c-49a3-a2ba-b2e7af7c66ae-kube-api-access-cfdtd podName:516bf532-d39c-49a3-a2ba-b2e7af7c66ae nodeName:}" failed. No retries permitted until 2026-07-05 13:15:38.098341529 +0000 UTC m=+18.192227134 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-cfdtd" (UniqueName: "kubernetes.io/projected/516bf532-d39c-49a3-a2ba-b2e7af7c66ae-kube-api-access-cfdtd") pod "network-check-target-2bmk6" (UID: "516bf532-d39c-49a3-a2ba-b2e7af7c66ae") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 05 13:15:30.347194 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:30.347115    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2bmk6"
Jul 05 13:15:30.347365 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:30.347296    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2bmk6" podUID="516bf532-d39c-49a3-a2ba-b2e7af7c66ae"
Jul 05 13:15:30.347365 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:30.347319    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-49n5p"
Jul 05 13:15:30.347481 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:30.347464    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-49n5p" podUID="7f4539d3-5413-4b71-9c09-a9503e62c68a"
Jul 05 13:15:31.343366 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:31.343269    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nll82"
Jul 05 13:15:31.343802 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:31.343410    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nll82" podUID="93717f79-abca-4163-80a4-061dabcc4d51"
Jul 05 13:15:32.343769 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:32.343733    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-49n5p"
Jul 05 13:15:32.344326 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:32.343886    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-49n5p" podUID="7f4539d3-5413-4b71-9c09-a9503e62c68a"
Jul 05 13:15:32.344392 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:32.344340    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2bmk6"
Jul 05 13:15:32.344446 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:32.344430    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2bmk6" podUID="516bf532-d39c-49a3-a2ba-b2e7af7c66ae"
Jul 05 13:15:33.343088 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:33.343050    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nll82"
Jul 05 13:15:33.343311 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:33.343164    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nll82" podUID="93717f79-abca-4163-80a4-061dabcc4d51"
Jul 05 13:15:34.343873 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:34.343833    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2bmk6"
Jul 05 13:15:34.344386 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:34.343833    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-49n5p"
Jul 05 13:15:34.344386 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:34.343967    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2bmk6" podUID="516bf532-d39c-49a3-a2ba-b2e7af7c66ae"
Jul 05 13:15:34.344386 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:34.344032    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-49n5p" podUID="7f4539d3-5413-4b71-9c09-a9503e62c68a"
Jul 05 13:15:35.343495 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:35.343463    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nll82"
Jul 05 13:15:35.343693 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:35.343587    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nll82" podUID="93717f79-abca-4163-80a4-061dabcc4d51"
Jul 05 13:15:36.343342 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:36.343303    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-49n5p"
Jul 05 13:15:36.343824 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:36.343432    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-49n5p" podUID="7f4539d3-5413-4b71-9c09-a9503e62c68a"
Jul 05 13:15:36.343824 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:36.343499    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2bmk6"
Jul 05 13:15:36.343824 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:36.343615    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2bmk6" podUID="516bf532-d39c-49a3-a2ba-b2e7af7c66ae"
Jul 05 13:15:37.343419 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:37.343385    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nll82"
Jul 05 13:15:37.343797 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:37.343499    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nll82" podUID="93717f79-abca-4163-80a4-061dabcc4d51"
Jul 05 13:15:38.060237 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:38.060178    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f4539d3-5413-4b71-9c09-a9503e62c68a-metrics-certs\") pod \"network-metrics-daemon-49n5p\" (UID: \"7f4539d3-5413-4b71-9c09-a9503e62c68a\") " pod="openshift-multus/network-metrics-daemon-49n5p"
Jul 05 13:15:38.060428 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:38.060300    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/93717f79-abca-4163-80a4-061dabcc4d51-original-pull-secret\") pod \"global-pull-secret-syncer-nll82\" (UID: \"93717f79-abca-4163-80a4-061dabcc4d51\") " pod="kube-system/global-pull-secret-syncer-nll82"
Jul 05 13:15:38.060428 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:38.060345    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 05 13:15:38.060428 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:38.060412    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 05 13:15:38.060428 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:38.060423    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f4539d3-5413-4b71-9c09-a9503e62c68a-metrics-certs podName:7f4539d3-5413-4b71-9c09-a9503e62c68a nodeName:}" failed. No retries permitted until 2026-07-05 13:15:54.060401741 +0000 UTC m=+34.154287356 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7f4539d3-5413-4b71-9c09-a9503e62c68a-metrics-certs") pod "network-metrics-daemon-49n5p" (UID: "7f4539d3-5413-4b71-9c09-a9503e62c68a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 05 13:15:38.060654 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:38.060459    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93717f79-abca-4163-80a4-061dabcc4d51-original-pull-secret podName:93717f79-abca-4163-80a4-061dabcc4d51 nodeName:}" failed. No retries permitted until 2026-07-05 13:15:54.060446563 +0000 UTC m=+34.154332167 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/93717f79-abca-4163-80a4-061dabcc4d51-original-pull-secret") pod "global-pull-secret-syncer-nll82" (UID: "93717f79-abca-4163-80a4-061dabcc4d51") : object "kube-system"/"original-pull-secret" not registered
Jul 05 13:15:38.160657 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:38.160619    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfdtd\" (UniqueName: \"kubernetes.io/projected/516bf532-d39c-49a3-a2ba-b2e7af7c66ae-kube-api-access-cfdtd\") pod \"network-check-target-2bmk6\" (UID: \"516bf532-d39c-49a3-a2ba-b2e7af7c66ae\") " pod="openshift-network-diagnostics/network-check-target-2bmk6"
Jul 05 13:15:38.160849 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:38.160771    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 05 13:15:38.160849 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:38.160791    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 05 13:15:38.160849 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:38.160804    2563 projected.go:196] Error preparing data for projected volume kube-api-access-cfdtd for pod openshift-network-diagnostics/network-check-target-2bmk6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 05 13:15:38.161009 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:38.160868    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/516bf532-d39c-49a3-a2ba-b2e7af7c66ae-kube-api-access-cfdtd podName:516bf532-d39c-49a3-a2ba-b2e7af7c66ae nodeName:}" failed. No retries permitted until 2026-07-05 13:15:54.160848464 +0000 UTC m=+34.254734073 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-cfdtd" (UniqueName: "kubernetes.io/projected/516bf532-d39c-49a3-a2ba-b2e7af7c66ae-kube-api-access-cfdtd") pod "network-check-target-2bmk6" (UID: "516bf532-d39c-49a3-a2ba-b2e7af7c66ae") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 05 13:15:38.343574 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:38.343486    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-49n5p"
Jul 05 13:15:38.343574 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:38.343488    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2bmk6"
Jul 05 13:15:38.344086 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:38.343644    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-49n5p" podUID="7f4539d3-5413-4b71-9c09-a9503e62c68a"
Jul 05 13:15:38.344086 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:38.343775    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2bmk6" podUID="516bf532-d39c-49a3-a2ba-b2e7af7c66ae"
Jul 05 13:15:39.342969 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:39.342936    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nll82"
Jul 05 13:15:39.343144 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:39.343068    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nll82" podUID="93717f79-abca-4163-80a4-061dabcc4d51"
Jul 05 13:15:40.344321 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:40.344284    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-49n5p"
Jul 05 13:15:40.344818 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:40.344404    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-49n5p" podUID="7f4539d3-5413-4b71-9c09-a9503e62c68a"
Jul 05 13:15:40.344818 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:40.344481    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2bmk6"
Jul 05 13:15:40.344818 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:40.344567    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2bmk6" podUID="516bf532-d39c-49a3-a2ba-b2e7af7c66ae"
Jul 05 13:15:41.343506 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:41.343465    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nll82"
Jul 05 13:15:41.343725 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:41.343607    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nll82" podUID="93717f79-abca-4163-80a4-061dabcc4d51"
Jul 05 13:15:42.344360 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:42.344165    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2bmk6"
Jul 05 13:15:42.344872 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:42.344235    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-49n5p"
Jul 05 13:15:42.344872 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:42.344473    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2bmk6" podUID="516bf532-d39c-49a3-a2ba-b2e7af7c66ae"
Jul 05 13:15:42.344872 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:42.344603    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-49n5p" podUID="7f4539d3-5413-4b71-9c09-a9503e62c68a"
Jul 05 13:15:42.456442 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:42.456184    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vsz6t" event={"ID":"6b7e0654-df3e-4f31-9fee-402ee841d4ac","Type":"ContainerStarted","Data":"33ff1d9ee18340689f892c661a24c3518c21034685786ce3a7b999e7cbfb9a84"}
Jul 05 13:15:42.457744 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:42.457721    2563 generic.go:356] "Generic (PLEG): container finished" podID="50c8a3c5-bf60-4554-bcf9-0b020c1f82ae" containerID="138c6d876e693f5b31094361ab98050062596c989eda38649feb234a4561bb50" exitCode=0
Jul 05 13:15:42.457870 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:42.457806    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xvkqz" event={"ID":"50c8a3c5-bf60-4554-bcf9-0b020c1f82ae","Type":"ContainerDied","Data":"138c6d876e693f5b31094361ab98050062596c989eda38649feb234a4561bb50"}
Jul 05 13:15:42.459927 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:42.459890    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ht6xk" event={"ID":"9810b314-df2c-4247-a5ae-43aea8036357","Type":"ContainerStarted","Data":"16069bacc287d8eea61787a822864eb6b0a0721f56493b32f69d2b3176501430"}
Jul 05 13:15:42.460047 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:42.459979    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ht6xk" event={"ID":"9810b314-df2c-4247-a5ae-43aea8036357","Type":"ContainerStarted","Data":"4eb93651021b8f71b15aafc7932be305fc1ea4e0a14c7678b01b5b63c1788ee6"}
Jul 05 13:15:42.463868 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:42.463826    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgz9n" event={"ID":"7a0f5157-6c15-4ec3-82b3-1c5dccb6e314","Type":"ContainerStarted","Data":"49513580a7ddeab35b00cf72ec4d569a7be3bbe35638c916c627c482b0e3bfd7"}
Jul 05 13:15:42.465362 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:42.465337    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-m9m5n" event={"ID":"c528f627-1ea0-45b7-892c-a8e34360bcc5","Type":"ContainerStarted","Data":"f985b32eb52459d0bd95f3997cd55fb4c1a70ffa240435257c60dead9159737f"}
Jul 05 13:15:42.466680 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:42.466656    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jrlbp" event={"ID":"e17e56ea-7aa6-4a13-a11c-399e00d91800","Type":"ContainerStarted","Data":"a848e7b6e344199254db82867ec14ae66d35df5280e8de84dab9a32276a669be"}
Jul 05 13:15:42.468087 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:42.468064    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-s9x2h" event={"ID":"3d69842e-9902-40bc-a7f6-0a018acc73db","Type":"ContainerStarted","Data":"06c8750e8399635a38c58ecd685a47d16b25f335330a57d41f251e8178f2ffba"}
Jul 05 13:15:42.469407 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:42.469382    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-w88w4" event={"ID":"e5283d97-9f47-4927-ad3f-f9f1596c1d55","Type":"ContainerStarted","Data":"b3c061f704a3949b0ed9f9eac5e723adeb0fce833b6c019f59587036af1344d8"}
Jul 05 13:15:42.470894 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:42.470859    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-239.ec2.internal" podStartSLOduration=21.470848338 podStartE2EDuration="21.470848338s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 13:15:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:15:25.435806989 +0000 UTC m=+5.529692616" watchObservedRunningTime="2026-07-05 13:15:42.470848338 +0000 UTC m=+22.564733962"
Jul 05 13:15:42.471021 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:42.470997    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-vsz6t" podStartSLOduration=3.6327294930000003 podStartE2EDuration="22.470991191s" totalImagesPullingTime="18.838261698s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 13:15:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:15:42.470701977 +0000 UTC m=+22.564587630" watchObservedRunningTime="2026-07-05 13:15:42.470991191 +0000 UTC m=+22.564876815"
Jul 05 13:15:42.505860 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:42.505815    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-jrlbp" podStartSLOduration=8.39271322 podStartE2EDuration="22.505799418s" totalImagesPullingTime="14.113086198s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:15:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:15:42.50548147 +0000 UTC m=+22.599367095" watchObservedRunningTime="2026-07-05 13:15:42.505799418 +0000 UTC m=+22.599685042"
Jul 05 13:15:42.521486 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:42.521441    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-m9m5n" podStartSLOduration=3.655183291 podStartE2EDuration="22.521424357s" totalImagesPullingTime="18.866241066s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 13:15:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:15:42.520746678 +0000 UTC m=+22.614632316" watchObservedRunningTime="2026-07-05 13:15:42.521424357 +0000 UTC m=+22.615309982"
Jul 05 13:15:42.536511 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:42.536463    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-s9x2h" podStartSLOduration=3.6977584329999997 podStartE2EDuration="22.53644752s" totalImagesPullingTime="18.838689087s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 13:15:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:15:42.535876257 +0000 UTC m=+22.629761881" watchObservedRunningTime="2026-07-05 13:15:42.53644752 +0000 UTC m=+22.630333145"
Jul 05 13:15:42.552867 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:42.552818    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-w88w4" podStartSLOduration=3.70086901 podStartE2EDuration="22.552803828s" totalImagesPullingTime="18.851934818s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 13:15:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:15:42.552187989 +0000 UTC m=+22.646073633" watchObservedRunningTime="2026-07-05 13:15:42.552803828 +0000 UTC m=+22.646689452"
Jul 05 13:15:43.343338 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:43.343258    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nll82"
Jul 05 13:15:43.343636 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:43.343378    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nll82" podUID="93717f79-abca-4163-80a4-061dabcc4d51"
Jul 05 13:15:43.477194 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:43.476536    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ht6xk" event={"ID":"9810b314-df2c-4247-a5ae-43aea8036357","Type":"ContainerStarted","Data":"7c1545b89497954773accb1319dcc6acbdb32a6e79510d77cf76381794623ee4"}
Jul 05 13:15:43.477194 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:43.476650    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ht6xk" event={"ID":"9810b314-df2c-4247-a5ae-43aea8036357","Type":"ContainerStarted","Data":"d050b7d489d001670520426aeee81603c1b99bb82205e0e1057140a1da105c45"}
Jul 05 13:15:43.477194 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:43.476691    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ht6xk" event={"ID":"9810b314-df2c-4247-a5ae-43aea8036357","Type":"ContainerStarted","Data":"c6417024fcc4e76335198ff7b5a04276f77a5767ec17a15e03c5ab8ae35088d8"}
Jul 05 13:15:43.477194 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:43.476740    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ht6xk" event={"ID":"9810b314-df2c-4247-a5ae-43aea8036357","Type":"ContainerStarted","Data":"71b313387d05de68a98b7e80d48fc252630220ff3a4633c50a298dec29bbd38e"}
Jul 05 13:15:43.570686 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:43.570650    2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 05 13:15:44.290668 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:44.290555    2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-05T13:15:43.570677492Z","UUID":"c335aa08-d535-4306-82df-2e0649617c11","Handler":null,"Name":"","Endpoint":""}
Jul 05 13:15:44.292274 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:44.292245    2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 05 13:15:44.292427 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:44.292312    2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 05 13:15:44.343445 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:44.343419    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-49n5p"
Jul 05 13:15:44.343638 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:44.343560    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-49n5p" podUID="7f4539d3-5413-4b71-9c09-a9503e62c68a"
Jul 05 13:15:44.343638 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:44.343614    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2bmk6"
Jul 05 13:15:44.343753 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:44.343731    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2bmk6" podUID="516bf532-d39c-49a3-a2ba-b2e7af7c66ae"
Jul 05 13:15:44.480806 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:44.480757    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgz9n" event={"ID":"7a0f5157-6c15-4ec3-82b3-1c5dccb6e314","Type":"ContainerStarted","Data":"6a331117a1c3dbd40e925d144998d1ac0a41d9cfb556d35e198dd8abc29eb39e"}
Jul 05 13:15:44.482427 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:44.482397    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-t6kt6" event={"ID":"78bd57a9-2c64-42b7-8d22-c920eb84afdd","Type":"ContainerStarted","Data":"52cd1f09b898d82af6d9a28ef4d719ab8d21b0537c9a7e9d449ec4bb8eec623f"}
Jul 05 13:15:44.498602 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:44.498544    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-t6kt6" podStartSLOduration=5.661277892 podStartE2EDuration="24.498523402s" totalImagesPullingTime="18.83724551s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 13:15:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:15:44.497913123 +0000 UTC m=+24.591798749" watchObservedRunningTime="2026-07-05 13:15:44.498523402 +0000 UTC m=+24.592409029"
Jul 05 13:15:45.343409 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:45.343375    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nll82"
Jul 05 13:15:45.343589 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:45.343488    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nll82" podUID="93717f79-abca-4163-80a4-061dabcc4d51"
Jul 05 13:15:45.487481 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:45.487451    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ht6xk" event={"ID":"9810b314-df2c-4247-a5ae-43aea8036357","Type":"ContainerStarted","Data":"2d84616b39bbc3d5fd12c5b9751c836a3da606bfb13822628d915bebff01f8af"}
Jul 05 13:15:45.492648 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:45.492600    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgz9n" event={"ID":"7a0f5157-6c15-4ec3-82b3-1c5dccb6e314","Type":"ContainerStarted","Data":"9073b9d30d5d8b80488320e56a496e77034888754fdb78834847c1eb3dc3e182"}
Jul 05 13:15:45.512957 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:45.512901    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgz9n" podStartSLOduration=4.3645876 podStartE2EDuration="25.512874334s" totalImagesPullingTime="21.148286734s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 13:15:20 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:15:45.51191925 +0000 UTC m=+25.605804876" watchObservedRunningTime="2026-07-05 13:15:45.512874334 +0000 UTC m=+25.606759960"
Jul 05 13:15:46.126246 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:46.126008    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-jrlbp"
Jul 05 13:15:46.126623 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:46.126594    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-jrlbp"
Jul 05 13:15:46.343820 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:46.343781    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2bmk6"
Jul 05 13:15:46.344035 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:46.343781    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-49n5p"
Jul 05 13:15:46.344035 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:46.343899    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2bmk6" podUID="516bf532-d39c-49a3-a2ba-b2e7af7c66ae"
Jul 05 13:15:46.344139 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:46.344050    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-49n5p" podUID="7f4539d3-5413-4b71-9c09-a9503e62c68a"
Jul 05 13:15:46.495873 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:46.495794    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-jrlbp"
Jul 05 13:15:46.496336 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:46.496316    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-jrlbp"
Jul 05 13:15:47.343327 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:47.343296    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nll82"
Jul 05 13:15:47.343540 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:47.343406    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nll82" podUID="93717f79-abca-4163-80a4-061dabcc4d51"
Jul 05 13:15:48.343618 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:48.343370    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-49n5p"
Jul 05 13:15:48.344328 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:48.343431    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2bmk6"
Jul 05 13:15:48.344328 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:48.343660    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-49n5p" podUID="7f4539d3-5413-4b71-9c09-a9503e62c68a"
Jul 05 13:15:48.344328 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:48.343736    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2bmk6" podUID="516bf532-d39c-49a3-a2ba-b2e7af7c66ae"
Jul 05 13:15:48.503092 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:48.502805    2563 generic.go:356] "Generic (PLEG): container finished" podID="50c8a3c5-bf60-4554-bcf9-0b020c1f82ae" containerID="1bfe80b77f8bb381e6aad74c2ae8476f379225d71c523aa9f64c0340f33123e5" exitCode=0
Jul 05 13:15:48.503092 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:48.502896    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xvkqz" event={"ID":"50c8a3c5-bf60-4554-bcf9-0b020c1f82ae","Type":"ContainerDied","Data":"1bfe80b77f8bb381e6aad74c2ae8476f379225d71c523aa9f64c0340f33123e5"}
Jul 05 13:15:48.507552 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:48.507527    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ht6xk" event={"ID":"9810b314-df2c-4247-a5ae-43aea8036357","Type":"ContainerStarted","Data":"d2cee8516fdcb4fee9b6ab9ac0ab89e653e13d57a43a85daaf1338660e99d633"}
Jul 05 13:15:48.551530 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:48.551472    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-ht6xk" podStartSLOduration=9.556595452 podStartE2EDuration="28.551456476s" totalImagesPullingTime="18.994861024s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 13:15:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:15:48.551081003 +0000 UTC m=+28.644966627" watchObservedRunningTime="2026-07-05 13:15:48.551456476 +0000 UTC m=+28.645342101"
Jul 05 13:15:49.343024 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:49.342991    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nll82"
Jul 05 13:15:49.343305 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:49.343092    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nll82" podUID="93717f79-abca-4163-80a4-061dabcc4d51"
Jul 05 13:15:49.510293 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:49.510261    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ht6xk"
Jul 05 13:15:49.510798 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:49.510334    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ht6xk"
Jul 05 13:15:49.510798 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:49.510376    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ht6xk"
Jul 05 13:15:49.525798 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:49.525770    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ht6xk"
Jul 05 13:15:49.525960 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:49.525948    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ht6xk"
Jul 05 13:15:50.082152 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:50.081977    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2bmk6"]
Jul 05 13:15:50.082330 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:50.082260    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2bmk6"
Jul 05 13:15:50.082398 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:50.082351    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2bmk6" podUID="516bf532-d39c-49a3-a2ba-b2e7af7c66ae"
Jul 05 13:15:50.085096 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:50.085070    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-49n5p"]
Jul 05 13:15:50.085212 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:50.085189    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-49n5p"
Jul 05 13:15:50.085358 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:50.085336    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-49n5p" podUID="7f4539d3-5413-4b71-9c09-a9503e62c68a"
Jul 05 13:15:50.095459 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:50.095432    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nll82"]
Jul 05 13:15:50.095586 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:50.095535    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nll82"
Jul 05 13:15:50.095663 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:50.095641    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nll82" podUID="93717f79-abca-4163-80a4-061dabcc4d51"
Jul 05 13:15:50.514268 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:50.514234    2563 generic.go:356] "Generic (PLEG): container finished" podID="50c8a3c5-bf60-4554-bcf9-0b020c1f82ae" containerID="b3c78cb31955ff6930e98b1c78128aced54b73b7e41ccb72cb7e5d7028fb84a4" exitCode=0
Jul 05 13:15:50.514789 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:50.514316    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xvkqz" event={"ID":"50c8a3c5-bf60-4554-bcf9-0b020c1f82ae","Type":"ContainerDied","Data":"b3c78cb31955ff6930e98b1c78128aced54b73b7e41ccb72cb7e5d7028fb84a4"}
Jul 05 13:15:51.343149 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:51.343115    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nll82"
Jul 05 13:15:51.343328 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:51.343115    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2bmk6"
Jul 05 13:15:51.343328 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:51.343269    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nll82" podUID="93717f79-abca-4163-80a4-061dabcc4d51"
Jul 05 13:15:51.343328 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:51.343302    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2bmk6" podUID="516bf532-d39c-49a3-a2ba-b2e7af7c66ae"
Jul 05 13:15:52.343751 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:52.343713    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-49n5p"
Jul 05 13:15:52.344421 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:52.343824    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-49n5p" podUID="7f4539d3-5413-4b71-9c09-a9503e62c68a"
Jul 05 13:15:52.521487 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:52.521452    2563 generic.go:356] "Generic (PLEG): container finished" podID="50c8a3c5-bf60-4554-bcf9-0b020c1f82ae" containerID="6b0265633430ef8ce0d17dbcf6632e2ef74589745fbc2cdc76b4711a4c52cbb9" exitCode=0
Jul 05 13:15:52.521644 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:52.521497    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xvkqz" event={"ID":"50c8a3c5-bf60-4554-bcf9-0b020c1f82ae","Type":"ContainerDied","Data":"6b0265633430ef8ce0d17dbcf6632e2ef74589745fbc2cdc76b4711a4c52cbb9"}
Jul 05 13:15:53.318639 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:53.318602    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:15:53.343588 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:53.343559    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nll82"
Jul 05 13:15:53.343754 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:53.343589    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2bmk6"
Jul 05 13:15:53.343754 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:53.343670    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nll82" podUID="93717f79-abca-4163-80a4-061dabcc4d51"
Jul 05 13:15:53.344184 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:53.343842    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2bmk6" podUID="516bf532-d39c-49a3-a2ba-b2e7af7c66ae"
Jul 05 13:15:53.402726 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:53.402691    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:15:54.079114 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:54.079082    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/93717f79-abca-4163-80a4-061dabcc4d51-original-pull-secret\") pod \"global-pull-secret-syncer-nll82\" (UID: \"93717f79-abca-4163-80a4-061dabcc4d51\") " pod="kube-system/global-pull-secret-syncer-nll82"
Jul 05 13:15:54.079323 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:54.079129    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f4539d3-5413-4b71-9c09-a9503e62c68a-metrics-certs\") pod \"network-metrics-daemon-49n5p\" (UID: \"7f4539d3-5413-4b71-9c09-a9503e62c68a\") " pod="openshift-multus/network-metrics-daemon-49n5p"
Jul 05 13:15:54.079323 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:54.079267    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 05 13:15:54.079323 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:54.079325    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f4539d3-5413-4b71-9c09-a9503e62c68a-metrics-certs podName:7f4539d3-5413-4b71-9c09-a9503e62c68a nodeName:}" failed. No retries permitted until 2026-07-05 13:16:26.079311096 +0000 UTC m=+66.173196699 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7f4539d3-5413-4b71-9c09-a9503e62c68a-metrics-certs") pod "network-metrics-daemon-49n5p" (UID: "7f4539d3-5413-4b71-9c09-a9503e62c68a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 05 13:15:54.079462 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:54.079268    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 05 13:15:54.079462 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:54.079362    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93717f79-abca-4163-80a4-061dabcc4d51-original-pull-secret podName:93717f79-abca-4163-80a4-061dabcc4d51 nodeName:}" failed. No retries permitted until 2026-07-05 13:16:26.079355234 +0000 UTC m=+66.173240837 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/93717f79-abca-4163-80a4-061dabcc4d51-original-pull-secret") pod "global-pull-secret-syncer-nll82" (UID: "93717f79-abca-4163-80a4-061dabcc4d51") : object "kube-system"/"original-pull-secret" not registered
Jul 05 13:15:54.180372 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:54.180329    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfdtd\" (UniqueName: \"kubernetes.io/projected/516bf532-d39c-49a3-a2ba-b2e7af7c66ae-kube-api-access-cfdtd\") pod \"network-check-target-2bmk6\" (UID: \"516bf532-d39c-49a3-a2ba-b2e7af7c66ae\") " pod="openshift-network-diagnostics/network-check-target-2bmk6"
Jul 05 13:15:54.180613 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:54.180509    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 05 13:15:54.180613 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:54.180536    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 05 13:15:54.180613 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:54.180552    2563 projected.go:196] Error preparing data for projected volume kube-api-access-cfdtd for pod openshift-network-diagnostics/network-check-target-2bmk6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 05 13:15:54.180613 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:54.180612    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/516bf532-d39c-49a3-a2ba-b2e7af7c66ae-kube-api-access-cfdtd podName:516bf532-d39c-49a3-a2ba-b2e7af7c66ae nodeName:}" failed. No retries permitted until 2026-07-05 13:16:26.180597078 +0000 UTC m=+66.274482682 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-cfdtd" (UniqueName: "kubernetes.io/projected/516bf532-d39c-49a3-a2ba-b2e7af7c66ae-kube-api-access-cfdtd") pod "network-check-target-2bmk6" (UID: "516bf532-d39c-49a3-a2ba-b2e7af7c66ae") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 05 13:15:54.343258 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:54.343167    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-49n5p"
Jul 05 13:15:54.343415 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:54.343311    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-49n5p" podUID="7f4539d3-5413-4b71-9c09-a9503e62c68a"
Jul 05 13:15:54.657144 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:54.657061    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-239.ec2.internal" event="NodeReady"
Jul 05 13:15:54.657551 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:54.657284    2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 05 13:15:54.700193 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:54.700159    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-hdt6g"]
Jul 05 13:15:54.704327 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:54.704298    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-ds4dn"]
Jul 05 13:15:54.704489 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:54.704432    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hdt6g"
Jul 05 13:15:54.706890 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:54.706642    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 05 13:15:54.706890 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:54.706652    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9gzst\""
Jul 05 13:15:54.706890 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:54.706812    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 05 13:15:54.708352 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:54.708329    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ds4dn"
Jul 05 13:15:54.710562 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:54.710426    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-5scw5\""
Jul 05 13:15:54.710562 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:54.710462    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 05 13:15:54.710562 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:54.710476    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 05 13:15:54.710562 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:54.710537    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 05 13:15:54.712764 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:54.712732    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hdt6g"]
Jul 05 13:15:54.725428 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:54.725368    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ds4dn"]
Jul 05 13:15:54.786529 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:54.786496    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/66bdf923-2681-4cef-b776-988f3c4d4a5c-cert\") pod \"ingress-canary-ds4dn\" (UID: \"66bdf923-2681-4cef-b776-988f3c4d4a5c\") " pod="openshift-ingress-canary/ingress-canary-ds4dn"
Jul 05 13:15:54.786726 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:54.786559    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hn2m7\" (UniqueName: \"kubernetes.io/projected/66bdf923-2681-4cef-b776-988f3c4d4a5c-kube-api-access-hn2m7\") pod \"ingress-canary-ds4dn\" (UID: \"66bdf923-2681-4cef-b776-988f3c4d4a5c\") " pod="openshift-ingress-canary/ingress-canary-ds4dn"
Jul 05 13:15:54.786726 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:54.786595    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jm9qq\" (UniqueName: \"kubernetes.io/projected/d3f908ac-37a8-4df4-a945-2795c28b7898-kube-api-access-jm9qq\") pod \"dns-default-hdt6g\" (UID: \"d3f908ac-37a8-4df4-a945-2795c28b7898\") " pod="openshift-dns/dns-default-hdt6g"
Jul 05 13:15:54.786726 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:54.786620    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3f908ac-37a8-4df4-a945-2795c28b7898-tmp-dir\") pod \"dns-default-hdt6g\" (UID: \"d3f908ac-37a8-4df4-a945-2795c28b7898\") " pod="openshift-dns/dns-default-hdt6g"
Jul 05 13:15:54.786726 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:54.786704    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3f908ac-37a8-4df4-a945-2795c28b7898-metrics-tls\") pod \"dns-default-hdt6g\" (UID: \"d3f908ac-37a8-4df4-a945-2795c28b7898\") " pod="openshift-dns/dns-default-hdt6g"
Jul 05 13:15:54.786952 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:54.786742    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d3f908ac-37a8-4df4-a945-2795c28b7898-config-volume\") pod \"dns-default-hdt6g\" (UID: \"d3f908ac-37a8-4df4-a945-2795c28b7898\") " pod="openshift-dns/dns-default-hdt6g"
Jul 05 13:15:54.887451 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:54.887414    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3f908ac-37a8-4df4-a945-2795c28b7898-metrics-tls\") pod \"dns-default-hdt6g\" (UID: \"d3f908ac-37a8-4df4-a945-2795c28b7898\") " pod="openshift-dns/dns-default-hdt6g"
Jul 05 13:15:54.887451 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:54.887455    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d3f908ac-37a8-4df4-a945-2795c28b7898-config-volume\") pod \"dns-default-hdt6g\" (UID: \"d3f908ac-37a8-4df4-a945-2795c28b7898\") " pod="openshift-dns/dns-default-hdt6g"
Jul 05 13:15:54.887712 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:54.887499    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/66bdf923-2681-4cef-b776-988f3c4d4a5c-cert\") pod \"ingress-canary-ds4dn\" (UID: \"66bdf923-2681-4cef-b776-988f3c4d4a5c\") " pod="openshift-ingress-canary/ingress-canary-ds4dn"
Jul 05 13:15:54.887712 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:54.887544    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hn2m7\" (UniqueName: \"kubernetes.io/projected/66bdf923-2681-4cef-b776-988f3c4d4a5c-kube-api-access-hn2m7\") pod \"ingress-canary-ds4dn\" (UID: \"66bdf923-2681-4cef-b776-988f3c4d4a5c\") " pod="openshift-ingress-canary/ingress-canary-ds4dn"
Jul 05 13:15:54.887712 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:54.887577    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jm9qq\" (UniqueName: \"kubernetes.io/projected/d3f908ac-37a8-4df4-a945-2795c28b7898-kube-api-access-jm9qq\") pod \"dns-default-hdt6g\" (UID: \"d3f908ac-37a8-4df4-a945-2795c28b7898\") " pod="openshift-dns/dns-default-hdt6g"
Jul 05 13:15:54.887712 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:54.887597    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 05 13:15:54.887712 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:54.887676    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3f908ac-37a8-4df4-a945-2795c28b7898-metrics-tls podName:d3f908ac-37a8-4df4-a945-2795c28b7898 nodeName:}" failed. No retries permitted until 2026-07-05 13:15:55.387652753 +0000 UTC m=+35.481538378 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d3f908ac-37a8-4df4-a945-2795c28b7898-metrics-tls") pod "dns-default-hdt6g" (UID: "d3f908ac-37a8-4df4-a945-2795c28b7898") : secret "dns-default-metrics-tls" not found
Jul 05 13:15:54.887952 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:54.887608    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3f908ac-37a8-4df4-a945-2795c28b7898-tmp-dir\") pod \"dns-default-hdt6g\" (UID: \"d3f908ac-37a8-4df4-a945-2795c28b7898\") " pod="openshift-dns/dns-default-hdt6g"
Jul 05 13:15:54.887952 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:54.887923    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3f908ac-37a8-4df4-a945-2795c28b7898-tmp-dir\") pod \"dns-default-hdt6g\" (UID: \"d3f908ac-37a8-4df4-a945-2795c28b7898\") " pod="openshift-dns/dns-default-hdt6g"
Jul 05 13:15:54.888179 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:54.888161    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d3f908ac-37a8-4df4-a945-2795c28b7898-config-volume\") pod \"dns-default-hdt6g\" (UID: \"d3f908ac-37a8-4df4-a945-2795c28b7898\") " pod="openshift-dns/dns-default-hdt6g"
Jul 05 13:15:54.892233 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:54.892196    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/66bdf923-2681-4cef-b776-988f3c4d4a5c-cert\") pod \"ingress-canary-ds4dn\" (UID: \"66bdf923-2681-4cef-b776-988f3c4d4a5c\") " pod="openshift-ingress-canary/ingress-canary-ds4dn"
Jul 05 13:15:54.898012 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:54.897800    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jm9qq\" (UniqueName: \"kubernetes.io/projected/d3f908ac-37a8-4df4-a945-2795c28b7898-kube-api-access-jm9qq\") pod \"dns-default-hdt6g\" (UID: \"d3f908ac-37a8-4df4-a945-2795c28b7898\") " pod="openshift-dns/dns-default-hdt6g"
Jul 05 13:15:54.898150 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:54.898009    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hn2m7\" (UniqueName: \"kubernetes.io/projected/66bdf923-2681-4cef-b776-988f3c4d4a5c-kube-api-access-hn2m7\") pod \"ingress-canary-ds4dn\" (UID: \"66bdf923-2681-4cef-b776-988f3c4d4a5c\") " pod="openshift-ingress-canary/ingress-canary-ds4dn"
Jul 05 13:15:55.024403 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:55.024309    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ds4dn"
Jul 05 13:15:55.343485 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:55.343451    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2bmk6"
Jul 05 13:15:55.343687 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:55.343451    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nll82"
Jul 05 13:15:55.346144 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:55.346121    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 05 13:15:55.347042 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:55.346993    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 05 13:15:55.347042 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:55.347004    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 05 13:15:55.347240 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:55.347004    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-852z8\""
Jul 05 13:15:55.391994 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:55.391949    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3f908ac-37a8-4df4-a945-2795c28b7898-metrics-tls\") pod \"dns-default-hdt6g\" (UID: \"d3f908ac-37a8-4df4-a945-2795c28b7898\") " pod="openshift-dns/dns-default-hdt6g"
Jul 05 13:15:55.392184 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:55.392113    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 05 13:15:55.392260 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:55.392184    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3f908ac-37a8-4df4-a945-2795c28b7898-metrics-tls podName:d3f908ac-37a8-4df4-a945-2795c28b7898 nodeName:}" failed. No retries permitted until 2026-07-05 13:15:56.39216644 +0000 UTC m=+36.486052056 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d3f908ac-37a8-4df4-a945-2795c28b7898-metrics-tls") pod "dns-default-hdt6g" (UID: "d3f908ac-37a8-4df4-a945-2795c28b7898") : secret "dns-default-metrics-tls" not found
Jul 05 13:15:55.428924 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:55.428885    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:15:55.529914 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:55.529882    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:15:56.343582 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:56.343545    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-49n5p"
Jul 05 13:15:56.346741 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:56.346444    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jgr78\""
Jul 05 13:15:56.346741 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:56.346476    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 05 13:15:56.402403 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:56.402369    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3f908ac-37a8-4df4-a945-2795c28b7898-metrics-tls\") pod \"dns-default-hdt6g\" (UID: \"d3f908ac-37a8-4df4-a945-2795c28b7898\") " pod="openshift-dns/dns-default-hdt6g"
Jul 05 13:15:56.402562 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:56.402520    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 05 13:15:56.402612 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:56.402601    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3f908ac-37a8-4df4-a945-2795c28b7898-metrics-tls podName:d3f908ac-37a8-4df4-a945-2795c28b7898 nodeName:}" failed. No retries permitted until 2026-07-05 13:15:58.402582743 +0000 UTC m=+38.496468354 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d3f908ac-37a8-4df4-a945-2795c28b7898-metrics-tls") pod "dns-default-hdt6g" (UID: "d3f908ac-37a8-4df4-a945-2795c28b7898") : secret "dns-default-metrics-tls" not found
Jul 05 13:15:56.547009 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:56.546980    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ds4dn"]
Jul 05 13:15:56.552285 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:15:56.552263    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66bdf923_2681_4cef_b776_988f3c4d4a5c.slice/crio-2ec0b7c22f2b4952d1dd6024aeb5271dc12e7791b868020dc3377adc35346134 WatchSource:0}: Error finding container 2ec0b7c22f2b4952d1dd6024aeb5271dc12e7791b868020dc3377adc35346134: Status 404 returned error can't find the container with id 2ec0b7c22f2b4952d1dd6024aeb5271dc12e7791b868020dc3377adc35346134
Jul 05 13:15:57.539033 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:57.538996    2563 generic.go:356] "Generic (PLEG): container finished" podID="50c8a3c5-bf60-4554-bcf9-0b020c1f82ae" containerID="86b36688ed8cfbce5dc79de2e9fd95e17bd0962b6ac3e1b4312536d051905049" exitCode=0
Jul 05 13:15:57.539594 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:57.539087    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xvkqz" event={"ID":"50c8a3c5-bf60-4554-bcf9-0b020c1f82ae","Type":"ContainerDied","Data":"86b36688ed8cfbce5dc79de2e9fd95e17bd0962b6ac3e1b4312536d051905049"}
Jul 05 13:15:57.540557 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:57.540423    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ds4dn" event={"ID":"66bdf923-2681-4cef-b776-988f3c4d4a5c","Type":"ContainerStarted","Data":"2ec0b7c22f2b4952d1dd6024aeb5271dc12e7791b868020dc3377adc35346134"}
Jul 05 13:15:58.420601 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:58.420558    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3f908ac-37a8-4df4-a945-2795c28b7898-metrics-tls\") pod \"dns-default-hdt6g\" (UID: \"d3f908ac-37a8-4df4-a945-2795c28b7898\") " pod="openshift-dns/dns-default-hdt6g"
Jul 05 13:15:58.420784 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:58.420757    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 05 13:15:58.420849 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:15:58.420837    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3f908ac-37a8-4df4-a945-2795c28b7898-metrics-tls podName:d3f908ac-37a8-4df4-a945-2795c28b7898 nodeName:}" failed. No retries permitted until 2026-07-05 13:16:02.420817955 +0000 UTC m=+42.514703561 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d3f908ac-37a8-4df4-a945-2795c28b7898-metrics-tls") pod "dns-default-hdt6g" (UID: "d3f908ac-37a8-4df4-a945-2795c28b7898") : secret "dns-default-metrics-tls" not found
Jul 05 13:15:58.546863 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:58.546607    2563 generic.go:356] "Generic (PLEG): container finished" podID="50c8a3c5-bf60-4554-bcf9-0b020c1f82ae" containerID="1e5826934fc4287e8e27459412170c6d22d2ef1aa6a94b138b36533ef6243b64" exitCode=0
Jul 05 13:15:58.547301 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:58.546684    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xvkqz" event={"ID":"50c8a3c5-bf60-4554-bcf9-0b020c1f82ae","Type":"ContainerDied","Data":"1e5826934fc4287e8e27459412170c6d22d2ef1aa6a94b138b36533ef6243b64"}
Jul 05 13:15:59.421363 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:59.421324    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:15:59.517987 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:59.517948    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:15:59.552672 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:59.552634    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xvkqz" event={"ID":"50c8a3c5-bf60-4554-bcf9-0b020c1f82ae","Type":"ContainerStarted","Data":"aea942e9f4638cd2bd141877b3fc2f4dcb4e7f77988f35c86e4057597609f59d"}
Jul 05 13:15:59.554069 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:59.554040    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ds4dn" event={"ID":"66bdf923-2681-4cef-b776-988f3c4d4a5c","Type":"ContainerStarted","Data":"05b94623d02037a05403ea1ff0e911a472d6a3c1766d79c7909865c83fac63db"}
Jul 05 13:15:59.580316 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:59.580254    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-xvkqz" podStartSLOduration=9.123928951 podStartE2EDuration="39.580214959s" totalImagesPullingTime="30.456286008s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 13:15:20 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:15:59.579652377 +0000 UTC m=+39.673538035" watchObservedRunningTime="2026-07-05 13:15:59.580214959 +0000 UTC m=+39.674100590"
Jul 05 13:15:59.600599 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:59.600548    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-ds4dn" podStartSLOduration=3.253138674 podStartE2EDuration="5.600530946s" totalImagesPullingTime="2.347392272s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:15:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:15:59.599513127 +0000 UTC m=+39.693398770" watchObservedRunningTime="2026-07-05 13:15:59.600530946 +0000 UTC m=+39.694416571"
Jul 05 13:15:59.710323 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:59.710211    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:15:59.768205 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:15:59.768163    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:16:00.095440 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:16:00.095407    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:16:00.651568 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:16:00.651530    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:16:00.751623 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:16:00.751580    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:16:00.812062 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:16:00.812030    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:16:00.989961 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:16:00.989873    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:16:01.046091 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:16:01.046061    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:16:02.450870 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:16:02.450837    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3f908ac-37a8-4df4-a945-2795c28b7898-metrics-tls\") pod \"dns-default-hdt6g\" (UID: \"d3f908ac-37a8-4df4-a945-2795c28b7898\") " pod="openshift-dns/dns-default-hdt6g"
Jul 05 13:16:02.451290 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:16:02.450971    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 05 13:16:02.451290 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:16:02.451029    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3f908ac-37a8-4df4-a945-2795c28b7898-metrics-tls podName:d3f908ac-37a8-4df4-a945-2795c28b7898 nodeName:}" failed. No retries permitted until 2026-07-05 13:16:10.451012558 +0000 UTC m=+50.544898161 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d3f908ac-37a8-4df4-a945-2795c28b7898-metrics-tls") pod "dns-default-hdt6g" (UID: "d3f908ac-37a8-4df4-a945-2795c28b7898") : secret "dns-default-metrics-tls" not found
Jul 05 13:16:03.482310 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:16:03.482277    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:16:03.543980 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:16:03.543947    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:16:10.504884 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:16:10.504844    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3f908ac-37a8-4df4-a945-2795c28b7898-metrics-tls\") pod \"dns-default-hdt6g\" (UID: \"d3f908ac-37a8-4df4-a945-2795c28b7898\") " pod="openshift-dns/dns-default-hdt6g"
Jul 05 13:16:10.505364 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:16:10.504965    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 05 13:16:10.505364 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:16:10.505018    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3f908ac-37a8-4df4-a945-2795c28b7898-metrics-tls podName:d3f908ac-37a8-4df4-a945-2795c28b7898 nodeName:}" failed. No retries permitted until 2026-07-05 13:16:26.505005456 +0000 UTC m=+66.598891059 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d3f908ac-37a8-4df4-a945-2795c28b7898-metrics-tls") pod "dns-default-hdt6g" (UID: "d3f908ac-37a8-4df4-a945-2795c28b7898") : secret "dns-default-metrics-tls" not found
Jul 05 13:16:18.397587 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:16:18.397546    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:16:18.450712 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:16:18.450676    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:16:21.527187 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:16:21.527163    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ht6xk"
Jul 05 13:16:21.676656 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:16:21.676621    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:16:21.729761 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:16:21.729727    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:16:23.587330 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:16:23.587296    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:16:23.649441 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:16:23.649403    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:16:23.704472 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:16:23.704441    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:16:26.112592 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:16:26.112549    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/93717f79-abca-4163-80a4-061dabcc4d51-original-pull-secret\") pod \"global-pull-secret-syncer-nll82\" (UID: \"93717f79-abca-4163-80a4-061dabcc4d51\") " pod="kube-system/global-pull-secret-syncer-nll82"
Jul 05 13:16:26.112592 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:16:26.112597    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f4539d3-5413-4b71-9c09-a9503e62c68a-metrics-certs\") pod \"network-metrics-daemon-49n5p\" (UID: \"7f4539d3-5413-4b71-9c09-a9503e62c68a\") " pod="openshift-multus/network-metrics-daemon-49n5p"
Jul 05 13:16:26.114898 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:16:26.114877    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 05 13:16:26.115049 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:16:26.115034    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 05 13:16:26.123808 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:16:26.123782    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 05 13:16:26.123888 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:16:26.123876    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f4539d3-5413-4b71-9c09-a9503e62c68a-metrics-certs podName:7f4539d3-5413-4b71-9c09-a9503e62c68a nodeName:}" failed. No retries permitted until 2026-07-05 13:17:30.123852702 +0000 UTC m=+130.217738318 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7f4539d3-5413-4b71-9c09-a9503e62c68a-metrics-certs") pod "network-metrics-daemon-49n5p" (UID: "7f4539d3-5413-4b71-9c09-a9503e62c68a") : secret "metrics-daemon-secret" not found
Jul 05 13:16:26.127640 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:16:26.127619    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/93717f79-abca-4163-80a4-061dabcc4d51-original-pull-secret\") pod \"global-pull-secret-syncer-nll82\" (UID: \"93717f79-abca-4163-80a4-061dabcc4d51\") " pod="kube-system/global-pull-secret-syncer-nll82"
Jul 05 13:16:26.213241 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:16:26.213185    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfdtd\" (UniqueName: \"kubernetes.io/projected/516bf532-d39c-49a3-a2ba-b2e7af7c66ae-kube-api-access-cfdtd\") pod \"network-check-target-2bmk6\" (UID: \"516bf532-d39c-49a3-a2ba-b2e7af7c66ae\") " pod="openshift-network-diagnostics/network-check-target-2bmk6"
Jul 05 13:16:26.215781 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:16:26.215760    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 05 13:16:26.225705 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:16:26.225679    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 05 13:16:26.236836 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:16:26.236816    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfdtd\" (UniqueName: \"kubernetes.io/projected/516bf532-d39c-49a3-a2ba-b2e7af7c66ae-kube-api-access-cfdtd\") pod \"network-check-target-2bmk6\" (UID: \"516bf532-d39c-49a3-a2ba-b2e7af7c66ae\") " pod="openshift-network-diagnostics/network-check-target-2bmk6"
Jul 05 13:16:26.258193 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:16:26.258164    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-852z8\""
Jul 05 13:16:26.261073 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:16:26.261055    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nll82"
Jul 05 13:16:26.266121 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:16:26.266101    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2bmk6"
Jul 05 13:16:26.420323 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:16:26.420248    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nll82"]
Jul 05 13:16:26.424101 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:16:26.424073    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93717f79_abca_4163_80a4_061dabcc4d51.slice/crio-18dbc2feafe3c8dea70e1b223f2fd78dfcd02eabd93438eb9e87033edc747ff4 WatchSource:0}: Error finding container 18dbc2feafe3c8dea70e1b223f2fd78dfcd02eabd93438eb9e87033edc747ff4: Status 404 returned error can't find the container with id 18dbc2feafe3c8dea70e1b223f2fd78dfcd02eabd93438eb9e87033edc747ff4
Jul 05 13:16:26.436653 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:16:26.436626    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2bmk6"]
Jul 05 13:16:26.439855 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:16:26.439831    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod516bf532_d39c_49a3_a2ba_b2e7af7c66ae.slice/crio-f72e51d3af5de48e11357a0880bd90a9ae152ade3fb51dcdbc7843aec454977c WatchSource:0}: Error finding container f72e51d3af5de48e11357a0880bd90a9ae152ade3fb51dcdbc7843aec454977c: Status 404 returned error can't find the container with id f72e51d3af5de48e11357a0880bd90a9ae152ade3fb51dcdbc7843aec454977c
Jul 05 13:16:26.516353 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:16:26.516316    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3f908ac-37a8-4df4-a945-2795c28b7898-metrics-tls\") pod \"dns-default-hdt6g\" (UID: \"d3f908ac-37a8-4df4-a945-2795c28b7898\") " pod="openshift-dns/dns-default-hdt6g"
Jul 05 13:16:26.516526 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:16:26.516445    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 05 13:16:26.516526 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:16:26.516518    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3f908ac-37a8-4df4-a945-2795c28b7898-metrics-tls podName:d3f908ac-37a8-4df4-a945-2795c28b7898 nodeName:}" failed. No retries permitted until 2026-07-05 13:16:58.516499893 +0000 UTC m=+98.610385503 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d3f908ac-37a8-4df4-a945-2795c28b7898-metrics-tls") pod "dns-default-hdt6g" (UID: "d3f908ac-37a8-4df4-a945-2795c28b7898") : secret "dns-default-metrics-tls" not found
Jul 05 13:16:26.619879 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:16:26.619844    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2bmk6" event={"ID":"516bf532-d39c-49a3-a2ba-b2e7af7c66ae","Type":"ContainerStarted","Data":"f72e51d3af5de48e11357a0880bd90a9ae152ade3fb51dcdbc7843aec454977c"}
Jul 05 13:16:26.620967 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:16:26.620938    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nll82" event={"ID":"93717f79-abca-4163-80a4-061dabcc4d51","Type":"ContainerStarted","Data":"18dbc2feafe3c8dea70e1b223f2fd78dfcd02eabd93438eb9e87033edc747ff4"}
Jul 05 13:16:31.553071 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:16:31.553041    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:16:31.604209 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:16:31.604174    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:16:31.638514 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:16:31.638481    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2bmk6" event={"ID":"516bf532-d39c-49a3-a2ba-b2e7af7c66ae","Type":"ContainerStarted","Data":"ef61dad7d11411403741854b7bcdf9f9a5b71406d71591cae0e95323ff3335a1"}
Jul 05 13:16:31.638699 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:16:31.638557    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-2bmk6"
Jul 05 13:16:31.639923 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:16:31.639899    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nll82" event={"ID":"93717f79-abca-4163-80a4-061dabcc4d51","Type":"ContainerStarted","Data":"9e72cf4e1f6014e6aef704c41873b7a4a7a7814c2594fc2f3567fd1f8241364a"}
Jul 05 13:16:31.655274 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:16:31.655211    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-2bmk6" podStartSLOduration=66.919328104 podStartE2EDuration="1m11.655196107s" totalImagesPullingTime="4.735868003s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:15:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:16:31.654579027 +0000 UTC m=+71.748464656" watchObservedRunningTime="2026-07-05 13:16:31.655196107 +0000 UTC m=+71.749081726"
Jul 05 13:16:31.668710 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:16:31.668661    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-nll82" podStartSLOduration=66.912294348 podStartE2EDuration="1m11.668645508s" totalImagesPullingTime="4.75635116s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 13:15:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:16:31.667777651 +0000 UTC m=+71.761663305" watchObservedRunningTime="2026-07-05 13:16:31.668645508 +0000 UTC m=+71.762531133"
Jul 05 13:16:53.575017 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:16:53.574975    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:16:53.630366 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:16:53.630327    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:16:58.532589 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:16:58.532552    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3f908ac-37a8-4df4-a945-2795c28b7898-metrics-tls\") pod \"dns-default-hdt6g\" (UID: \"d3f908ac-37a8-4df4-a945-2795c28b7898\") " pod="openshift-dns/dns-default-hdt6g"
Jul 05 13:16:58.532990 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:16:58.532652    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 05 13:16:58.532990 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:16:58.532713    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3f908ac-37a8-4df4-a945-2795c28b7898-metrics-tls podName:d3f908ac-37a8-4df4-a945-2795c28b7898 nodeName:}" failed. No retries permitted until 2026-07-05 13:18:02.532700759 +0000 UTC m=+162.626586363 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d3f908ac-37a8-4df4-a945-2795c28b7898-metrics-tls") pod "dns-default-hdt6g" (UID: "d3f908ac-37a8-4df4-a945-2795c28b7898") : secret "dns-default-metrics-tls" not found
Jul 05 13:17:00.549286 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:17:00.549250    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d97d64b76-9p7zr"]
Jul 05 13:17:00.553467 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:17:00.553448    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d97d64b76-9p7zr"
Jul 05 13:17:00.556855 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:17:00.556828    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 05 13:17:00.556855 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:17:00.556835    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 05 13:17:00.557051 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:17:00.556882    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 05 13:17:00.557051 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:17:00.556912    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 05 13:17:00.561029 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:17:00.561006    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d97d64b76-9p7zr"]
Jul 05 13:17:00.591337 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:17:00.591304    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8577fc5b84-9b7wp"]
Jul 05 13:17:00.594143 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:17:00.594127    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8577fc5b84-9b7wp"
Jul 05 13:17:00.597330 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:17:00.597301    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 05 13:17:00.597482 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:17:00.597381    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 05 13:17:00.597482 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:17:00.597436    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 05 13:17:00.597482 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:17:00.597451    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 05 13:17:00.604320 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:17:00.604298    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8577fc5b84-9b7wp"]
Jul 05 13:17:00.644649 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:17:00.644614    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/579a484b-b10c-482b-8a8c-336afc4c5f9b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-8577fc5b84-9b7wp\" (UID: \"579a484b-b10c-482b-8a8c-336afc4c5f9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8577fc5b84-9b7wp"
Jul 05 13:17:00.644649 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:17:00.644661    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/275fedac-9db0-40c0-a314-768b2488de87-tmp\") pod \"klusterlet-addon-workmgr-6d97d64b76-9p7zr\" (UID: \"275fedac-9db0-40c0-a314-768b2488de87\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d97d64b76-9p7zr"
Jul 05 13:17:00.644928 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:17:00.644681    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/579a484b-b10c-482b-8a8c-336afc4c5f9b-ca\") pod \"cluster-proxy-proxy-agent-8577fc5b84-9b7wp\" (UID: \"579a484b-b10c-482b-8a8c-336afc4c5f9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8577fc5b84-9b7wp"
Jul 05 13:17:00.644928 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:17:00.644740    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/579a484b-b10c-482b-8a8c-336afc4c5f9b-hub\") pod \"cluster-proxy-proxy-agent-8577fc5b84-9b7wp\" (UID: \"579a484b-b10c-482b-8a8c-336afc4c5f9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8577fc5b84-9b7wp"
Jul 05 13:17:00.644928 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:17:00.644776    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/579a484b-b10c-482b-8a8c-336afc4c5f9b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-8577fc5b84-9b7wp\" (UID: \"579a484b-b10c-482b-8a8c-336afc4c5f9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8577fc5b84-9b7wp"
Jul 05 13:17:00.644928 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:17:00.644808    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/579a484b-b10c-482b-8a8c-336afc4c5f9b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-8577fc5b84-9b7wp\" (UID: \"579a484b-b10c-482b-8a8c-336afc4c5f9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8577fc5b84-9b7wp"
Jul 05 13:17:00.644928 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:17:00.644831    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnsnh\" (UniqueName: \"kubernetes.io/projected/579a484b-b10c-482b-8a8c-336afc4c5f9b-kube-api-access-mnsnh\") pod \"cluster-proxy-proxy-agent-8577fc5b84-9b7wp\" (UID: \"579a484b-b10c-482b-8a8c-336afc4c5f9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8577fc5b84-9b7wp"
Jul 05 13:17:00.644928 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:17:00.644889    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/275fedac-9db0-40c0-a314-768b2488de87-klusterlet-config\") pod \"klusterlet-addon-workmgr-6d97d64b76-9p7zr\" (UID: \"275fedac-9db0-40c0-a314-768b2488de87\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d97d64b76-9p7zr"
Jul 05 13:17:00.644928 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:17:00.644927    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkr5l\" (UniqueName: \"kubernetes.io/projected/275fedac-9db0-40c0-a314-768b2488de87-kube-api-access-nkr5l\") pod \"klusterlet-addon-workmgr-6d97d64b76-9p7zr\" (UID: \"275fedac-9db0-40c0-a314-768b2488de87\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d97d64b76-9p7zr"
Jul 05 13:17:00.746017 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:17:00.745978    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/275fedac-9db0-40c0-a314-768b2488de87-klusterlet-config\") pod \"klusterlet-addon-workmgr-6d97d64b76-9p7zr\" (UID: \"275fedac-9db0-40c0-a314-768b2488de87\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d97d64b76-9p7zr"
Jul 05 13:17:00.746017 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:17:00.746017    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkr5l\" (UniqueName: \"kubernetes.io/projected/275fedac-9db0-40c0-a314-768b2488de87-kube-api-access-nkr5l\") pod \"klusterlet-addon-workmgr-6d97d64b76-9p7zr\" (UID: \"275fedac-9db0-40c0-a314-768b2488de87\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d97d64b76-9p7zr"
Jul 05 13:17:00.746276 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:17:00.746085    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/579a484b-b10c-482b-8a8c-336afc4c5f9b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-8577fc5b84-9b7wp\" (UID: \"579a484b-b10c-482b-8a8c-336afc4c5f9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8577fc5b84-9b7wp"
Jul 05 13:17:00.746276 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:17:00.746128    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/275fedac-9db0-40c0-a314-768b2488de87-tmp\") pod \"klusterlet-addon-workmgr-6d97d64b76-9p7zr\" (UID: \"275fedac-9db0-40c0-a314-768b2488de87\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d97d64b76-9p7zr"
Jul 05 13:17:00.746369 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:17:00.746266    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/579a484b-b10c-482b-8a8c-336afc4c5f9b-ca\") pod \"cluster-proxy-proxy-agent-8577fc5b84-9b7wp\" (UID: \"579a484b-b10c-482b-8a8c-336afc4c5f9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8577fc5b84-9b7wp"
Jul 05 13:17:00.746369 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:17:00.746307    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/579a484b-b10c-482b-8a8c-336afc4c5f9b-hub\") pod \"cluster-proxy-proxy-agent-8577fc5b84-9b7wp\" (UID: \"579a484b-b10c-482b-8a8c-336afc4c5f9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8577fc5b84-9b7wp"
Jul 05 13:17:00.746369 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:17:00.746336    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/579a484b-b10c-482b-8a8c-336afc4c5f9b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-8577fc5b84-9b7wp\" (UID: \"579a484b-b10c-482b-8a8c-336afc4c5f9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8577fc5b84-9b7wp"
Jul 05 13:17:00.746586 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:17:00.746496    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/579a484b-b10c-482b-8a8c-336afc4c5f9b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-8577fc5b84-9b7wp\" (UID: \"579a484b-b10c-482b-8a8c-336afc4c5f9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8577fc5b84-9b7wp"
Jul 05 13:17:00.746586 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:17:00.746541    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnsnh\" (UniqueName: \"kubernetes.io/projected/579a484b-b10c-482b-8a8c-336afc4c5f9b-kube-api-access-mnsnh\") pod \"cluster-proxy-proxy-agent-8577fc5b84-9b7wp\" (UID: \"579a484b-b10c-482b-8a8c-336afc4c5f9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8577fc5b84-9b7wp"
Jul 05 13:17:00.746683 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:17:00.746600    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/275fedac-9db0-40c0-a314-768b2488de87-tmp\") pod \"klusterlet-addon-workmgr-6d97d64b76-9p7zr\" (UID: \"275fedac-9db0-40c0-a314-768b2488de87\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d97d64b76-9p7zr"
Jul 05 13:17:00.746949 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:17:00.746917    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/579a484b-b10c-482b-8a8c-336afc4c5f9b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-8577fc5b84-9b7wp\" (UID: \"579a484b-b10c-482b-8a8c-336afc4c5f9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8577fc5b84-9b7wp"
Jul 05 13:17:00.748839 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:17:00.748809    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/579a484b-b10c-482b-8a8c-336afc4c5f9b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-8577fc5b84-9b7wp\" (UID: \"579a484b-b10c-482b-8a8c-336afc4c5f9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8577fc5b84-9b7wp"
Jul 05 13:17:00.749133 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:17:00.749113    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/579a484b-b10c-482b-8a8c-336afc4c5f9b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-8577fc5b84-9b7wp\" (UID: \"579a484b-b10c-482b-8a8c-336afc4c5f9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8577fc5b84-9b7wp"
Jul 05 13:17:00.749175 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:17:00.749113    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/579a484b-b10c-482b-8a8c-336afc4c5f9b-hub\") pod \"cluster-proxy-proxy-agent-8577fc5b84-9b7wp\" (UID: \"579a484b-b10c-482b-8a8c-336afc4c5f9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8577fc5b84-9b7wp"
Jul 05 13:17:00.749209 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:17:00.749182    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/275fedac-9db0-40c0-a314-768b2488de87-klusterlet-config\") pod \"klusterlet-addon-workmgr-6d97d64b76-9p7zr\" (UID: \"275fedac-9db0-40c0-a314-768b2488de87\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d97d64b76-9p7zr"
Jul 05 13:17:00.749359 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:17:00.749347    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/579a484b-b10c-482b-8a8c-336afc4c5f9b-ca\") pod \"cluster-proxy-proxy-agent-8577fc5b84-9b7wp\" (UID: \"579a484b-b10c-482b-8a8c-336afc4c5f9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8577fc5b84-9b7wp"
Jul 05 13:17:00.755092 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:17:00.755064    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnsnh\" (UniqueName: \"kubernetes.io/projected/579a484b-b10c-482b-8a8c-336afc4c5f9b-kube-api-access-mnsnh\") pod \"cluster-proxy-proxy-agent-8577fc5b84-9b7wp\" (UID: \"579a484b-b10c-482b-8a8c-336afc4c5f9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8577fc5b84-9b7wp"
Jul 05 13:17:00.755308 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:17:00.755154    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkr5l\" (UniqueName: \"kubernetes.io/projected/275fedac-9db0-40c0-a314-768b2488de87-kube-api-access-nkr5l\") pod \"klusterlet-addon-workmgr-6d97d64b76-9p7zr\" (UID: \"275fedac-9db0-40c0-a314-768b2488de87\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d97d64b76-9p7zr"
Jul 05 13:17:00.863412 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:17:00.863321    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d97d64b76-9p7zr"
Jul 05 13:17:00.918616 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:17:00.918577    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8577fc5b84-9b7wp"
Jul 05 13:17:01.001452 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:17:01.001368    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d97d64b76-9p7zr"]
Jul 05 13:17:01.005959 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:17:01.005926    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod275fedac_9db0_40c0_a314_768b2488de87.slice/crio-8408e7ebce187bfd325c7b55f8ad338e0238ad570bbe9ffac9e834b1f274feaa WatchSource:0}: Error finding container 8408e7ebce187bfd325c7b55f8ad338e0238ad570bbe9ffac9e834b1f274feaa: Status 404 returned error can't find the container with id 8408e7ebce187bfd325c7b55f8ad338e0238ad570bbe9ffac9e834b1f274feaa
Jul 05 13:17:01.054129 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:17:01.054093    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8577fc5b84-9b7wp"]
Jul 05 13:17:01.057839 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:17:01.057808    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod579a484b_b10c_482b_8a8c_336afc4c5f9b.slice/crio-23cf1c6124a308e8e71b24d3e883a0886fd6315151603351d9aa128ff2f38902 WatchSource:0}: Error finding container 23cf1c6124a308e8e71b24d3e883a0886fd6315151603351d9aa128ff2f38902: Status 404 returned error can't find the container with id 23cf1c6124a308e8e71b24d3e883a0886fd6315151603351d9aa128ff2f38902
Jul 05 13:17:01.721260 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:17:01.721208    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8577fc5b84-9b7wp" event={"ID":"579a484b-b10c-482b-8a8c-336afc4c5f9b","Type":"ContainerStarted","Data":"23cf1c6124a308e8e71b24d3e883a0886fd6315151603351d9aa128ff2f38902"}
Jul 05 13:17:01.722470 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:17:01.722441    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d97d64b76-9p7zr" event={"ID":"275fedac-9db0-40c0-a314-768b2488de87","Type":"ContainerStarted","Data":"8408e7ebce187bfd325c7b55f8ad338e0238ad570bbe9ffac9e834b1f274feaa"}
Jul 05 13:17:02.645475 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:17:02.645443    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-2bmk6"
Jul 05 13:17:06.739413 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:17:06.739378    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8577fc5b84-9b7wp" event={"ID":"579a484b-b10c-482b-8a8c-336afc4c5f9b","Type":"ContainerStarted","Data":"7a4ace41bdc1af12ba723ca68707ef39ed9f08bc86e40127bf4648e339ecbd23"}
Jul 05 13:17:06.739886 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:17:06.739429    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8577fc5b84-9b7wp" event={"ID":"579a484b-b10c-482b-8a8c-336afc4c5f9b","Type":"ContainerStarted","Data":"aba89ff4dca5f38190a59e1e851fff05e8f31104fece8c074ec0b2f62dded7de"}
Jul 05 13:17:06.739886 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:17:06.739447    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8577fc5b84-9b7wp" event={"ID":"579a484b-b10c-482b-8a8c-336afc4c5f9b","Type":"ContainerStarted","Data":"58843373c0733c4186ec224047c17b754810bc386b52005d4d35a993bf560771"}
Jul 05 13:17:06.740869 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:17:06.740842    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d97d64b76-9p7zr" event={"ID":"275fedac-9db0-40c0-a314-768b2488de87","Type":"ContainerStarted","Data":"b0936c345f1d296b6fddd0993fd882437de5841125c9b603641f88fb611a80bb"}
Jul 05 13:17:06.740972 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:17:06.740895    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d97d64b76-9p7zr"
Jul 05 13:17:06.742678 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:17:06.742653    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d97d64b76-9p7zr"
Jul 05 13:17:06.758043 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:17:06.758000    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8577fc5b84-9b7wp" podStartSLOduration=1.655687623 podStartE2EDuration="6.757986099s" totalImagesPullingTime="5.102298476s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:17:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:17:06.75650647 +0000 UTC m=+106.850392106" watchObservedRunningTime="2026-07-05 13:17:06.757986099 +0000 UTC m=+106.851871723"
Jul 05 13:17:06.771160 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:17:06.771110    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d97d64b76-9p7zr" podStartSLOduration=1.614710001 podStartE2EDuration="6.77109531s" totalImagesPullingTime="5.156385309s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:17:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:17:06.770437398 +0000 UTC m=+106.864323039" watchObservedRunningTime="2026-07-05 13:17:06.77109531 +0000 UTC m=+106.864980935"
Jul 05 13:17:30.163715 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:17:30.163666    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f4539d3-5413-4b71-9c09-a9503e62c68a-metrics-certs\") pod \"network-metrics-daemon-49n5p\" (UID: \"7f4539d3-5413-4b71-9c09-a9503e62c68a\") " pod="openshift-multus/network-metrics-daemon-49n5p"
Jul 05 13:17:30.164139 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:17:30.163792    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 05 13:17:30.164139 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:17:30.163860    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f4539d3-5413-4b71-9c09-a9503e62c68a-metrics-certs podName:7f4539d3-5413-4b71-9c09-a9503e62c68a nodeName:}" failed. No retries permitted until 2026-07-05 13:19:32.163844179 +0000 UTC m=+252.257729782 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7f4539d3-5413-4b71-9c09-a9503e62c68a-metrics-certs") pod "network-metrics-daemon-49n5p" (UID: "7f4539d3-5413-4b71-9c09-a9503e62c68a") : secret "metrics-daemon-secret" not found
Jul 05 13:17:57.718281 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:17:57.718210    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-hdt6g" podUID="d3f908ac-37a8-4df4-a945-2795c28b7898"
Jul 05 13:17:57.886590 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:17:57.886559    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hdt6g"
Jul 05 13:17:59.354419 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:17:59.354360    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-49n5p" podUID="7f4539d3-5413-4b71-9c09-a9503e62c68a"
Jul 05 13:18:02.595154 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:18:02.595109    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3f908ac-37a8-4df4-a945-2795c28b7898-metrics-tls\") pod \"dns-default-hdt6g\" (UID: \"d3f908ac-37a8-4df4-a945-2795c28b7898\") " pod="openshift-dns/dns-default-hdt6g"
Jul 05 13:18:02.595700 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:18:02.595288    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 05 13:18:02.595700 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:18:02.595377    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3f908ac-37a8-4df4-a945-2795c28b7898-metrics-tls podName:d3f908ac-37a8-4df4-a945-2795c28b7898 nodeName:}" failed. No retries permitted until 2026-07-05 13:20:04.595351381 +0000 UTC m=+284.689237005 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d3f908ac-37a8-4df4-a945-2795c28b7898-metrics-tls") pod "dns-default-hdt6g" (UID: "d3f908ac-37a8-4df4-a945-2795c28b7898") : secret "dns-default-metrics-tls" not found
Jul 05 13:18:11.343108 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:18:11.343067    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-49n5p"
Jul 05 13:18:42.106426 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:18:42.106297    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:18:55.386557 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:18:55.386498    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:19:06.741950 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:06.741892    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d97d64b76-9p7zr" podUID="275fedac-9db0-40c0-a314-768b2488de87" containerName="acm-agent" probeResult="failure" output="Get \"http://10.133.0.8:8000/readyz\": dial tcp 10.133.0.8:8000: connect: connection refused"
Jul 05 13:19:07.083693 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:07.083658    2563 generic.go:356] "Generic (PLEG): container finished" podID="275fedac-9db0-40c0-a314-768b2488de87" containerID="b0936c345f1d296b6fddd0993fd882437de5841125c9b603641f88fb611a80bb" exitCode=1
Jul 05 13:19:07.083893 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:07.083734    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d97d64b76-9p7zr" event={"ID":"275fedac-9db0-40c0-a314-768b2488de87","Type":"ContainerDied","Data":"b0936c345f1d296b6fddd0993fd882437de5841125c9b603641f88fb611a80bb"}
Jul 05 13:19:07.084111 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:07.084095    2563 scope.go:117] "RemoveContainer" containerID="b0936c345f1d296b6fddd0993fd882437de5841125c9b603641f88fb611a80bb"
Jul 05 13:19:08.089440 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:08.089394    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d97d64b76-9p7zr" event={"ID":"275fedac-9db0-40c0-a314-768b2488de87","Type":"ContainerStarted","Data":"622604375bf856d6d38495b97b9e6daacabee9a40f454ffadece412eb21e8d90"}
Jul 05 13:19:08.089998 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:08.089805    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d97d64b76-9p7zr"
Jul 05 13:19:08.090511 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:08.090490    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d97d64b76-9p7zr"
Jul 05 13:19:21.446847 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:21.446808    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:19:21.551399 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:21.551368    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:19:22.946332 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:22.946299    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:19:23.044669 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:23.044640    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:19:26.089732 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:26.089694    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-9lcx7"]
Jul 05 13:19:26.092715 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:26.092698    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9lcx7"
Jul 05 13:19:26.100315 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:26.100283    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 05 13:19:26.100513 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:26.100442    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-ztcxg\""
Jul 05 13:19:26.101141 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:26.101126    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 05 13:19:26.103819 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:26.103795    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 05 13:19:26.104503 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:26.104489    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 05 13:19:26.127399 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:26.127368    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9lcx7"]
Jul 05 13:19:26.181692 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:26.181656    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/23d8f7e1-77de-4373-aef3-cc81d8e823ea-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9lcx7\" (UID: \"23d8f7e1-77de-4373-aef3-cc81d8e823ea\") " pod="openshift-insights/insights-runtime-extractor-9lcx7"
Jul 05 13:19:26.181868 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:26.181708    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/23d8f7e1-77de-4373-aef3-cc81d8e823ea-data-volume\") pod \"insights-runtime-extractor-9lcx7\" (UID: \"23d8f7e1-77de-4373-aef3-cc81d8e823ea\") " pod="openshift-insights/insights-runtime-extractor-9lcx7"
Jul 05 13:19:26.181868 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:26.181766    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qj4cd\" (UniqueName: \"kubernetes.io/projected/23d8f7e1-77de-4373-aef3-cc81d8e823ea-kube-api-access-qj4cd\") pod \"insights-runtime-extractor-9lcx7\" (UID: \"23d8f7e1-77de-4373-aef3-cc81d8e823ea\") " pod="openshift-insights/insights-runtime-extractor-9lcx7"
Jul 05 13:19:26.181868 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:26.181783    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/23d8f7e1-77de-4373-aef3-cc81d8e823ea-crio-socket\") pod \"insights-runtime-extractor-9lcx7\" (UID: \"23d8f7e1-77de-4373-aef3-cc81d8e823ea\") " pod="openshift-insights/insights-runtime-extractor-9lcx7"
Jul 05 13:19:26.181868 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:26.181802    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/23d8f7e1-77de-4373-aef3-cc81d8e823ea-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9lcx7\" (UID: \"23d8f7e1-77de-4373-aef3-cc81d8e823ea\") " pod="openshift-insights/insights-runtime-extractor-9lcx7"
Jul 05 13:19:26.220664 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:26.220633    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:19:26.282660 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:26.282629    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/23d8f7e1-77de-4373-aef3-cc81d8e823ea-data-volume\") pod \"insights-runtime-extractor-9lcx7\" (UID: \"23d8f7e1-77de-4373-aef3-cc81d8e823ea\") " pod="openshift-insights/insights-runtime-extractor-9lcx7"
Jul 05 13:19:26.282812 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:26.282684    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qj4cd\" (UniqueName: \"kubernetes.io/projected/23d8f7e1-77de-4373-aef3-cc81d8e823ea-kube-api-access-qj4cd\") pod \"insights-runtime-extractor-9lcx7\" (UID: \"23d8f7e1-77de-4373-aef3-cc81d8e823ea\") " pod="openshift-insights/insights-runtime-extractor-9lcx7"
Jul 05 13:19:26.282812 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:26.282706    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/23d8f7e1-77de-4373-aef3-cc81d8e823ea-crio-socket\") pod \"insights-runtime-extractor-9lcx7\" (UID: \"23d8f7e1-77de-4373-aef3-cc81d8e823ea\") " pod="openshift-insights/insights-runtime-extractor-9lcx7"
Jul 05 13:19:26.282812 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:26.282724    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/23d8f7e1-77de-4373-aef3-cc81d8e823ea-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9lcx7\" (UID: \"23d8f7e1-77de-4373-aef3-cc81d8e823ea\") " pod="openshift-insights/insights-runtime-extractor-9lcx7"
Jul 05 13:19:26.282812 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:26.282754    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/23d8f7e1-77de-4373-aef3-cc81d8e823ea-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9lcx7\" (UID: \"23d8f7e1-77de-4373-aef3-cc81d8e823ea\") " pod="openshift-insights/insights-runtime-extractor-9lcx7"
Jul 05 13:19:26.283016 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:19:26.282819    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 05 13:19:26.283016 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:19:26.282861    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 05 13:19:26.283016 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:19:26.282886    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/23d8f7e1-77de-4373-aef3-cc81d8e823ea-kube-rbac-proxy-cm podName:23d8f7e1-77de-4373-aef3-cc81d8e823ea nodeName:}" failed. No retries permitted until 2026-07-05 13:19:26.782871992 +0000 UTC m=+246.876757595 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/23d8f7e1-77de-4373-aef3-cc81d8e823ea-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9lcx7" (UID: "23d8f7e1-77de-4373-aef3-cc81d8e823ea") : configmap "kube-rbac-proxy" not found
Jul 05 13:19:26.283016 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:26.282821    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/23d8f7e1-77de-4373-aef3-cc81d8e823ea-crio-socket\") pod \"insights-runtime-extractor-9lcx7\" (UID: \"23d8f7e1-77de-4373-aef3-cc81d8e823ea\") " pod="openshift-insights/insights-runtime-extractor-9lcx7"
Jul 05 13:19:26.283016 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:19:26.282919    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23d8f7e1-77de-4373-aef3-cc81d8e823ea-insights-runtime-extractor-tls podName:23d8f7e1-77de-4373-aef3-cc81d8e823ea nodeName:}" failed. No retries permitted until 2026-07-05 13:19:26.782904855 +0000 UTC m=+246.876790458 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/23d8f7e1-77de-4373-aef3-cc81d8e823ea-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9lcx7" (UID: "23d8f7e1-77de-4373-aef3-cc81d8e823ea") : secret "insights-runtime-extractor-tls" not found
Jul 05 13:19:26.283016 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:26.283004    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/23d8f7e1-77de-4373-aef3-cc81d8e823ea-data-volume\") pod \"insights-runtime-extractor-9lcx7\" (UID: \"23d8f7e1-77de-4373-aef3-cc81d8e823ea\") " pod="openshift-insights/insights-runtime-extractor-9lcx7"
Jul 05 13:19:26.295012 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:26.294976    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qj4cd\" (UniqueName: \"kubernetes.io/projected/23d8f7e1-77de-4373-aef3-cc81d8e823ea-kube-api-access-qj4cd\") pod \"insights-runtime-extractor-9lcx7\" (UID: \"23d8f7e1-77de-4373-aef3-cc81d8e823ea\") " pod="openshift-insights/insights-runtime-extractor-9lcx7"
Jul 05 13:19:26.386871 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:26.386787    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:19:26.787002 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:26.786970    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/23d8f7e1-77de-4373-aef3-cc81d8e823ea-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9lcx7\" (UID: \"23d8f7e1-77de-4373-aef3-cc81d8e823ea\") " pod="openshift-insights/insights-runtime-extractor-9lcx7"
Jul 05 13:19:26.787176 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:26.787021    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/23d8f7e1-77de-4373-aef3-cc81d8e823ea-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9lcx7\" (UID: \"23d8f7e1-77de-4373-aef3-cc81d8e823ea\") " pod="openshift-insights/insights-runtime-extractor-9lcx7"
Jul 05 13:19:26.787176 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:19:26.787097    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 05 13:19:26.787176 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:19:26.787126    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 05 13:19:26.787176 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:19:26.787156    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/23d8f7e1-77de-4373-aef3-cc81d8e823ea-kube-rbac-proxy-cm podName:23d8f7e1-77de-4373-aef3-cc81d8e823ea nodeName:}" failed. No retries permitted until 2026-07-05 13:19:27.787142659 +0000 UTC m=+247.881028262 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/23d8f7e1-77de-4373-aef3-cc81d8e823ea-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9lcx7" (UID: "23d8f7e1-77de-4373-aef3-cc81d8e823ea") : configmap "kube-rbac-proxy" not found
Jul 05 13:19:26.787176 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:19:26.787178    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23d8f7e1-77de-4373-aef3-cc81d8e823ea-insights-runtime-extractor-tls podName:23d8f7e1-77de-4373-aef3-cc81d8e823ea nodeName:}" failed. No retries permitted until 2026-07-05 13:19:27.787164179 +0000 UTC m=+247.881049785 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/23d8f7e1-77de-4373-aef3-cc81d8e823ea-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9lcx7" (UID: "23d8f7e1-77de-4373-aef3-cc81d8e823ea") : secret "insights-runtime-extractor-tls" not found
Jul 05 13:19:27.112333 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:27.112252    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:19:27.361697 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:27.361635    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:19:27.639473 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:27.639431    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:19:27.787794 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:27.787760    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:19:27.795804 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:27.795781    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/23d8f7e1-77de-4373-aef3-cc81d8e823ea-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9lcx7\" (UID: \"23d8f7e1-77de-4373-aef3-cc81d8e823ea\") " pod="openshift-insights/insights-runtime-extractor-9lcx7"
Jul 05 13:19:27.795885 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:27.795869    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/23d8f7e1-77de-4373-aef3-cc81d8e823ea-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9lcx7\" (UID: \"23d8f7e1-77de-4373-aef3-cc81d8e823ea\") " pod="openshift-insights/insights-runtime-extractor-9lcx7"
Jul 05 13:19:27.795922 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:19:27.795899    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 05 13:19:27.795965 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:19:27.795956    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/23d8f7e1-77de-4373-aef3-cc81d8e823ea-kube-rbac-proxy-cm podName:23d8f7e1-77de-4373-aef3-cc81d8e823ea nodeName:}" failed. No retries permitted until 2026-07-05 13:19:29.795942251 +0000 UTC m=+249.889827854 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/23d8f7e1-77de-4373-aef3-cc81d8e823ea-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9lcx7" (UID: "23d8f7e1-77de-4373-aef3-cc81d8e823ea") : configmap "kube-rbac-proxy" not found
Jul 05 13:19:27.796013 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:19:27.795969    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 05 13:19:27.796046 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:19:27.796013    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23d8f7e1-77de-4373-aef3-cc81d8e823ea-insights-runtime-extractor-tls podName:23d8f7e1-77de-4373-aef3-cc81d8e823ea nodeName:}" failed. No retries permitted until 2026-07-05 13:19:29.795996909 +0000 UTC m=+249.889882516 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/23d8f7e1-77de-4373-aef3-cc81d8e823ea-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9lcx7" (UID: "23d8f7e1-77de-4373-aef3-cc81d8e823ea") : secret "insights-runtime-extractor-tls" not found
Jul 05 13:19:27.923540 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:27.923454    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:19:28.291489 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:28.291466    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vsz6t_6b7e0654-df3e-4f31-9fee-402ee841d4ac/dns-node-resolver/0.log"
Jul 05 13:19:29.293546 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:29.293521    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-s9x2h_3d69842e-9902-40bc-a7f6-0a018acc73db/node-ca/0.log"
Jul 05 13:19:29.491257 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:29.491206    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:19:29.629080 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:29.629002    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:19:29.693492 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:29.693464    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ds4dn_66bdf923-2681-4cef-b776-988f3c4d4a5c/serve-healthcheck-canary/0.log"
Jul 05 13:19:29.812739 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:29.812708    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/23d8f7e1-77de-4373-aef3-cc81d8e823ea-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9lcx7\" (UID: \"23d8f7e1-77de-4373-aef3-cc81d8e823ea\") " pod="openshift-insights/insights-runtime-extractor-9lcx7"
Jul 05 13:19:29.812917 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:29.812765    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/23d8f7e1-77de-4373-aef3-cc81d8e823ea-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9lcx7\" (UID: \"23d8f7e1-77de-4373-aef3-cc81d8e823ea\") " pod="openshift-insights/insights-runtime-extractor-9lcx7"
Jul 05 13:19:29.812917 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:19:29.812862    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 05 13:19:29.813029 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:19:29.812928    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23d8f7e1-77de-4373-aef3-cc81d8e823ea-insights-runtime-extractor-tls podName:23d8f7e1-77de-4373-aef3-cc81d8e823ea nodeName:}" failed. No retries permitted until 2026-07-05 13:19:33.81291177 +0000 UTC m=+253.906797372 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/23d8f7e1-77de-4373-aef3-cc81d8e823ea-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9lcx7" (UID: "23d8f7e1-77de-4373-aef3-cc81d8e823ea") : secret "insights-runtime-extractor-tls" not found
Jul 05 13:19:29.813029 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:19:29.812864    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 05 13:19:29.813029 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:19:29.812965    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/23d8f7e1-77de-4373-aef3-cc81d8e823ea-kube-rbac-proxy-cm podName:23d8f7e1-77de-4373-aef3-cc81d8e823ea nodeName:}" failed. No retries permitted until 2026-07-05 13:19:33.81295591 +0000 UTC m=+253.906841514 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/23d8f7e1-77de-4373-aef3-cc81d8e823ea-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9lcx7" (UID: "23d8f7e1-77de-4373-aef3-cc81d8e823ea") : configmap "kube-rbac-proxy" not found
Jul 05 13:19:29.986709 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:29.986627    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:19:30.121508 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:30.121476    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:19:30.705684 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:30.705650    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:19:31.994237 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:31.994189    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:19:32.233692 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:32.233650    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f4539d3-5413-4b71-9c09-a9503e62c68a-metrics-certs\") pod \"network-metrics-daemon-49n5p\" (UID: \"7f4539d3-5413-4b71-9c09-a9503e62c68a\") " pod="openshift-multus/network-metrics-daemon-49n5p"
Jul 05 13:19:32.233872 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:19:32.233806    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 05 13:19:32.233912 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:19:32.233878    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f4539d3-5413-4b71-9c09-a9503e62c68a-metrics-certs podName:7f4539d3-5413-4b71-9c09-a9503e62c68a nodeName:}" failed. No retries permitted until 2026-07-05 13:21:34.233860457 +0000 UTC m=+374.327746064 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7f4539d3-5413-4b71-9c09-a9503e62c68a-metrics-certs") pod "network-metrics-daemon-49n5p" (UID: "7f4539d3-5413-4b71-9c09-a9503e62c68a") : secret "metrics-daemon-secret" not found
Jul 05 13:19:32.678818 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:32.678786    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:19:32.931513 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:32.931432    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:19:33.160814 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:33.160779    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:19:33.601679 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:33.601648    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:19:33.846339 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:33.846287    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/23d8f7e1-77de-4373-aef3-cc81d8e823ea-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9lcx7\" (UID: \"23d8f7e1-77de-4373-aef3-cc81d8e823ea\") " pod="openshift-insights/insights-runtime-extractor-9lcx7"
Jul 05 13:19:33.846339 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:33.846349    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/23d8f7e1-77de-4373-aef3-cc81d8e823ea-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9lcx7\" (UID: \"23d8f7e1-77de-4373-aef3-cc81d8e823ea\") " pod="openshift-insights/insights-runtime-extractor-9lcx7"
Jul 05 13:19:33.846562 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:19:33.846415    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 05 13:19:33.846562 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:19:33.846441    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 05 13:19:33.846562 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:19:33.846490    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/23d8f7e1-77de-4373-aef3-cc81d8e823ea-kube-rbac-proxy-cm podName:23d8f7e1-77de-4373-aef3-cc81d8e823ea nodeName:}" failed. No retries permitted until 2026-07-05 13:19:41.84647435 +0000 UTC m=+261.940359953 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/23d8f7e1-77de-4373-aef3-cc81d8e823ea-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9lcx7" (UID: "23d8f7e1-77de-4373-aef3-cc81d8e823ea") : configmap "kube-rbac-proxy" not found
Jul 05 13:19:33.846562 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:19:33.846505    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23d8f7e1-77de-4373-aef3-cc81d8e823ea-insights-runtime-extractor-tls podName:23d8f7e1-77de-4373-aef3-cc81d8e823ea nodeName:}" failed. No retries permitted until 2026-07-05 13:19:41.846499577 +0000 UTC m=+261.940385180 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/23d8f7e1-77de-4373-aef3-cc81d8e823ea-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9lcx7" (UID: "23d8f7e1-77de-4373-aef3-cc81d8e823ea") : secret "insights-runtime-extractor-tls" not found
Jul 05 13:19:33.908834 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:33.908754    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:19:34.847081 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:34.847051    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:19:35.117077 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:35.116973    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:19:35.340411 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:35.340360    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:19:35.544193 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:35.544164    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:19:35.701845 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:35.701813    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:19:36.539780 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:36.539745    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:19:36.702660 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:36.702623    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:19:36.853329 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:36.853246    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:19:37.126920 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:37.126808    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:19:37.327482 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:37.327447    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:19:37.507860 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:37.507749    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:19:37.923836 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:37.923792    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:19:38.585414 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:38.585381    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:19:39.146103 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:39.146052    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:19:39.299062 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:39.299030    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:19:39.473723 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:39.473620    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:19:39.683346 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:39.683314    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:19:39.896076 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:39.896046    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:19:40.892308 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:40.892275    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:19:41.128924 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:41.128891    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:19:41.266339 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:41.266250    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:19:41.487923 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:41.487895    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:19:41.706137 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:41.706106    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:19:41.907753 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:41.907710    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/23d8f7e1-77de-4373-aef3-cc81d8e823ea-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9lcx7\" (UID: \"23d8f7e1-77de-4373-aef3-cc81d8e823ea\") " pod="openshift-insights/insights-runtime-extractor-9lcx7"
Jul 05 13:19:41.908188 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:41.907762    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/23d8f7e1-77de-4373-aef3-cc81d8e823ea-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9lcx7\" (UID: \"23d8f7e1-77de-4373-aef3-cc81d8e823ea\") " pod="openshift-insights/insights-runtime-extractor-9lcx7"
Jul 05 13:19:41.908188 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:19:41.907863    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 05 13:19:41.908188 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:19:41.907935    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23d8f7e1-77de-4373-aef3-cc81d8e823ea-insights-runtime-extractor-tls podName:23d8f7e1-77de-4373-aef3-cc81d8e823ea nodeName:}" failed. No retries permitted until 2026-07-05 13:19:57.907916001 +0000 UTC m=+278.001801609 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/23d8f7e1-77de-4373-aef3-cc81d8e823ea-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9lcx7" (UID: "23d8f7e1-77de-4373-aef3-cc81d8e823ea") : secret "insights-runtime-extractor-tls" not found
Jul 05 13:19:41.908445 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:41.908428    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/23d8f7e1-77de-4373-aef3-cc81d8e823ea-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9lcx7\" (UID: \"23d8f7e1-77de-4373-aef3-cc81d8e823ea\") " pod="openshift-insights/insights-runtime-extractor-9lcx7"
Jul 05 13:19:41.952432 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:41.952359    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:19:42.668851 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:42.668813    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:19:42.898020 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:42.897987    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:19:43.090071 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:43.090044    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:19:43.285649 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:43.285614    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:19:47.236994 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:47.236963    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:19:47.355038 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:47.354993    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:19:47.434250 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:47.434200    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:19:47.608857 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:47.608829    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:19:47.704466 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:47.704435    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:19:47.920510 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:47.920431    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:19:48.026979 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:48.026940    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:19:48.135931 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:48.135899    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:19:48.361560 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:48.361530    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:19:48.568359 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:48.568322    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:19:48.737376 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:48.737273    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:19:48.971053 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:48.971021    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:19:49.112796 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:49.112761    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:19:49.369826 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:49.369717    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:19:49.631336 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:49.631236    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:19:49.864199 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:49.864147    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:19:50.920293 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:50.920256    2563 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8577fc5b84-9b7wp" podUID="579a484b-b10c-482b-8a8c-336afc4c5f9b" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 05 13:19:55.354496 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:55.354461    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:19:55.498352 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:55.498319    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:19:55.607603 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:55.607487    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:19:55.697374 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:55.697339    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:19:57.923324 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:57.923279    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/23d8f7e1-77de-4373-aef3-cc81d8e823ea-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9lcx7\" (UID: \"23d8f7e1-77de-4373-aef3-cc81d8e823ea\") " pod="openshift-insights/insights-runtime-extractor-9lcx7"
Jul 05 13:19:57.925573 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:57.925550    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/23d8f7e1-77de-4373-aef3-cc81d8e823ea-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9lcx7\" (UID: \"23d8f7e1-77de-4373-aef3-cc81d8e823ea\") " pod="openshift-insights/insights-runtime-extractor-9lcx7"
Jul 05 13:19:58.202130 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:58.202035    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9lcx7"
Jul 05 13:19:58.327539 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:58.327500    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9lcx7"]
Jul 05 13:19:58.332912 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:19:58.332887    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23d8f7e1_77de_4373_aef3_cc81d8e823ea.slice/crio-2b685dedd4dcdd5b7e592c2cd21278e89ba679db94ca41855df44f0b0eecb02a WatchSource:0}: Error finding container 2b685dedd4dcdd5b7e592c2cd21278e89ba679db94ca41855df44f0b0eecb02a: Status 404 returned error can't find the container with id 2b685dedd4dcdd5b7e592c2cd21278e89ba679db94ca41855df44f0b0eecb02a
Jul 05 13:19:59.240898 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:59.240789    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9lcx7" event={"ID":"23d8f7e1-77de-4373-aef3-cc81d8e823ea","Type":"ContainerStarted","Data":"2b685dedd4dcdd5b7e592c2cd21278e89ba679db94ca41855df44f0b0eecb02a"}
Jul 05 13:19:59.986866 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:59.985289    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-rn6hc"]
Jul 05 13:19:59.992291 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:59.992262    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-rn6hc"
Jul 05 13:19:59.998698 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:59.998667    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 05 13:19:59.998698 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:59.998690    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-k29l2\""
Jul 05 13:19:59.998985 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:19:59.998964    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 05 13:20:00.006186 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:00.006162    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-rn6hc"]
Jul 05 13:20:00.040551 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:00.040503    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnq6t\" (UniqueName: \"kubernetes.io/projected/370ad4f7-5e60-49b7-a245-d61dcf41c590-kube-api-access-rnq6t\") pod \"downloads-685bfb5f64-rn6hc\" (UID: \"370ad4f7-5e60-49b7-a245-d61dcf41c590\") " pod="openshift-console/downloads-685bfb5f64-rn6hc"
Jul 05 13:20:00.074706 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:00.074665    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-9fqtl"]
Jul 05 13:20:00.081383 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:00.081357    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-9fqtl"
Jul 05 13:20:00.085129 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:00.085095    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-s75jd\""
Jul 05 13:20:00.085129 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:00.085095    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 05 13:20:00.091671 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:00.091635    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-9fqtl"]
Jul 05 13:20:00.141907 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:00.141869    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnq6t\" (UniqueName: \"kubernetes.io/projected/370ad4f7-5e60-49b7-a245-d61dcf41c590-kube-api-access-rnq6t\") pod \"downloads-685bfb5f64-rn6hc\" (UID: \"370ad4f7-5e60-49b7-a245-d61dcf41c590\") " pod="openshift-console/downloads-685bfb5f64-rn6hc"
Jul 05 13:20:00.142089 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:00.141958    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/26c93170-d1c0-4597-8dbe-1e3213d7381c-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-9fqtl\" (UID: \"26c93170-d1c0-4597-8dbe-1e3213d7381c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-9fqtl"
Jul 05 13:20:00.151737 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:00.151708    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnq6t\" (UniqueName: \"kubernetes.io/projected/370ad4f7-5e60-49b7-a245-d61dcf41c590-kube-api-access-rnq6t\") pod \"downloads-685bfb5f64-rn6hc\" (UID: \"370ad4f7-5e60-49b7-a245-d61dcf41c590\") " pod="openshift-console/downloads-685bfb5f64-rn6hc"
Jul 05 13:20:00.242565 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:00.242487    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/26c93170-d1c0-4597-8dbe-1e3213d7381c-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-9fqtl\" (UID: \"26c93170-d1c0-4597-8dbe-1e3213d7381c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-9fqtl"
Jul 05 13:20:00.245414 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:00.245389    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/26c93170-d1c0-4597-8dbe-1e3213d7381c-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-9fqtl\" (UID: \"26c93170-d1c0-4597-8dbe-1e3213d7381c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-9fqtl"
Jul 05 13:20:00.302654 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:00.302622    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-rn6hc"
Jul 05 13:20:00.392355 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:00.392319    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-9fqtl"
Jul 05 13:20:00.887267 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:20:00.887204    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-hdt6g" podUID="d3f908ac-37a8-4df4-a945-2795c28b7898"
Jul 05 13:20:00.920008 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:00.919970    2563 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8577fc5b84-9b7wp" podUID="579a484b-b10c-482b-8a8c-336afc4c5f9b" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 05 13:20:01.247554 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:01.247479    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hdt6g"
Jul 05 13:20:02.216118 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:02.216075    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-rn6hc"]
Jul 05 13:20:02.220906 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:20:02.220877    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod370ad4f7_5e60_49b7_a245_d61dcf41c590.slice/crio-0ce64639a3e0e2065568b9b09f6bc00fc2dc4ff154f52672ad216364f7d2f69c WatchSource:0}: Error finding container 0ce64639a3e0e2065568b9b09f6bc00fc2dc4ff154f52672ad216364f7d2f69c: Status 404 returned error can't find the container with id 0ce64639a3e0e2065568b9b09f6bc00fc2dc4ff154f52672ad216364f7d2f69c
Jul 05 13:20:02.227242 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:02.227199    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-9fqtl"]
Jul 05 13:20:02.230883 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:20:02.230859    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26c93170_d1c0_4597_8dbe_1e3213d7381c.slice/crio-45adb542a4a0d466d1e7cf2233d8b9bbc289424eba282741f7fa64cee871d021 WatchSource:0}: Error finding container 45adb542a4a0d466d1e7cf2233d8b9bbc289424eba282741f7fa64cee871d021: Status 404 returned error can't find the container with id 45adb542a4a0d466d1e7cf2233d8b9bbc289424eba282741f7fa64cee871d021
Jul 05 13:20:02.252143 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:02.252112    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9lcx7" event={"ID":"23d8f7e1-77de-4373-aef3-cc81d8e823ea","Type":"ContainerStarted","Data":"cfd371f5f73bf3dfb73a94b75d62989d4007dca0b679ff920c048b54c859cfea"}
Jul 05 13:20:02.253266 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:02.253245    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-9fqtl" event={"ID":"26c93170-d1c0-4597-8dbe-1e3213d7381c","Type":"ContainerStarted","Data":"45adb542a4a0d466d1e7cf2233d8b9bbc289424eba282741f7fa64cee871d021"}
Jul 05 13:20:02.254270 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:02.254249    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-rn6hc" event={"ID":"370ad4f7-5e60-49b7-a245-d61dcf41c590","Type":"ContainerStarted","Data":"0ce64639a3e0e2065568b9b09f6bc00fc2dc4ff154f52672ad216364f7d2f69c"}
Jul 05 13:20:03.261133 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:03.261044    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9lcx7" event={"ID":"23d8f7e1-77de-4373-aef3-cc81d8e823ea","Type":"ContainerStarted","Data":"dd6715ac4bf9b076b95ae9788a32208486c5b86834937b828cfda762078a30fe"}
Jul 05 13:20:04.267632 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:04.267547    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-9fqtl" event={"ID":"26c93170-d1c0-4597-8dbe-1e3213d7381c","Type":"ContainerStarted","Data":"5155ee1fd28e2332be249fa92fd221cce4f8f254267c5a1be2f295fe97f26503"}
Jul 05 13:20:04.268118 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:04.268068    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-9fqtl"
Jul 05 13:20:04.273862 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:04.273829    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-9fqtl"
Jul 05 13:20:04.307982 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:04.307890    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-9fqtl" podStartSLOduration=2.432508451 podStartE2EDuration="4.307868952s" totalImagesPullingTime="1.875360501s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:20:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:20:04.307137907 +0000 UTC m=+284.401023534" watchObservedRunningTime="2026-07-05 13:20:04.307868952 +0000 UTC m=+284.401754582"
Jul 05 13:20:04.396458 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:04.396322    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:20:04.528829 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:04.528784    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:20:04.677520 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:04.677428    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3f908ac-37a8-4df4-a945-2795c28b7898-metrics-tls\") pod \"dns-default-hdt6g\" (UID: \"d3f908ac-37a8-4df4-a945-2795c28b7898\") " pod="openshift-dns/dns-default-hdt6g"
Jul 05 13:20:04.680606 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:04.680542    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3f908ac-37a8-4df4-a945-2795c28b7898-metrics-tls\") pod \"dns-default-hdt6g\" (UID: \"d3f908ac-37a8-4df4-a945-2795c28b7898\") " pod="openshift-dns/dns-default-hdt6g"
Jul 05 13:20:04.721382 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:04.721344    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:20:04.859064 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:04.859027    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9gzst\""
Jul 05 13:20:04.869287 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:04.869241    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hdt6g"
Jul 05 13:20:04.983485 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:04.983317    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:20:05.138500 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:05.138429    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:20:05.963097 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:05.963058    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hdt6g"]
Jul 05 13:20:05.967317 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:20:05.967283    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3f908ac_37a8_4df4_a945_2795c28b7898.slice/crio-df9aa886e7bfd8679679a34eb1d446bc9c0ba37fe4a21e0b97c4c6a6ee90d5f3 WatchSource:0}: Error finding container df9aa886e7bfd8679679a34eb1d446bc9c0ba37fe4a21e0b97c4c6a6ee90d5f3: Status 404 returned error can't find the container with id df9aa886e7bfd8679679a34eb1d446bc9c0ba37fe4a21e0b97c4c6a6ee90d5f3
Jul 05 13:20:06.277124 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:06.277036    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hdt6g" event={"ID":"d3f908ac-37a8-4df4-a945-2795c28b7898","Type":"ContainerStarted","Data":"df9aa886e7bfd8679679a34eb1d446bc9c0ba37fe4a21e0b97c4c6a6ee90d5f3"}
Jul 05 13:20:06.279407 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:06.279371    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9lcx7" event={"ID":"23d8f7e1-77de-4373-aef3-cc81d8e823ea","Type":"ContainerStarted","Data":"f4513fdd61784036c7369cc79f725e9571e5e8d10beaad1a3297199f5e2c749a"}
Jul 05 13:20:06.306988 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:06.306924    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-9lcx7" podStartSLOduration=32.918016825 podStartE2EDuration="40.306901305s" totalImagesPullingTime="7.38888448s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 13:19:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:20:06.306445098 +0000 UTC m=+286.400330725" watchObservedRunningTime="2026-07-05 13:20:06.306901305 +0000 UTC m=+286.400786916"
Jul 05 13:20:07.400549 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:07.400506    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:20:07.522775 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:07.522734    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:20:07.646442 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:07.646401    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:20:08.287722 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:08.287688    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hdt6g" event={"ID":"d3f908ac-37a8-4df4-a945-2795c28b7898","Type":"ContainerStarted","Data":"0561687f0dfa71c3daa442a3712939dd10d128183fb3e661331716dd8dd98aa3"}
Jul 05 13:20:08.287886 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:08.287739    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hdt6g" event={"ID":"d3f908ac-37a8-4df4-a945-2795c28b7898","Type":"ContainerStarted","Data":"3643be4f0350ac3b3787478c851689753edee8279193e4ae84fc3306fc90694f"}
Jul 05 13:20:08.288341 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:08.288326    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-hdt6g"
Jul 05 13:20:08.540437 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:08.540376    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:20:10.919697 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:10.919659    2563 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8577fc5b84-9b7wp" podUID="579a484b-b10c-482b-8a8c-336afc4c5f9b" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 05 13:20:10.920134 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:10.919733    2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8577fc5b84-9b7wp"
Jul 05 13:20:10.920389 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:10.920348    2563 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"7a4ace41bdc1af12ba723ca68707ef39ed9f08bc86e40127bf4648e339ecbd23"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8577fc5b84-9b7wp" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Jul 05 13:20:10.920473 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:10.920417    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8577fc5b84-9b7wp" podUID="579a484b-b10c-482b-8a8c-336afc4c5f9b" containerName="service-proxy" containerID="cri-o://7a4ace41bdc1af12ba723ca68707ef39ed9f08bc86e40127bf4648e339ecbd23" gracePeriod=30
Jul 05 13:20:11.027742 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:11.027705    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:20:11.302556 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:11.302522    2563 generic.go:356] "Generic (PLEG): container finished" podID="579a484b-b10c-482b-8a8c-336afc4c5f9b" containerID="7a4ace41bdc1af12ba723ca68707ef39ed9f08bc86e40127bf4648e339ecbd23" exitCode=2
Jul 05 13:20:11.302744 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:11.302570    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8577fc5b84-9b7wp" event={"ID":"579a484b-b10c-482b-8a8c-336afc4c5f9b","Type":"ContainerDied","Data":"7a4ace41bdc1af12ba723ca68707ef39ed9f08bc86e40127bf4648e339ecbd23"}
Jul 05 13:20:11.302744 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:11.302610    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8577fc5b84-9b7wp" event={"ID":"579a484b-b10c-482b-8a8c-336afc4c5f9b","Type":"ContainerStarted","Data":"2a9ae9c030fa4954d891aa8fb3962b684c8b171396841ffde48330ee87854723"}
Jul 05 13:20:11.351624 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:11.351561    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-hdt6g" podStartSLOduration=255.27955058 podStartE2EDuration="4m17.35153994s" totalImagesPullingTime="2.07198936s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:15:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:20:08.319377063 +0000 UTC m=+288.413262690" watchObservedRunningTime="2026-07-05 13:20:11.35153994 +0000 UTC m=+291.445425567"
Jul 05 13:20:11.356204 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:11.356160    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:20:11.595173 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:11.595051    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:20:11.641940 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:11.641908    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-x4b5q"]
Jul 05 13:20:11.645048 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:11.645024    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-x4b5q"
Jul 05 13:20:11.650183 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:11.650159    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 05 13:20:11.650350 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:11.650160    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 05 13:20:11.650350 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:11.650280    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 05 13:20:11.650350 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:11.650162    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 05 13:20:11.650522 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:11.650461    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 05 13:20:11.650803 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:11.650783    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2xspd\""
Jul 05 13:20:11.651171 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:11.651154    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 05 13:20:11.736938 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:11.736901    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6f2f0cf0-ebb3-457c-9639-11b729c957c4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x4b5q\" (UID: \"6f2f0cf0-ebb3-457c-9639-11b729c957c4\") " pod="openshift-monitoring/node-exporter-x4b5q"
Jul 05 13:20:11.737132 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:11.736949    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6f2f0cf0-ebb3-457c-9639-11b729c957c4-root\") pod \"node-exporter-x4b5q\" (UID: \"6f2f0cf0-ebb3-457c-9639-11b729c957c4\") " pod="openshift-monitoring/node-exporter-x4b5q"
Jul 05 13:20:11.737132 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:11.737020    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6f2f0cf0-ebb3-457c-9639-11b729c957c4-node-exporter-wtmp\") pod \"node-exporter-x4b5q\" (UID: \"6f2f0cf0-ebb3-457c-9639-11b729c957c4\") " pod="openshift-monitoring/node-exporter-x4b5q"
Jul 05 13:20:11.737132 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:11.737090    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6f2f0cf0-ebb3-457c-9639-11b729c957c4-sys\") pod \"node-exporter-x4b5q\" (UID: \"6f2f0cf0-ebb3-457c-9639-11b729c957c4\") " pod="openshift-monitoring/node-exporter-x4b5q"
Jul 05 13:20:11.737132 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:11.737125    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6f2f0cf0-ebb3-457c-9639-11b729c957c4-node-exporter-accelerators-collector-config\") pod \"node-exporter-x4b5q\" (UID: \"6f2f0cf0-ebb3-457c-9639-11b729c957c4\") " pod="openshift-monitoring/node-exporter-x4b5q"
Jul 05 13:20:11.737369 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:11.737173    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6f2f0cf0-ebb3-457c-9639-11b729c957c4-node-exporter-textfile\") pod \"node-exporter-x4b5q\" (UID: \"6f2f0cf0-ebb3-457c-9639-11b729c957c4\") " pod="openshift-monitoring/node-exporter-x4b5q"
Jul 05 13:20:11.737369 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:11.737200    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f2f0cf0-ebb3-457c-9639-11b729c957c4-metrics-client-ca\") pod \"node-exporter-x4b5q\" (UID: \"6f2f0cf0-ebb3-457c-9639-11b729c957c4\") " pod="openshift-monitoring/node-exporter-x4b5q"
Jul 05 13:20:11.737369 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:11.737282    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6f2f0cf0-ebb3-457c-9639-11b729c957c4-node-exporter-tls\") pod \"node-exporter-x4b5q\" (UID: \"6f2f0cf0-ebb3-457c-9639-11b729c957c4\") " pod="openshift-monitoring/node-exporter-x4b5q"
Jul 05 13:20:11.737369 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:11.737323    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dft8q\" (UniqueName: \"kubernetes.io/projected/6f2f0cf0-ebb3-457c-9639-11b729c957c4-kube-api-access-dft8q\") pod \"node-exporter-x4b5q\" (UID: \"6f2f0cf0-ebb3-457c-9639-11b729c957c4\") " pod="openshift-monitoring/node-exporter-x4b5q"
Jul 05 13:20:11.761061 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:11.761030    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:20:11.838309 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:11.838269    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6f2f0cf0-ebb3-457c-9639-11b729c957c4-node-exporter-textfile\") pod \"node-exporter-x4b5q\" (UID: \"6f2f0cf0-ebb3-457c-9639-11b729c957c4\") " pod="openshift-monitoring/node-exporter-x4b5q"
Jul 05 13:20:11.838509 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:11.838322    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f2f0cf0-ebb3-457c-9639-11b729c957c4-metrics-client-ca\") pod \"node-exporter-x4b5q\" (UID: \"6f2f0cf0-ebb3-457c-9639-11b729c957c4\") " pod="openshift-monitoring/node-exporter-x4b5q"
Jul 05 13:20:11.838509 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:11.838471    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6f2f0cf0-ebb3-457c-9639-11b729c957c4-node-exporter-tls\") pod \"node-exporter-x4b5q\" (UID: \"6f2f0cf0-ebb3-457c-9639-11b729c957c4\") " pod="openshift-monitoring/node-exporter-x4b5q"
Jul 05 13:20:11.838509 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:11.838504    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dft8q\" (UniqueName: \"kubernetes.io/projected/6f2f0cf0-ebb3-457c-9639-11b729c957c4-kube-api-access-dft8q\") pod \"node-exporter-x4b5q\" (UID: \"6f2f0cf0-ebb3-457c-9639-11b729c957c4\") " pod="openshift-monitoring/node-exporter-x4b5q"
Jul 05 13:20:11.838669 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:11.838558    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6f2f0cf0-ebb3-457c-9639-11b729c957c4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x4b5q\" (UID: \"6f2f0cf0-ebb3-457c-9639-11b729c957c4\") " pod="openshift-monitoring/node-exporter-x4b5q"
Jul 05 13:20:11.838669 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:11.838591    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6f2f0cf0-ebb3-457c-9639-11b729c957c4-root\") pod \"node-exporter-x4b5q\" (UID: \"6f2f0cf0-ebb3-457c-9639-11b729c957c4\") " pod="openshift-monitoring/node-exporter-x4b5q"
Jul 05 13:20:11.838669 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:11.838628    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6f2f0cf0-ebb3-457c-9639-11b729c957c4-node-exporter-wtmp\") pod \"node-exporter-x4b5q\" (UID: \"6f2f0cf0-ebb3-457c-9639-11b729c957c4\") " pod="openshift-monitoring/node-exporter-x4b5q"
Jul 05 13:20:11.838815 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:11.838672    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6f2f0cf0-ebb3-457c-9639-11b729c957c4-sys\") pod \"node-exporter-x4b5q\" (UID: \"6f2f0cf0-ebb3-457c-9639-11b729c957c4\") " pod="openshift-monitoring/node-exporter-x4b5q"
Jul 05 13:20:11.838815 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:11.838698    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6f2f0cf0-ebb3-457c-9639-11b729c957c4-node-exporter-textfile\") pod \"node-exporter-x4b5q\" (UID: \"6f2f0cf0-ebb3-457c-9639-11b729c957c4\") " pod="openshift-monitoring/node-exporter-x4b5q"
Jul 05 13:20:11.838815 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:11.838732    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6f2f0cf0-ebb3-457c-9639-11b729c957c4-node-exporter-accelerators-collector-config\") pod \"node-exporter-x4b5q\" (UID: \"6f2f0cf0-ebb3-457c-9639-11b729c957c4\") " pod="openshift-monitoring/node-exporter-x4b5q"
Jul 05 13:20:11.838973 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:11.838952    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f2f0cf0-ebb3-457c-9639-11b729c957c4-metrics-client-ca\") pod \"node-exporter-x4b5q\" (UID: \"6f2f0cf0-ebb3-457c-9639-11b729c957c4\") " pod="openshift-monitoring/node-exporter-x4b5q"
Jul 05 13:20:11.839251 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:11.839132    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6f2f0cf0-ebb3-457c-9639-11b729c957c4-root\") pod \"node-exporter-x4b5q\" (UID: \"6f2f0cf0-ebb3-457c-9639-11b729c957c4\") " pod="openshift-monitoring/node-exporter-x4b5q"
Jul 05 13:20:11.839251 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:11.839138    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6f2f0cf0-ebb3-457c-9639-11b729c957c4-sys\") pod \"node-exporter-x4b5q\" (UID: \"6f2f0cf0-ebb3-457c-9639-11b729c957c4\") " pod="openshift-monitoring/node-exporter-x4b5q"
Jul 05 13:20:11.839251 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:11.839190    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6f2f0cf0-ebb3-457c-9639-11b729c957c4-node-exporter-wtmp\") pod \"node-exporter-x4b5q\" (UID: \"6f2f0cf0-ebb3-457c-9639-11b729c957c4\") " pod="openshift-monitoring/node-exporter-x4b5q"
Jul 05 13:20:11.839440 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:11.839281    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6f2f0cf0-ebb3-457c-9639-11b729c957c4-node-exporter-accelerators-collector-config\") pod \"node-exporter-x4b5q\" (UID: \"6f2f0cf0-ebb3-457c-9639-11b729c957c4\") " pod="openshift-monitoring/node-exporter-x4b5q"
Jul 05 13:20:11.841311 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:11.841285    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6f2f0cf0-ebb3-457c-9639-11b729c957c4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x4b5q\" (UID: \"6f2f0cf0-ebb3-457c-9639-11b729c957c4\") " pod="openshift-monitoring/node-exporter-x4b5q"
Jul 05 13:20:11.841419 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:11.841393    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6f2f0cf0-ebb3-457c-9639-11b729c957c4-node-exporter-tls\") pod \"node-exporter-x4b5q\" (UID: \"6f2f0cf0-ebb3-457c-9639-11b729c957c4\") " pod="openshift-monitoring/node-exporter-x4b5q"
Jul 05 13:20:11.859747 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:11.859673    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dft8q\" (UniqueName: \"kubernetes.io/projected/6f2f0cf0-ebb3-457c-9639-11b729c957c4-kube-api-access-dft8q\") pod \"node-exporter-x4b5q\" (UID: \"6f2f0cf0-ebb3-457c-9639-11b729c957c4\") " pod="openshift-monitoring/node-exporter-x4b5q"
Jul 05 13:20:11.955074 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:11.955041    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-x4b5q"
Jul 05 13:20:11.956701 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:11.956669    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:20:12.170885 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:12.170788    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:20:12.501098 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:12.500998    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:20:12.783621 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:12.783590    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:20:13.391101 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:13.391072    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:20:14.344278 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:20:14.344236    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-49n5p" podUID="7f4539d3-5413-4b71-9c09-a9503e62c68a"
Jul 05 13:20:15.114810 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:15.114759    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:20:15.261504 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:15.261473    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:20:15.388135 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:15.388052    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:20:15.781463 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:15.781432    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7b769b59b-xnhn5"]
Jul 05 13:20:15.785513 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:15.785488    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7b769b59b-xnhn5"
Jul 05 13:20:15.789849 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:15.789826    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 05 13:20:15.790256 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:15.790209    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 05 13:20:15.790362 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:15.790338    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 05 13:20:15.790418 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:15.790393    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 05 13:20:15.790621 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:15.790601    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-hv9hx\""
Jul 05 13:20:15.790919 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:15.790901    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-f134j8enkfltu\""
Jul 05 13:20:15.791012 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:15.790963    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 05 13:20:15.802714 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:15.802687    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7b769b59b-xnhn5"]
Jul 05 13:20:15.876573 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:15.876530    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/92d3b75f-05b2-4f2a-8da5-052c79d99748-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7b769b59b-xnhn5\" (UID: \"92d3b75f-05b2-4f2a-8da5-052c79d99748\") " pod="openshift-monitoring/thanos-querier-7b769b59b-xnhn5"
Jul 05 13:20:15.876755 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:15.876619    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/92d3b75f-05b2-4f2a-8da5-052c79d99748-secret-grpc-tls\") pod \"thanos-querier-7b769b59b-xnhn5\" (UID: \"92d3b75f-05b2-4f2a-8da5-052c79d99748\") " pod="openshift-monitoring/thanos-querier-7b769b59b-xnhn5"
Jul 05 13:20:15.876755 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:15.876659    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/92d3b75f-05b2-4f2a-8da5-052c79d99748-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7b769b59b-xnhn5\" (UID: \"92d3b75f-05b2-4f2a-8da5-052c79d99748\") " pod="openshift-monitoring/thanos-querier-7b769b59b-xnhn5"
Jul 05 13:20:15.876755 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:15.876686    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/92d3b75f-05b2-4f2a-8da5-052c79d99748-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7b769b59b-xnhn5\" (UID: \"92d3b75f-05b2-4f2a-8da5-052c79d99748\") " pod="openshift-monitoring/thanos-querier-7b769b59b-xnhn5"
Jul 05 13:20:15.876755 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:15.876710    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92d3b75f-05b2-4f2a-8da5-052c79d99748-metrics-client-ca\") pod \"thanos-querier-7b769b59b-xnhn5\" (UID: \"92d3b75f-05b2-4f2a-8da5-052c79d99748\") " pod="openshift-monitoring/thanos-querier-7b769b59b-xnhn5"
Jul 05 13:20:15.876932 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:15.876754    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcn9k\" (UniqueName: \"kubernetes.io/projected/92d3b75f-05b2-4f2a-8da5-052c79d99748-kube-api-access-xcn9k\") pod \"thanos-querier-7b769b59b-xnhn5\" (UID: \"92d3b75f-05b2-4f2a-8da5-052c79d99748\") " pod="openshift-monitoring/thanos-querier-7b769b59b-xnhn5"
Jul 05 13:20:15.876932 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:15.876792    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/92d3b75f-05b2-4f2a-8da5-052c79d99748-secret-thanos-querier-tls\") pod \"thanos-querier-7b769b59b-xnhn5\" (UID: \"92d3b75f-05b2-4f2a-8da5-052c79d99748\") " pod="openshift-monitoring/thanos-querier-7b769b59b-xnhn5"
Jul 05 13:20:15.876932 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:15.876820    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/92d3b75f-05b2-4f2a-8da5-052c79d99748-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7b769b59b-xnhn5\" (UID: \"92d3b75f-05b2-4f2a-8da5-052c79d99748\") " pod="openshift-monitoring/thanos-querier-7b769b59b-xnhn5"
Jul 05 13:20:15.978299 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:15.978261    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/92d3b75f-05b2-4f2a-8da5-052c79d99748-secret-grpc-tls\") pod \"thanos-querier-7b769b59b-xnhn5\" (UID: \"92d3b75f-05b2-4f2a-8da5-052c79d99748\") " pod="openshift-monitoring/thanos-querier-7b769b59b-xnhn5"
Jul 05 13:20:15.978496 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:15.978325    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/92d3b75f-05b2-4f2a-8da5-052c79d99748-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7b769b59b-xnhn5\" (UID: \"92d3b75f-05b2-4f2a-8da5-052c79d99748\") " pod="openshift-monitoring/thanos-querier-7b769b59b-xnhn5"
Jul 05 13:20:15.978496 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:15.978355    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/92d3b75f-05b2-4f2a-8da5-052c79d99748-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7b769b59b-xnhn5\" (UID: \"92d3b75f-05b2-4f2a-8da5-052c79d99748\") " pod="openshift-monitoring/thanos-querier-7b769b59b-xnhn5"
Jul 05 13:20:15.978496 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:15.978378    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92d3b75f-05b2-4f2a-8da5-052c79d99748-metrics-client-ca\") pod \"thanos-querier-7b769b59b-xnhn5\" (UID: \"92d3b75f-05b2-4f2a-8da5-052c79d99748\") " pod="openshift-monitoring/thanos-querier-7b769b59b-xnhn5"
Jul 05 13:20:15.978671 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:15.978534    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcn9k\" (UniqueName: \"kubernetes.io/projected/92d3b75f-05b2-4f2a-8da5-052c79d99748-kube-api-access-xcn9k\") pod \"thanos-querier-7b769b59b-xnhn5\" (UID: \"92d3b75f-05b2-4f2a-8da5-052c79d99748\") " pod="openshift-monitoring/thanos-querier-7b769b59b-xnhn5"
Jul 05 13:20:15.978671 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:15.978589    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/92d3b75f-05b2-4f2a-8da5-052c79d99748-secret-thanos-querier-tls\") pod \"thanos-querier-7b769b59b-xnhn5\" (UID: \"92d3b75f-05b2-4f2a-8da5-052c79d99748\") " pod="openshift-monitoring/thanos-querier-7b769b59b-xnhn5"
Jul 05 13:20:15.978671 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:15.978615    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/92d3b75f-05b2-4f2a-8da5-052c79d99748-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7b769b59b-xnhn5\" (UID: \"92d3b75f-05b2-4f2a-8da5-052c79d99748\") " pod="openshift-monitoring/thanos-querier-7b769b59b-xnhn5"
Jul 05 13:20:15.978822 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:15.978672    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/92d3b75f-05b2-4f2a-8da5-052c79d99748-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7b769b59b-xnhn5\" (UID: \"92d3b75f-05b2-4f2a-8da5-052c79d99748\") " pod="openshift-monitoring/thanos-querier-7b769b59b-xnhn5"
Jul 05 13:20:15.979334 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:15.979280    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92d3b75f-05b2-4f2a-8da5-052c79d99748-metrics-client-ca\") pod \"thanos-querier-7b769b59b-xnhn5\" (UID: \"92d3b75f-05b2-4f2a-8da5-052c79d99748\") " pod="openshift-monitoring/thanos-querier-7b769b59b-xnhn5"
Jul 05 13:20:15.981531 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:15.981457    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/92d3b75f-05b2-4f2a-8da5-052c79d99748-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7b769b59b-xnhn5\" (UID: \"92d3b75f-05b2-4f2a-8da5-052c79d99748\") " pod="openshift-monitoring/thanos-querier-7b769b59b-xnhn5"
Jul 05 13:20:15.981531 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:15.981504    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/92d3b75f-05b2-4f2a-8da5-052c79d99748-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7b769b59b-xnhn5\" (UID: \"92d3b75f-05b2-4f2a-8da5-052c79d99748\") " pod="openshift-monitoring/thanos-querier-7b769b59b-xnhn5"
Jul 05 13:20:15.981871 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:15.981846    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/92d3b75f-05b2-4f2a-8da5-052c79d99748-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7b769b59b-xnhn5\" (UID: \"92d3b75f-05b2-4f2a-8da5-052c79d99748\") " pod="openshift-monitoring/thanos-querier-7b769b59b-xnhn5"
Jul 05 13:20:15.981971 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:15.981949    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/92d3b75f-05b2-4f2a-8da5-052c79d99748-secret-thanos-querier-tls\") pod \"thanos-querier-7b769b59b-xnhn5\" (UID: \"92d3b75f-05b2-4f2a-8da5-052c79d99748\") " pod="openshift-monitoring/thanos-querier-7b769b59b-xnhn5"
Jul 05 13:20:15.982069 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:15.982046    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/92d3b75f-05b2-4f2a-8da5-052c79d99748-secret-grpc-tls\") pod \"thanos-querier-7b769b59b-xnhn5\" (UID: \"92d3b75f-05b2-4f2a-8da5-052c79d99748\") " pod="openshift-monitoring/thanos-querier-7b769b59b-xnhn5"
Jul 05 13:20:15.982522 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:15.982505    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/92d3b75f-05b2-4f2a-8da5-052c79d99748-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7b769b59b-xnhn5\" (UID: \"92d3b75f-05b2-4f2a-8da5-052c79d99748\") " pod="openshift-monitoring/thanos-querier-7b769b59b-xnhn5"
Jul 05 13:20:16.014463 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:16.014425    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcn9k\" (UniqueName: \"kubernetes.io/projected/92d3b75f-05b2-4f2a-8da5-052c79d99748-kube-api-access-xcn9k\") pod \"thanos-querier-7b769b59b-xnhn5\" (UID: \"92d3b75f-05b2-4f2a-8da5-052c79d99748\") " pod="openshift-monitoring/thanos-querier-7b769b59b-xnhn5"
Jul 05 13:20:16.031276 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:16.031244    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-l2fhm"]
Jul 05 13:20:16.035904 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:16.035844    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-l2fhm"
Jul 05 13:20:16.038651 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:16.038628    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-6x9wr\""
Jul 05 13:20:16.039132 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:16.039102    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 05 13:20:16.054119 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:16.054061    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:20:16.068648 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:16.068617    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-l2fhm"]
Jul 05 13:20:16.097270 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:16.097238    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7b769b59b-xnhn5"
Jul 05 13:20:16.180777 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:16.180747    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7aacf9b6-db42-4cad-a2e1-567348e1df0d-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-l2fhm\" (UID: \"7aacf9b6-db42-4cad-a2e1-567348e1df0d\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-l2fhm"
Jul 05 13:20:16.181268 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:16.180907    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfhzf\" (UniqueName: \"kubernetes.io/projected/7aacf9b6-db42-4cad-a2e1-567348e1df0d-kube-api-access-tfhzf\") pod \"monitoring-plugin-d5dcff7cf-l2fhm\" (UID: \"7aacf9b6-db42-4cad-a2e1-567348e1df0d\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-l2fhm"
Jul 05 13:20:16.245544 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:16.245507    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:20:16.281590 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:16.281553    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfhzf\" (UniqueName: \"kubernetes.io/projected/7aacf9b6-db42-4cad-a2e1-567348e1df0d-kube-api-access-tfhzf\") pod \"monitoring-plugin-d5dcff7cf-l2fhm\" (UID: \"7aacf9b6-db42-4cad-a2e1-567348e1df0d\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-l2fhm"
Jul 05 13:20:16.281789 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:16.281619    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7aacf9b6-db42-4cad-a2e1-567348e1df0d-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-l2fhm\" (UID: \"7aacf9b6-db42-4cad-a2e1-567348e1df0d\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-l2fhm"
Jul 05 13:20:16.284522 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:16.284494    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7aacf9b6-db42-4cad-a2e1-567348e1df0d-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-l2fhm\" (UID: \"7aacf9b6-db42-4cad-a2e1-567348e1df0d\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-l2fhm"
Jul 05 13:20:16.297941 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:16.297867    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfhzf\" (UniqueName: \"kubernetes.io/projected/7aacf9b6-db42-4cad-a2e1-567348e1df0d-kube-api-access-tfhzf\") pod \"monitoring-plugin-d5dcff7cf-l2fhm\" (UID: \"7aacf9b6-db42-4cad-a2e1-567348e1df0d\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-l2fhm"
Jul 05 13:20:16.347449 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:16.347418    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-l2fhm"
Jul 05 13:20:16.464360 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:16.464327    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:20:16.853130 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:16.853099    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5d9dcf858c-p95ld"]
Jul 05 13:20:16.856440 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:16.856412    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5d9dcf858c-p95ld"
Jul 05 13:20:16.862512 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:16.862477    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-wdcfm\""
Jul 05 13:20:16.862711 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:16.862630    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 05 13:20:16.862805 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:16.862782    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 05 13:20:16.865571 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:16.865543    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 05 13:20:16.865721 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:16.865543    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 05 13:20:16.868065 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:16.868038    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 05 13:20:16.879673 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:16.879642    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 05 13:20:16.967389 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:16.967358    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5d9dcf858c-p95ld"]
Jul 05 13:20:16.987639 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:16.987608    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a0d059b-fa5f-4854-a91a-95ef161eb5bd-serving-certs-ca-bundle\") pod \"telemeter-client-5d9dcf858c-p95ld\" (UID: \"5a0d059b-fa5f-4854-a91a-95ef161eb5bd\") " pod="openshift-monitoring/telemeter-client-5d9dcf858c-p95ld"
Jul 05 13:20:16.987884 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:16.987670    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a0d059b-fa5f-4854-a91a-95ef161eb5bd-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5d9dcf858c-p95ld\" (UID: \"5a0d059b-fa5f-4854-a91a-95ef161eb5bd\") " pod="openshift-monitoring/telemeter-client-5d9dcf858c-p95ld"
Jul 05 13:20:16.987884 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:16.987702    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5a0d059b-fa5f-4854-a91a-95ef161eb5bd-secret-telemeter-client\") pod \"telemeter-client-5d9dcf858c-p95ld\" (UID: \"5a0d059b-fa5f-4854-a91a-95ef161eb5bd\") " pod="openshift-monitoring/telemeter-client-5d9dcf858c-p95ld"
Jul 05 13:20:16.987884 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:16.987732    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5a0d059b-fa5f-4854-a91a-95ef161eb5bd-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5d9dcf858c-p95ld\" (UID: \"5a0d059b-fa5f-4854-a91a-95ef161eb5bd\") " pod="openshift-monitoring/telemeter-client-5d9dcf858c-p95ld"
Jul 05 13:20:16.987884 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:16.987827    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a0d059b-fa5f-4854-a91a-95ef161eb5bd-metrics-client-ca\") pod \"telemeter-client-5d9dcf858c-p95ld\" (UID: \"5a0d059b-fa5f-4854-a91a-95ef161eb5bd\") " pod="openshift-monitoring/telemeter-client-5d9dcf858c-p95ld"
Jul 05 13:20:16.987884 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:16.987858    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmvxl\" (UniqueName: \"kubernetes.io/projected/5a0d059b-fa5f-4854-a91a-95ef161eb5bd-kube-api-access-xmvxl\") pod \"telemeter-client-5d9dcf858c-p95ld\" (UID: \"5a0d059b-fa5f-4854-a91a-95ef161eb5bd\") " pod="openshift-monitoring/telemeter-client-5d9dcf858c-p95ld"
Jul 05 13:20:16.988119 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:16.987939    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5a0d059b-fa5f-4854-a91a-95ef161eb5bd-telemeter-client-tls\") pod \"telemeter-client-5d9dcf858c-p95ld\" (UID: \"5a0d059b-fa5f-4854-a91a-95ef161eb5bd\") " pod="openshift-monitoring/telemeter-client-5d9dcf858c-p95ld"
Jul 05 13:20:16.988119 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:16.987965    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5a0d059b-fa5f-4854-a91a-95ef161eb5bd-federate-client-tls\") pod \"telemeter-client-5d9dcf858c-p95ld\" (UID: \"5a0d059b-fa5f-4854-a91a-95ef161eb5bd\") " pod="openshift-monitoring/telemeter-client-5d9dcf858c-p95ld"
Jul 05 13:20:17.088992 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:17.088951    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a0d059b-fa5f-4854-a91a-95ef161eb5bd-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5d9dcf858c-p95ld\" (UID: \"5a0d059b-fa5f-4854-a91a-95ef161eb5bd\") " pod="openshift-monitoring/telemeter-client-5d9dcf858c-p95ld"
Jul 05 13:20:17.089199 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:17.089004    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5a0d059b-fa5f-4854-a91a-95ef161eb5bd-secret-telemeter-client\") pod \"telemeter-client-5d9dcf858c-p95ld\" (UID: \"5a0d059b-fa5f-4854-a91a-95ef161eb5bd\") " pod="openshift-monitoring/telemeter-client-5d9dcf858c-p95ld"
Jul 05 13:20:17.089199 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:17.089042    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5a0d059b-fa5f-4854-a91a-95ef161eb5bd-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5d9dcf858c-p95ld\" (UID: \"5a0d059b-fa5f-4854-a91a-95ef161eb5bd\") " pod="openshift-monitoring/telemeter-client-5d9dcf858c-p95ld"
Jul 05 13:20:17.089199 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:17.089095    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a0d059b-fa5f-4854-a91a-95ef161eb5bd-metrics-client-ca\") pod \"telemeter-client-5d9dcf858c-p95ld\" (UID: \"5a0d059b-fa5f-4854-a91a-95ef161eb5bd\") " pod="openshift-monitoring/telemeter-client-5d9dcf858c-p95ld"
Jul 05 13:20:17.089199 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:17.089127    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmvxl\" (UniqueName: \"kubernetes.io/projected/5a0d059b-fa5f-4854-a91a-95ef161eb5bd-kube-api-access-xmvxl\") pod \"telemeter-client-5d9dcf858c-p95ld\" (UID: \"5a0d059b-fa5f-4854-a91a-95ef161eb5bd\") " pod="openshift-monitoring/telemeter-client-5d9dcf858c-p95ld"
Jul 05 13:20:17.089199 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:17.089175    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5a0d059b-fa5f-4854-a91a-95ef161eb5bd-telemeter-client-tls\") pod \"telemeter-client-5d9dcf858c-p95ld\" (UID: \"5a0d059b-fa5f-4854-a91a-95ef161eb5bd\") " pod="openshift-monitoring/telemeter-client-5d9dcf858c-p95ld"
Jul 05 13:20:17.089499 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:17.089200    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5a0d059b-fa5f-4854-a91a-95ef161eb5bd-federate-client-tls\") pod \"telemeter-client-5d9dcf858c-p95ld\" (UID: \"5a0d059b-fa5f-4854-a91a-95ef161eb5bd\") " pod="openshift-monitoring/telemeter-client-5d9dcf858c-p95ld"
Jul 05 13:20:17.089499 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:17.089272    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a0d059b-fa5f-4854-a91a-95ef161eb5bd-serving-certs-ca-bundle\") pod \"telemeter-client-5d9dcf858c-p95ld\" (UID: \"5a0d059b-fa5f-4854-a91a-95ef161eb5bd\") " pod="openshift-monitoring/telemeter-client-5d9dcf858c-p95ld"
Jul 05 13:20:17.090041 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:17.089993    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a0d059b-fa5f-4854-a91a-95ef161eb5bd-metrics-client-ca\") pod \"telemeter-client-5d9dcf858c-p95ld\" (UID: \"5a0d059b-fa5f-4854-a91a-95ef161eb5bd\") " pod="openshift-monitoring/telemeter-client-5d9dcf858c-p95ld"
Jul 05 13:20:17.090041 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:17.090010    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a0d059b-fa5f-4854-a91a-95ef161eb5bd-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5d9dcf858c-p95ld\" (UID: \"5a0d059b-fa5f-4854-a91a-95ef161eb5bd\") " pod="openshift-monitoring/telemeter-client-5d9dcf858c-p95ld"
Jul 05 13:20:17.090214 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:17.090067    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a0d059b-fa5f-4854-a91a-95ef161eb5bd-serving-certs-ca-bundle\") pod \"telemeter-client-5d9dcf858c-p95ld\" (UID: \"5a0d059b-fa5f-4854-a91a-95ef161eb5bd\") " pod="openshift-monitoring/telemeter-client-5d9dcf858c-p95ld"
Jul 05 13:20:17.092476 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:17.092423    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5a0d059b-fa5f-4854-a91a-95ef161eb5bd-secret-telemeter-client\") pod \"telemeter-client-5d9dcf858c-p95ld\" (UID: \"5a0d059b-fa5f-4854-a91a-95ef161eb5bd\") " pod="openshift-monitoring/telemeter-client-5d9dcf858c-p95ld"
Jul 05 13:20:17.092589 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:17.092534    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5a0d059b-fa5f-4854-a91a-95ef161eb5bd-telemeter-client-tls\") pod \"telemeter-client-5d9dcf858c-p95ld\" (UID: \"5a0d059b-fa5f-4854-a91a-95ef161eb5bd\") " pod="openshift-monitoring/telemeter-client-5d9dcf858c-p95ld"
Jul 05 13:20:17.092653 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:17.092606    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5a0d059b-fa5f-4854-a91a-95ef161eb5bd-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5d9dcf858c-p95ld\" (UID: \"5a0d059b-fa5f-4854-a91a-95ef161eb5bd\") " pod="openshift-monitoring/telemeter-client-5d9dcf858c-p95ld"
Jul 05 13:20:17.092653 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:17.092614    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5a0d059b-fa5f-4854-a91a-95ef161eb5bd-federate-client-tls\") pod \"telemeter-client-5d9dcf858c-p95ld\" (UID: \"5a0d059b-fa5f-4854-a91a-95ef161eb5bd\") " pod="openshift-monitoring/telemeter-client-5d9dcf858c-p95ld"
Jul 05 13:20:17.110694 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:17.110599    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmvxl\" (UniqueName: \"kubernetes.io/projected/5a0d059b-fa5f-4854-a91a-95ef161eb5bd-kube-api-access-xmvxl\") pod \"telemeter-client-5d9dcf858c-p95ld\" (UID: \"5a0d059b-fa5f-4854-a91a-95ef161eb5bd\") " pod="openshift-monitoring/telemeter-client-5d9dcf858c-p95ld"
Jul 05 13:20:17.169547 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:17.169514    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5d9dcf858c-p95ld"
Jul 05 13:20:18.205565 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:18.205532    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:20:18.618826 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:20:18.618785    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f2f0cf0_ebb3_457c_9639_11b729c957c4.slice/crio-ff5f74f73d0138d2f54e149a3b81b1ffaf109c79aaf1fdee367e79df11b67841 WatchSource:0}: Error finding container ff5f74f73d0138d2f54e149a3b81b1ffaf109c79aaf1fdee367e79df11b67841: Status 404 returned error can't find the container with id ff5f74f73d0138d2f54e149a3b81b1ffaf109c79aaf1fdee367e79df11b67841
Jul 05 13:20:18.790744 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:18.790643    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5d9dcf858c-p95ld"]
Jul 05 13:20:18.795094 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:20:18.795066    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a0d059b_fa5f_4854_a91a_95ef161eb5bd.slice/crio-352f6c235597a7ed2993ba6e2b8c9bc3aaa3106c13073b5970a5f9b83eec400d WatchSource:0}: Error finding container 352f6c235597a7ed2993ba6e2b8c9bc3aaa3106c13073b5970a5f9b83eec400d: Status 404 returned error can't find the container with id 352f6c235597a7ed2993ba6e2b8c9bc3aaa3106c13073b5970a5f9b83eec400d
Jul 05 13:20:18.810427 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:18.810362    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7b769b59b-xnhn5"]
Jul 05 13:20:18.813040 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:20:18.813010    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92d3b75f_05b2_4f2a_8da5_052c79d99748.slice/crio-e276701467c02b699322df92abf71d4f121735dc637b7c762bbccae90e44dd58 WatchSource:0}: Error finding container e276701467c02b699322df92abf71d4f121735dc637b7c762bbccae90e44dd58: Status 404 returned error can't find the container with id e276701467c02b699322df92abf71d4f121735dc637b7c762bbccae90e44dd58
Jul 05 13:20:18.824929 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:18.824901    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-l2fhm"]
Jul 05 13:20:18.828722 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:20:18.828694    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7aacf9b6_db42_4cad_a2e1_567348e1df0d.slice/crio-f94c882ff7f45f9dbb113bb6e5f65da64281754aa3c04f4755903055b3e25e59 WatchSource:0}: Error finding container f94c882ff7f45f9dbb113bb6e5f65da64281754aa3c04f4755903055b3e25e59: Status 404 returned error can't find the container with id f94c882ff7f45f9dbb113bb6e5f65da64281754aa3c04f4755903055b3e25e59
Jul 05 13:20:19.300515 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:19.299533    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-hdt6g"
Jul 05 13:20:19.343991 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:19.343894    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5d9dcf858c-p95ld" event={"ID":"5a0d059b-fa5f-4854-a91a-95ef161eb5bd","Type":"ContainerStarted","Data":"352f6c235597a7ed2993ba6e2b8c9bc3aaa3106c13073b5970a5f9b83eec400d"}
Jul 05 13:20:19.349247 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:19.346993    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-rn6hc" event={"ID":"370ad4f7-5e60-49b7-a245-d61dcf41c590","Type":"ContainerStarted","Data":"74be81fe95db6db228e8c04ead45afd3fef25f72391f7ad8828edd7182c509c3"}
Jul 05 13:20:19.349845 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:19.349449    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-rn6hc"
Jul 05 13:20:19.353409 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:19.353338    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-rn6hc"
Jul 05 13:20:19.355377 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:19.355287    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x4b5q" event={"ID":"6f2f0cf0-ebb3-457c-9639-11b729c957c4","Type":"ContainerStarted","Data":"ff5f74f73d0138d2f54e149a3b81b1ffaf109c79aaf1fdee367e79df11b67841"}
Jul 05 13:20:19.358873 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:19.358788    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-l2fhm" event={"ID":"7aacf9b6-db42-4cad-a2e1-567348e1df0d","Type":"ContainerStarted","Data":"f94c882ff7f45f9dbb113bb6e5f65da64281754aa3c04f4755903055b3e25e59"}
Jul 05 13:20:19.361425 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:19.361333    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b769b59b-xnhn5" event={"ID":"92d3b75f-05b2-4f2a-8da5-052c79d99748","Type":"ContainerStarted","Data":"e276701467c02b699322df92abf71d4f121735dc637b7c762bbccae90e44dd58"}
Jul 05 13:20:19.400322 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:19.399294    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-rn6hc" podStartSLOduration=3.890340718 podStartE2EDuration="20.399272632s" totalImagesPullingTime="16.508931914s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:19:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:20:19.37256939 +0000 UTC m=+299.466455033" watchObservedRunningTime="2026-07-05 13:20:19.399272632 +0000 UTC m=+299.493158259"
Jul 05 13:20:19.599183 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:19.599043    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:20:20.376091 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:20.375149    2563 generic.go:356] "Generic (PLEG): container finished" podID="6f2f0cf0-ebb3-457c-9639-11b729c957c4" containerID="55855285e8917463581e5d23accb58ac59c32717afce85976302b6106f0820fd" exitCode=0
Jul 05 13:20:20.376091 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:20.375375    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x4b5q" event={"ID":"6f2f0cf0-ebb3-457c-9639-11b729c957c4","Type":"ContainerDied","Data":"55855285e8917463581e5d23accb58ac59c32717afce85976302b6106f0820fd"}
Jul 05 13:20:22.111112 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:22.111059    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:20:22.213688 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:22.213655    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:20:22.722317 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:22.722295    2563 kubelet.go:1648] "Image garbage collection succeeded"
Jul 05 13:20:22.858356 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:22.858334    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 05 13:20:23.392204 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:23.392162    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x4b5q" event={"ID":"6f2f0cf0-ebb3-457c-9639-11b729c957c4","Type":"ContainerStarted","Data":"b20008e9f95ff2b6a72c25d6ec6fecf79994aa26c8289eae37c32b8717805d9f"}
Jul 05 13:20:23.392726 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:23.392251    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x4b5q" event={"ID":"6f2f0cf0-ebb3-457c-9639-11b729c957c4","Type":"ContainerStarted","Data":"f42b245a109670531fade65d65f14fabea15136fc3f95fc3fd81b802cdd677ed"}
Jul 05 13:20:23.394574 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:23.394542    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-l2fhm" event={"ID":"7aacf9b6-db42-4cad-a2e1-567348e1df0d","Type":"ContainerStarted","Data":"90f9b0df1629efeef2f7c549c00a8167ff0f1d61d87e11926107ce322c047524"}
Jul 05 13:20:23.395071 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:23.395051    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-l2fhm"
Jul 05 13:20:23.398851 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:23.398653    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b769b59b-xnhn5" event={"ID":"92d3b75f-05b2-4f2a-8da5-052c79d99748","Type":"ContainerStarted","Data":"149199ba60cf607778efa27096660a520b38a76df691f2fbdf062f7b90d03221"}
Jul 05 13:20:23.398851 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:23.398724    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b769b59b-xnhn5" event={"ID":"92d3b75f-05b2-4f2a-8da5-052c79d99748","Type":"ContainerStarted","Data":"d540acb2c7c8c5c97019195bfaa5fa59c7bbcd3a82553cd33dc73f725ed099cb"}
Jul 05 13:20:23.398851 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:23.398766    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b769b59b-xnhn5" event={"ID":"92d3b75f-05b2-4f2a-8da5-052c79d99748","Type":"ContainerStarted","Data":"bdb6ade7bca6aae29c4157e219753ba477d78a423cbb57810e6b98bdaf9f592a"}
Jul 05 13:20:23.401566 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:23.401439    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5d9dcf858c-p95ld" event={"ID":"5a0d059b-fa5f-4854-a91a-95ef161eb5bd","Type":"ContainerStarted","Data":"61ed5800911a08aa0f9c34d8838a7b2511a8b6605c9ec03e493e1f033040487b"}
Jul 05 13:20:23.401566 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:23.401558    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-l2fhm"
Jul 05 13:20:23.441016 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:23.440955    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-x4b5q" podStartSLOduration=11.056054036 podStartE2EDuration="12.440931658s" totalImagesPullingTime="1.271593373s" totalInitContainerRuntime="113.284249ms" isStatefulPod=true podCreationTimestamp="2026-07-05 13:20:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:20:23.419645472 +0000 UTC m=+303.513531120" watchObservedRunningTime="2026-07-05 13:20:23.440931658 +0000 UTC m=+303.534817285"
Jul 05 13:20:23.441494 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:23.441090    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-l2fhm" podStartSLOduration=4.577397366 podStartE2EDuration="8.44108434s" totalImagesPullingTime="3.863686974s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:20:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:20:23.439615756 +0000 UTC m=+303.533501382" watchObservedRunningTime="2026-07-05 13:20:23.44108434 +0000 UTC m=+303.534969943"
Jul 05 13:20:24.111735 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:24.111688    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:20:24.185445 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:24.185408    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:20:24.316359 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:24.316331    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:20:24.389925 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:24.389846    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:20:25.224413 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:25.224372    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:20:25.369279 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:25.369168    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:20:25.413611 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:25.413572    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b769b59b-xnhn5" event={"ID":"92d3b75f-05b2-4f2a-8da5-052c79d99748","Type":"ContainerStarted","Data":"d539810ed854f8af40fca1a968e7ed867ab3f280cae5d7d6261da6dc6578c2ec"}
Jul 05 13:20:25.413803 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:25.413656    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b769b59b-xnhn5" event={"ID":"92d3b75f-05b2-4f2a-8da5-052c79d99748","Type":"ContainerStarted","Data":"3180c2fa7a02ace146b543c6be526022094fda6be1fd8aa077b2963e364a0571"}
Jul 05 13:20:25.413803 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:25.413701    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b769b59b-xnhn5" event={"ID":"92d3b75f-05b2-4f2a-8da5-052c79d99748","Type":"ContainerStarted","Data":"644f2bfb0eae81fb32b6c7bf990525c4e812361074717021a78ef4386c39a1e2"}
Jul 05 13:20:25.413803 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:25.413732    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7b769b59b-xnhn5"
Jul 05 13:20:25.416198 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:25.416163    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5d9dcf858c-p95ld" event={"ID":"5a0d059b-fa5f-4854-a91a-95ef161eb5bd","Type":"ContainerStarted","Data":"7493760b4c84c598b00f541760c1a312055cbfce3b10bf1846c490171dbcefd4"}
Jul 05 13:20:25.416367 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:25.416247    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5d9dcf858c-p95ld" event={"ID":"5a0d059b-fa5f-4854-a91a-95ef161eb5bd","Type":"ContainerStarted","Data":"bd7ba4d26ad87420ea97f89b7ce25f10df3ec2f4f7253aee61e22ce7e4524628"}
Jul 05 13:20:25.440526 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:25.440470    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7b769b59b-xnhn5" podStartSLOduration=4.870459303 podStartE2EDuration="10.440451072s" totalImagesPullingTime="5.569991769s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:20:15 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:20:25.438423703 +0000 UTC m=+305.532309328" watchObservedRunningTime="2026-07-05 13:20:25.440451072 +0000 UTC m=+305.534336698"
Jul 05 13:20:25.467067 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:25.467016    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5d9dcf858c-p95ld" podStartSLOduration=3.631378297 podStartE2EDuration="9.466992792s" totalImagesPullingTime="5.835614495s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:20:16 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:20:25.463779039 +0000 UTC m=+305.557664682" watchObservedRunningTime="2026-07-05 13:20:25.466992792 +0000 UTC m=+305.560878419"
Jul 05 13:20:25.475002 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:25.474968    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:20:25.547033 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:25.546997    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:20:26.427113 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:26.427073    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:20:26.523872 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:26.523836    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:20:26.633660 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:26.633623    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:20:27.342995 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:27.342958    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-49n5p"
Jul 05 13:20:31.179946 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:31.179908    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:20:31.237230 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:31.237191    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:20:31.427280 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:31.427250    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7b769b59b-xnhn5"
Jul 05 13:20:35.210924 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:35.210867    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:20:35.271421 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:35.271391    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:20:37.303768 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:37.303737    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:20:37.405318 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:37.405285    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:20:37.508853 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:37.508818    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:20:48.486140 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:48.486108    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:20:48.548981 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:20:48.548945    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:21:28.343821 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:21:28.343735    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:21:28.425576 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:21:28.425543    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:21:29.745749 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:21:29.745717    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:21:29.802029 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:21:29.801994    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:21:32.488784 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:21:32.488752    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:21:32.590310 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:21:32.590277    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:21:34.240450 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:21:34.240412    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f4539d3-5413-4b71-9c09-a9503e62c68a-metrics-certs\") pod \"network-metrics-daemon-49n5p\" (UID: \"7f4539d3-5413-4b71-9c09-a9503e62c68a\") " pod="openshift-multus/network-metrics-daemon-49n5p"
Jul 05 13:21:34.242791 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:21:34.242764    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f4539d3-5413-4b71-9c09-a9503e62c68a-metrics-certs\") pod \"network-metrics-daemon-49n5p\" (UID: \"7f4539d3-5413-4b71-9c09-a9503e62c68a\") " pod="openshift-multus/network-metrics-daemon-49n5p"
Jul 05 13:21:34.246444 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:21:34.246426    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jgr78\""
Jul 05 13:21:34.254853 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:21:34.254829    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-49n5p"
Jul 05 13:21:34.384394 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:21:34.384363    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-49n5p"]
Jul 05 13:21:34.387297 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:21:34.387267    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f4539d3_5413_4b71_9c09_a9503e62c68a.slice/crio-5b79864e1ad93bfaa0fe9bf4d59df376a533bb5c6114174888adf52ae8db307e WatchSource:0}: Error finding container 5b79864e1ad93bfaa0fe9bf4d59df376a533bb5c6114174888adf52ae8db307e: Status 404 returned error can't find the container with id 5b79864e1ad93bfaa0fe9bf4d59df376a533bb5c6114174888adf52ae8db307e
Jul 05 13:21:34.664298 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:21:34.664257    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-49n5p" event={"ID":"7f4539d3-5413-4b71-9c09-a9503e62c68a","Type":"ContainerStarted","Data":"5b79864e1ad93bfaa0fe9bf4d59df376a533bb5c6114174888adf52ae8db307e"}
Jul 05 13:21:35.669883 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:21:35.669851    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-49n5p" event={"ID":"7f4539d3-5413-4b71-9c09-a9503e62c68a","Type":"ContainerStarted","Data":"7fbdb619c0d0a1c07c206dd3896f40ec76e479b5263f9acaafdd91de5c710f9e"}
Jul 05 13:21:35.670410 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:21:35.669910    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-49n5p" event={"ID":"7f4539d3-5413-4b71-9c09-a9503e62c68a","Type":"ContainerStarted","Data":"87e52401ca221607c7f61a7cd4b6a19f9aca4a658cdec180f27394a99533c39e"}
Jul 05 13:21:35.686192 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:21:35.686135    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-49n5p" podStartSLOduration=374.79896452 podStartE2EDuration="6m15.686113071s" totalImagesPullingTime="887.148551ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:15:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:21:35.685927393 +0000 UTC m=+375.779813045" watchObservedRunningTime="2026-07-05 13:21:35.686113071 +0000 UTC m=+375.779998697"
Jul 05 13:21:35.779932 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:21:35.779886    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:21:35.878641 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:21:35.878609    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:21:36.632710 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:21:36.632679    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:21:36.732894 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:21:36.732864    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:21:40.235747 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:21:40.235708    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:21:40.336729 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:21:40.336677    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:21:40.610151 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:21:40.610119    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:21:40.714113 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:21:40.714086    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:21:40.775805 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:21:40.775773    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:21:43.799551 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:21:43.799515    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:21:43.864502 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:21:43.864474    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:21:48.487680 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:21:48.487634    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:21:48.588007 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:21:48.587974    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:22:11.947013 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:22:11.946980    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:22:12.012117 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:22:12.012088    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:22:23.587068 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:22:23.587032    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:22:23.683770 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:22:23.683741    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:22:39.594714 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:22:39.594671    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:22:39.651547 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:22:39.651517    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:22:45.454196 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:22:45.454096    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:22:46.272013 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:22:46.271978    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:22:49.279467 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:22:49.279426    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:22:49.382977 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:22:49.382945    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:22:50.232668 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:22:50.232636    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:22:50.398281 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:22:50.398248    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:22:51.163339 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:22:51.163308    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:22:51.284622 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:22:51.284594    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:22:53.682934 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:22:53.682905    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:22:53.878289 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:22:53.878261    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:22:56.060059 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:22:56.060030    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:22:56.162061 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:22:56.162019    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:23:01.157579 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:01.157526    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:23:03.014179 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:03.014148    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:23:03.111065 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:03.111032    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:23:04.335976 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:04.335943    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-krp2d"]
Jul 05 13:23:04.338981 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:04.338964    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-krp2d"
Jul 05 13:23:04.341504 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:04.341473    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 05 13:23:04.341633 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:04.341555    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 05 13:23:04.342483 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:04.342467    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-fng2r\""
Jul 05 13:23:04.350110 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:04.350085    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-krp2d"]
Jul 05 13:23:04.415936 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:04.415900    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a55a040f-959c-498d-afb2-ae054215d9da-tmp\") pod \"openshift-lws-operator-fd8ccff4c-krp2d\" (UID: \"a55a040f-959c-498d-afb2-ae054215d9da\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-krp2d"
Jul 05 13:23:04.416091 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:04.415955    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srdx4\" (UniqueName: \"kubernetes.io/projected/a55a040f-959c-498d-afb2-ae054215d9da-kube-api-access-srdx4\") pod \"openshift-lws-operator-fd8ccff4c-krp2d\" (UID: \"a55a040f-959c-498d-afb2-ae054215d9da\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-krp2d"
Jul 05 13:23:04.516294 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:04.516259    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a55a040f-959c-498d-afb2-ae054215d9da-tmp\") pod \"openshift-lws-operator-fd8ccff4c-krp2d\" (UID: \"a55a040f-959c-498d-afb2-ae054215d9da\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-krp2d"
Jul 05 13:23:04.516405 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:04.516313    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srdx4\" (UniqueName: \"kubernetes.io/projected/a55a040f-959c-498d-afb2-ae054215d9da-kube-api-access-srdx4\") pod \"openshift-lws-operator-fd8ccff4c-krp2d\" (UID: \"a55a040f-959c-498d-afb2-ae054215d9da\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-krp2d"
Jul 05 13:23:04.516647 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:04.516627    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a55a040f-959c-498d-afb2-ae054215d9da-tmp\") pod \"openshift-lws-operator-fd8ccff4c-krp2d\" (UID: \"a55a040f-959c-498d-afb2-ae054215d9da\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-krp2d"
Jul 05 13:23:04.526117 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:04.526086    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-srdx4\" (UniqueName: \"kubernetes.io/projected/a55a040f-959c-498d-afb2-ae054215d9da-kube-api-access-srdx4\") pod \"openshift-lws-operator-fd8ccff4c-krp2d\" (UID: \"a55a040f-959c-498d-afb2-ae054215d9da\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-krp2d"
Jul 05 13:23:04.650419 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:04.650311    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-krp2d"
Jul 05 13:23:04.789001 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:04.788963    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-krp2d"]
Jul 05 13:23:04.790409 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:23:04.790379    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda55a040f_959c_498d_afb2_ae054215d9da.slice/crio-59da2fb651410ecb84604682b767d74b7532c84ae654ce6869bfe1c0d13add1b WatchSource:0}: Error finding container 59da2fb651410ecb84604682b767d74b7532c84ae654ce6869bfe1c0d13add1b: Status 404 returned error can't find the container with id 59da2fb651410ecb84604682b767d74b7532c84ae654ce6869bfe1c0d13add1b
Jul 05 13:23:04.984633 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:04.984533    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-krp2d" event={"ID":"a55a040f-959c-498d-afb2-ae054215d9da","Type":"ContainerStarted","Data":"59da2fb651410ecb84604682b767d74b7532c84ae654ce6869bfe1c0d13add1b"}
Jul 05 13:23:07.999086 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:07.999050    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-krp2d" event={"ID":"a55a040f-959c-498d-afb2-ae054215d9da","Type":"ContainerStarted","Data":"0ff195ad409db0ea870423aaeb4a19dbe332bb17e8f52b2267c542891ac89ffc"}
Jul 05 13:23:08.017428 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:08.017360    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-krp2d" podStartSLOduration=1.6610393289999998 podStartE2EDuration="4.017338998s" totalImagesPullingTime="2.356299669s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:23:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:23:08.016745268 +0000 UTC m=+468.110630894" watchObservedRunningTime="2026-07-05 13:23:08.017338998 +0000 UTC m=+468.111224641"
Jul 05 13:23:08.869395 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:08.869352    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:23:08.969788 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:08.969748    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:23:10.499764 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:10.499734    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:23:24.226681 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:24.226647    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:23:24.328411 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:24.328354    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:23:26.795548 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:26.795506    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:23:26.920542 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:26.920482    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:23:27.383979 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:27.383947    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:23:27.694149 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:27.694044    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:23:27.798693 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:27.798642    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:23:27.872287 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:27.872253    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6674ff8b4f-vkw8n"]
Jul 05 13:23:27.878775 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:27.878749    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6674ff8b4f-vkw8n"
Jul 05 13:23:27.881667 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:27.881643    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 05 13:23:27.881816 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:27.881724    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 05 13:23:27.882327 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:27.882304    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-dk7w4\""
Jul 05 13:23:27.882327 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:27.882314    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 05 13:23:27.882669 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:27.882655    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 05 13:23:27.908277 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:27.908243    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6674ff8b4f-vkw8n"]
Jul 05 13:23:27.992906 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:27.992816    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8630b1ac-6708-46b1-b8b5-27fbcff48712-manifests\") pod \"opendatahub-operator-controller-manager-6674ff8b4f-vkw8n\" (UID: \"8630b1ac-6708-46b1-b8b5-27fbcff48712\") " pod="opendatahub/opendatahub-operator-controller-manager-6674ff8b4f-vkw8n"
Jul 05 13:23:27.992906 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:27.992866    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8630b1ac-6708-46b1-b8b5-27fbcff48712-tmp\") pod \"opendatahub-operator-controller-manager-6674ff8b4f-vkw8n\" (UID: \"8630b1ac-6708-46b1-b8b5-27fbcff48712\") " pod="opendatahub/opendatahub-operator-controller-manager-6674ff8b4f-vkw8n"
Jul 05 13:23:27.993125 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:27.992927    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8630b1ac-6708-46b1-b8b5-27fbcff48712-webhook-cert\") pod \"opendatahub-operator-controller-manager-6674ff8b4f-vkw8n\" (UID: \"8630b1ac-6708-46b1-b8b5-27fbcff48712\") " pod="opendatahub/opendatahub-operator-controller-manager-6674ff8b4f-vkw8n"
Jul 05 13:23:27.993125 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:27.992957    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5d472\" (UniqueName: \"kubernetes.io/projected/8630b1ac-6708-46b1-b8b5-27fbcff48712-kube-api-access-5d472\") pod \"opendatahub-operator-controller-manager-6674ff8b4f-vkw8n\" (UID: \"8630b1ac-6708-46b1-b8b5-27fbcff48712\") " pod="opendatahub/opendatahub-operator-controller-manager-6674ff8b4f-vkw8n"
Jul 05 13:23:27.993125 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:27.992993    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8630b1ac-6708-46b1-b8b5-27fbcff48712-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6674ff8b4f-vkw8n\" (UID: \"8630b1ac-6708-46b1-b8b5-27fbcff48712\") " pod="opendatahub/opendatahub-operator-controller-manager-6674ff8b4f-vkw8n"
Jul 05 13:23:28.093884 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:28.093848    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8630b1ac-6708-46b1-b8b5-27fbcff48712-manifests\") pod \"opendatahub-operator-controller-manager-6674ff8b4f-vkw8n\" (UID: \"8630b1ac-6708-46b1-b8b5-27fbcff48712\") " pod="opendatahub/opendatahub-operator-controller-manager-6674ff8b4f-vkw8n"
Jul 05 13:23:28.094078 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:28.093894    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8630b1ac-6708-46b1-b8b5-27fbcff48712-tmp\") pod \"opendatahub-operator-controller-manager-6674ff8b4f-vkw8n\" (UID: \"8630b1ac-6708-46b1-b8b5-27fbcff48712\") " pod="opendatahub/opendatahub-operator-controller-manager-6674ff8b4f-vkw8n"
Jul 05 13:23:28.094078 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:28.093939    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8630b1ac-6708-46b1-b8b5-27fbcff48712-webhook-cert\") pod \"opendatahub-operator-controller-manager-6674ff8b4f-vkw8n\" (UID: \"8630b1ac-6708-46b1-b8b5-27fbcff48712\") " pod="opendatahub/opendatahub-operator-controller-manager-6674ff8b4f-vkw8n"
Jul 05 13:23:28.094078 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:28.093967    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5d472\" (UniqueName: \"kubernetes.io/projected/8630b1ac-6708-46b1-b8b5-27fbcff48712-kube-api-access-5d472\") pod \"opendatahub-operator-controller-manager-6674ff8b4f-vkw8n\" (UID: \"8630b1ac-6708-46b1-b8b5-27fbcff48712\") " pod="opendatahub/opendatahub-operator-controller-manager-6674ff8b4f-vkw8n"
Jul 05 13:23:28.094078 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:28.094005    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8630b1ac-6708-46b1-b8b5-27fbcff48712-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6674ff8b4f-vkw8n\" (UID: \"8630b1ac-6708-46b1-b8b5-27fbcff48712\") " pod="opendatahub/opendatahub-operator-controller-manager-6674ff8b4f-vkw8n"
Jul 05 13:23:28.094317 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:28.094241    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8630b1ac-6708-46b1-b8b5-27fbcff48712-manifests\") pod \"opendatahub-operator-controller-manager-6674ff8b4f-vkw8n\" (UID: \"8630b1ac-6708-46b1-b8b5-27fbcff48712\") " pod="opendatahub/opendatahub-operator-controller-manager-6674ff8b4f-vkw8n"
Jul 05 13:23:28.096350 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:28.096326    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8630b1ac-6708-46b1-b8b5-27fbcff48712-tmp\") pod \"opendatahub-operator-controller-manager-6674ff8b4f-vkw8n\" (UID: \"8630b1ac-6708-46b1-b8b5-27fbcff48712\") " pod="opendatahub/opendatahub-operator-controller-manager-6674ff8b4f-vkw8n"
Jul 05 13:23:28.096482 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:28.096425    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8630b1ac-6708-46b1-b8b5-27fbcff48712-webhook-cert\") pod \"opendatahub-operator-controller-manager-6674ff8b4f-vkw8n\" (UID: \"8630b1ac-6708-46b1-b8b5-27fbcff48712\") " pod="opendatahub/opendatahub-operator-controller-manager-6674ff8b4f-vkw8n"
Jul 05 13:23:28.096482 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:28.096469    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8630b1ac-6708-46b1-b8b5-27fbcff48712-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6674ff8b4f-vkw8n\" (UID: \"8630b1ac-6708-46b1-b8b5-27fbcff48712\") " pod="opendatahub/opendatahub-operator-controller-manager-6674ff8b4f-vkw8n"
Jul 05 13:23:28.105459 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:28.105433    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5d472\" (UniqueName: \"kubernetes.io/projected/8630b1ac-6708-46b1-b8b5-27fbcff48712-kube-api-access-5d472\") pod \"opendatahub-operator-controller-manager-6674ff8b4f-vkw8n\" (UID: \"8630b1ac-6708-46b1-b8b5-27fbcff48712\") " pod="opendatahub/opendatahub-operator-controller-manager-6674ff8b4f-vkw8n"
Jul 05 13:23:28.179646 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:28.179618    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:23:28.188556 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:28.188526    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6674ff8b4f-vkw8n"
Jul 05 13:23:28.320163 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:28.320129    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:23:28.332997 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:28.332968    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6674ff8b4f-vkw8n"]
Jul 05 13:23:28.336167 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:23:28.336137    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8630b1ac_6708_46b1_b8b5_27fbcff48712.slice/crio-a91bad21a39120bc61e45b958ee59a1ae8cf500b77f6768c283ab94dd21558dc WatchSource:0}: Error finding container a91bad21a39120bc61e45b958ee59a1ae8cf500b77f6768c283ab94dd21558dc: Status 404 returned error can't find the container with id a91bad21a39120bc61e45b958ee59a1ae8cf500b77f6768c283ab94dd21558dc
Jul 05 13:23:28.421683 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:28.421652    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:23:28.533039 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:28.532995    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:23:28.638403 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:28.638376    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:23:28.743066 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:28.743029    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:23:28.902078 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:28.901903    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:23:29.028703 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:29.028633    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:23:29.078771 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:29.078731    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6674ff8b4f-vkw8n" event={"ID":"8630b1ac-6708-46b1-b8b5-27fbcff48712","Type":"ContainerStarted","Data":"a91bad21a39120bc61e45b958ee59a1ae8cf500b77f6768c283ab94dd21558dc"}
Jul 05 13:23:32.092567 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:32.092532    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6674ff8b4f-vkw8n" event={"ID":"8630b1ac-6708-46b1-b8b5-27fbcff48712","Type":"ContainerStarted","Data":"8451e5f5ca6aa779d9b1320f32b96c4016d4bd5f12c257f2f1ca87e002cd22de"}
Jul 05 13:23:33.097705 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:33.097671    2563 generic.go:356] "Generic (PLEG): container finished" podID="8630b1ac-6708-46b1-b8b5-27fbcff48712" containerID="8451e5f5ca6aa779d9b1320f32b96c4016d4bd5f12c257f2f1ca87e002cd22de" exitCode=0
Jul 05 13:23:33.098153 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:33.097744    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6674ff8b4f-vkw8n" event={"ID":"8630b1ac-6708-46b1-b8b5-27fbcff48712","Type":"ContainerDied","Data":"8451e5f5ca6aa779d9b1320f32b96c4016d4bd5f12c257f2f1ca87e002cd22de"}
Jul 05 13:23:34.108291 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:34.108252    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6674ff8b4f-vkw8n" event={"ID":"8630b1ac-6708-46b1-b8b5-27fbcff48712","Type":"ContainerStarted","Data":"c65584477810c8eb83a12dc91912840405c4d43123308c66c375554b2621ad24"}
Jul 05 13:23:34.108777 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:34.108354    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6674ff8b4f-vkw8n"
Jul 05 13:23:34.138903 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:34.138848    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6674ff8b4f-vkw8n" podStartSLOduration=2.936880507 podStartE2EDuration="7.138832587s" totalImagesPullingTime="3.178955196s" totalInitContainerRuntime="1.022996884s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:23:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:23:34.137561455 +0000 UTC m=+494.231447081" watchObservedRunningTime="2026-07-05 13:23:34.138832587 +0000 UTC m=+494.232718212"
Jul 05 13:23:43.953998 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:43.953967    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:23:45.113797 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:45.113767    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6674ff8b4f-vkw8n"
Jul 05 13:23:47.390251 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:47.390210    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:23:47.781614 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:47.781589    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:23:48.393764 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:48.393733    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:23:48.481722 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:48.481692    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7bcdf4856b-4fv6n"]
Jul 05 13:23:48.484866 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:48.484845    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7bcdf4856b-4fv6n"
Jul 05 13:23:48.487722 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:48.487699    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 05 13:23:48.488454 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:48.488432    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 05 13:23:48.488454 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:48.488446    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 05 13:23:48.489084 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:48.489061    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-6mmzt\""
Jul 05 13:23:48.489195 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:48.489109    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 05 13:23:48.511033 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:48.510990    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7bcdf4856b-4fv6n"]
Jul 05 13:23:48.559148 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:48.559110    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c180d7f0-78ef-4c2a-b62f-dcfc0af24c71-tmp\") pod \"kube-auth-proxy-7bcdf4856b-4fv6n\" (UID: \"c180d7f0-78ef-4c2a-b62f-dcfc0af24c71\") " pod="openshift-ingress/kube-auth-proxy-7bcdf4856b-4fv6n"
Jul 05 13:23:48.559148 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:48.559148    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c180d7f0-78ef-4c2a-b62f-dcfc0af24c71-tls-certs\") pod \"kube-auth-proxy-7bcdf4856b-4fv6n\" (UID: \"c180d7f0-78ef-4c2a-b62f-dcfc0af24c71\") " pod="openshift-ingress/kube-auth-proxy-7bcdf4856b-4fv6n"
Jul 05 13:23:48.559387 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:48.559250    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxp7m\" (UniqueName: \"kubernetes.io/projected/c180d7f0-78ef-4c2a-b62f-dcfc0af24c71-kube-api-access-qxp7m\") pod \"kube-auth-proxy-7bcdf4856b-4fv6n\" (UID: \"c180d7f0-78ef-4c2a-b62f-dcfc0af24c71\") " pod="openshift-ingress/kube-auth-proxy-7bcdf4856b-4fv6n"
Jul 05 13:23:48.659896 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:48.659792    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxp7m\" (UniqueName: \"kubernetes.io/projected/c180d7f0-78ef-4c2a-b62f-dcfc0af24c71-kube-api-access-qxp7m\") pod \"kube-auth-proxy-7bcdf4856b-4fv6n\" (UID: \"c180d7f0-78ef-4c2a-b62f-dcfc0af24c71\") " pod="openshift-ingress/kube-auth-proxy-7bcdf4856b-4fv6n"
Jul 05 13:23:48.659896 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:48.659851    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c180d7f0-78ef-4c2a-b62f-dcfc0af24c71-tmp\") pod \"kube-auth-proxy-7bcdf4856b-4fv6n\" (UID: \"c180d7f0-78ef-4c2a-b62f-dcfc0af24c71\") " pod="openshift-ingress/kube-auth-proxy-7bcdf4856b-4fv6n"
Jul 05 13:23:48.659896 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:48.659874    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c180d7f0-78ef-4c2a-b62f-dcfc0af24c71-tls-certs\") pod \"kube-auth-proxy-7bcdf4856b-4fv6n\" (UID: \"c180d7f0-78ef-4c2a-b62f-dcfc0af24c71\") " pod="openshift-ingress/kube-auth-proxy-7bcdf4856b-4fv6n"
Jul 05 13:23:48.662122 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:48.662094    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c180d7f0-78ef-4c2a-b62f-dcfc0af24c71-tmp\") pod \"kube-auth-proxy-7bcdf4856b-4fv6n\" (UID: \"c180d7f0-78ef-4c2a-b62f-dcfc0af24c71\") " pod="openshift-ingress/kube-auth-proxy-7bcdf4856b-4fv6n"
Jul 05 13:23:48.662357 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:48.662341    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c180d7f0-78ef-4c2a-b62f-dcfc0af24c71-tls-certs\") pod \"kube-auth-proxy-7bcdf4856b-4fv6n\" (UID: \"c180d7f0-78ef-4c2a-b62f-dcfc0af24c71\") " pod="openshift-ingress/kube-auth-proxy-7bcdf4856b-4fv6n"
Jul 05 13:23:48.696233 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:48.696182    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxp7m\" (UniqueName: \"kubernetes.io/projected/c180d7f0-78ef-4c2a-b62f-dcfc0af24c71-kube-api-access-qxp7m\") pod \"kube-auth-proxy-7bcdf4856b-4fv6n\" (UID: \"c180d7f0-78ef-4c2a-b62f-dcfc0af24c71\") " pod="openshift-ingress/kube-auth-proxy-7bcdf4856b-4fv6n"
Jul 05 13:23:48.795259 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:48.795196    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7bcdf4856b-4fv6n"
Jul 05 13:23:48.854933 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:48.854903    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:23:48.862601 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:48.862574    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-mlntb"]
Jul 05 13:23:48.866136 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:48.866114    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-mlntb"
Jul 05 13:23:48.872431 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:48.872397    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 05 13:23:48.873451 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:48.873426    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-4wd4f\""
Jul 05 13:23:48.893914 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:48.893875    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-mlntb"]
Jul 05 13:23:48.952830 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:48.952730    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7bcdf4856b-4fv6n"]
Jul 05 13:23:48.955512 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:23:48.955487    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc180d7f0_78ef_4c2a_b62f_dcfc0af24c71.slice/crio-48648de423707edad7b2af74786ade12a613eb22f95d3f97b7e6fc85cc7118d1 WatchSource:0}: Error finding container 48648de423707edad7b2af74786ade12a613eb22f95d3f97b7e6fc85cc7118d1: Status 404 returned error can't find the container with id 48648de423707edad7b2af74786ade12a613eb22f95d3f97b7e6fc85cc7118d1
Jul 05 13:23:48.962956 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:48.962929    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v72gj\" (UniqueName: \"kubernetes.io/projected/b91847d8-1eb2-49b6-bf0a-fe5da4089de9-kube-api-access-v72gj\") pod \"odh-model-controller-7998c67dc4-mlntb\" (UID: \"b91847d8-1eb2-49b6-bf0a-fe5da4089de9\") " pod="opendatahub/odh-model-controller-7998c67dc4-mlntb"
Jul 05 13:23:48.963067 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:48.962988    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b91847d8-1eb2-49b6-bf0a-fe5da4089de9-cert\") pod \"odh-model-controller-7998c67dc4-mlntb\" (UID: \"b91847d8-1eb2-49b6-bf0a-fe5da4089de9\") " pod="opendatahub/odh-model-controller-7998c67dc4-mlntb"
Jul 05 13:23:49.063421 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:49.063384    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b91847d8-1eb2-49b6-bf0a-fe5da4089de9-cert\") pod \"odh-model-controller-7998c67dc4-mlntb\" (UID: \"b91847d8-1eb2-49b6-bf0a-fe5da4089de9\") " pod="opendatahub/odh-model-controller-7998c67dc4-mlntb"
Jul 05 13:23:49.063627 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:49.063451    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v72gj\" (UniqueName: \"kubernetes.io/projected/b91847d8-1eb2-49b6-bf0a-fe5da4089de9-kube-api-access-v72gj\") pod \"odh-model-controller-7998c67dc4-mlntb\" (UID: \"b91847d8-1eb2-49b6-bf0a-fe5da4089de9\") " pod="opendatahub/odh-model-controller-7998c67dc4-mlntb"
Jul 05 13:23:49.063627 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:23:49.063563    2563 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 05 13:23:49.063749 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:23:49.063640    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b91847d8-1eb2-49b6-bf0a-fe5da4089de9-cert podName:b91847d8-1eb2-49b6-bf0a-fe5da4089de9 nodeName:}" failed. No retries permitted until 2026-07-05 13:23:49.563619943 +0000 UTC m=+509.657505574 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b91847d8-1eb2-49b6-bf0a-fe5da4089de9-cert") pod "odh-model-controller-7998c67dc4-mlntb" (UID: "b91847d8-1eb2-49b6-bf0a-fe5da4089de9") : secret "odh-model-controller-webhook-cert" not found
Jul 05 13:23:49.083067 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:49.083038    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:23:49.089547 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:49.089528    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v72gj\" (UniqueName: \"kubernetes.io/projected/b91847d8-1eb2-49b6-bf0a-fe5da4089de9-kube-api-access-v72gj\") pod \"odh-model-controller-7998c67dc4-mlntb\" (UID: \"b91847d8-1eb2-49b6-bf0a-fe5da4089de9\") " pod="opendatahub/odh-model-controller-7998c67dc4-mlntb"
Jul 05 13:23:49.164404 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:49.164365    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7bcdf4856b-4fv6n" event={"ID":"c180d7f0-78ef-4c2a-b62f-dcfc0af24c71","Type":"ContainerStarted","Data":"48648de423707edad7b2af74786ade12a613eb22f95d3f97b7e6fc85cc7118d1"}
Jul 05 13:23:49.269826 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:49.269746    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:23:49.477111 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:49.477076    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:23:49.567652 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:49.567610    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b91847d8-1eb2-49b6-bf0a-fe5da4089de9-cert\") pod \"odh-model-controller-7998c67dc4-mlntb\" (UID: \"b91847d8-1eb2-49b6-bf0a-fe5da4089de9\") " pod="opendatahub/odh-model-controller-7998c67dc4-mlntb"
Jul 05 13:23:49.570036 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:49.570013    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b91847d8-1eb2-49b6-bf0a-fe5da4089de9-cert\") pod \"odh-model-controller-7998c67dc4-mlntb\" (UID: \"b91847d8-1eb2-49b6-bf0a-fe5da4089de9\") " pod="opendatahub/odh-model-controller-7998c67dc4-mlntb"
Jul 05 13:23:49.691975 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:49.691940    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:23:49.780136 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:49.780096    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-mlntb"
Jul 05 13:23:49.972390 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:49.972031    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-mlntb"]
Jul 05 13:23:49.974999 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:23:49.974966    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb91847d8_1eb2_49b6_bf0a_fe5da4089de9.slice/crio-04e6e970161e88e88db5c2c80313e6138352d0b7b1560829770eba8494498361 WatchSource:0}: Error finding container 04e6e970161e88e88db5c2c80313e6138352d0b7b1560829770eba8494498361: Status 404 returned error can't find the container with id 04e6e970161e88e88db5c2c80313e6138352d0b7b1560829770eba8494498361
Jul 05 13:23:50.171441 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:50.171352    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-mlntb" event={"ID":"b91847d8-1eb2-49b6-bf0a-fe5da4089de9","Type":"ContainerStarted","Data":"04e6e970161e88e88db5c2c80313e6138352d0b7b1560829770eba8494498361"}
Jul 05 13:23:50.840304 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:50.838817    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-qlqcv"]
Jul 05 13:23:50.842750 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:50.842725    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-qlqcv"
Jul 05 13:23:50.855748 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:50.855504    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 05 13:23:50.963012 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:50.962936    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:23:50.979602 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:50.979570    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hkrq\" (UniqueName: \"kubernetes.io/projected/f0d5a21c-1cf9-4102-b1f4-9b43e2e0842e-kube-api-access-6hkrq\") pod \"model-serving-api-54d89bd5fc-qlqcv\" (UID: \"f0d5a21c-1cf9-4102-b1f4-9b43e2e0842e\") " pod="opendatahub/model-serving-api-54d89bd5fc-qlqcv"
Jul 05 13:23:50.979602 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:50.979608    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0d5a21c-1cf9-4102-b1f4-9b43e2e0842e-tls-certs\") pod \"model-serving-api-54d89bd5fc-qlqcv\" (UID: \"f0d5a21c-1cf9-4102-b1f4-9b43e2e0842e\") " pod="opendatahub/model-serving-api-54d89bd5fc-qlqcv"
Jul 05 13:23:51.035734 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:51.035605    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-qlqcv"]
Jul 05 13:23:51.080429 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:51.080394    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hkrq\" (UniqueName: \"kubernetes.io/projected/f0d5a21c-1cf9-4102-b1f4-9b43e2e0842e-kube-api-access-6hkrq\") pod \"model-serving-api-54d89bd5fc-qlqcv\" (UID: \"f0d5a21c-1cf9-4102-b1f4-9b43e2e0842e\") " pod="opendatahub/model-serving-api-54d89bd5fc-qlqcv"
Jul 05 13:23:51.080622 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:51.080448    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0d5a21c-1cf9-4102-b1f4-9b43e2e0842e-tls-certs\") pod \"model-serving-api-54d89bd5fc-qlqcv\" (UID: \"f0d5a21c-1cf9-4102-b1f4-9b43e2e0842e\") " pod="opendatahub/model-serving-api-54d89bd5fc-qlqcv"
Jul 05 13:23:51.083981 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:51.083948    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0d5a21c-1cf9-4102-b1f4-9b43e2e0842e-tls-certs\") pod \"model-serving-api-54d89bd5fc-qlqcv\" (UID: \"f0d5a21c-1cf9-4102-b1f4-9b43e2e0842e\") " pod="opendatahub/model-serving-api-54d89bd5fc-qlqcv"
Jul 05 13:23:51.167575 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:51.167498    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hkrq\" (UniqueName: \"kubernetes.io/projected/f0d5a21c-1cf9-4102-b1f4-9b43e2e0842e-kube-api-access-6hkrq\") pod \"model-serving-api-54d89bd5fc-qlqcv\" (UID: \"f0d5a21c-1cf9-4102-b1f4-9b43e2e0842e\") " pod="opendatahub/model-serving-api-54d89bd5fc-qlqcv"
Jul 05 13:23:51.276089 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:51.276036    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:23:51.459541 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:51.459457    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-qlqcv"
Jul 05 13:23:53.152119 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:53.152084    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:23:53.163878 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:53.163847    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-qlqcv"]
Jul 05 13:23:53.170870 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:53.170843    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-rb7ns"]
Jul 05 13:23:53.174290 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:53.174269    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-rb7ns"
Jul 05 13:23:53.179908 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:23:53.179876    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"cacerts\" is forbidden: User \"system:node:ip-10-0-129-239.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-129-239.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"cacerts\"" type="*v1.Secret"
Jul 05 13:23:53.179908 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:23:53.179884    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"istiod-openshift-gateway-7574459656-rb7ns\" is forbidden: User \"system:node:ip-10-0-129-239.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-129-239.ec2.internal' and this object" podUID="55654e68-dd17-47b9-84fc-aa5055f0652d" pod="openshift-ingress/istiod-openshift-gateway-7574459656-rb7ns"
Jul 05 13:23:53.180239 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:23:53.180193    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"istiod-openshift-gateway-dockercfg-xxqqd\" is forbidden: User \"system:node:ip-10-0-129-239.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-129-239.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-xxqqd\"" type="*v1.Secret"
Jul 05 13:23:53.180443 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:23:53.180419    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"istiod-tls\" is forbidden: User \"system:node:ip-10-0-129-239.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-129-239.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" type="*v1.Secret"
Jul 05 13:23:53.181115 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:53.181011    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 05 13:23:53.186347 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:23:53.186316    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"istio-kubeconfig\" is forbidden: User \"system:node:ip-10-0-129-239.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-129-239.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" type="*v1.Secret"
Jul 05 13:23:53.187590 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:23:53.187565    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0d5a21c_1cf9_4102_b1f4_9b43e2e0842e.slice/crio-133692301be361054ea977fe8be3c51bf3301f046d1d38e97d43b1bd26553308 WatchSource:0}: Error finding container 133692301be361054ea977fe8be3c51bf3301f046d1d38e97d43b1bd26553308: Status 404 returned error can't find the container with id 133692301be361054ea977fe8be3c51bf3301f046d1d38e97d43b1bd26553308
Jul 05 13:23:53.189782 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:53.189755    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-mlntb" event={"ID":"b91847d8-1eb2-49b6-bf0a-fe5da4089de9","Type":"ContainerStarted","Data":"98e13a9d5e8a7b5419935ed2af8eca55e0f280d92b2a263923757d45cbdacdf9"}
Jul 05 13:23:53.189895 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:53.189873    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-mlntb"
Jul 05 13:23:53.191752 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:53.191730    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7bcdf4856b-4fv6n" event={"ID":"c180d7f0-78ef-4c2a-b62f-dcfc0af24c71","Type":"ContainerStarted","Data":"847652b0bf6dd72f01c228049f810945a82081a3ac16523a50e856013e92d2be"}
Jul 05 13:23:53.253645 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:53.253562    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-rb7ns"]
Jul 05 13:23:53.299515 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:53.299481    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkj4c\" (UniqueName: \"kubernetes.io/projected/55654e68-dd17-47b9-84fc-aa5055f0652d-kube-api-access-bkj4c\") pod \"istiod-openshift-gateway-7574459656-rb7ns\" (UID: \"55654e68-dd17-47b9-84fc-aa5055f0652d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rb7ns"
Jul 05 13:23:53.299727 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:53.299537    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/55654e68-dd17-47b9-84fc-aa5055f0652d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-rb7ns\" (UID: \"55654e68-dd17-47b9-84fc-aa5055f0652d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rb7ns"
Jul 05 13:23:53.299727 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:53.299559    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/55654e68-dd17-47b9-84fc-aa5055f0652d-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-rb7ns\" (UID: \"55654e68-dd17-47b9-84fc-aa5055f0652d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rb7ns"
Jul 05 13:23:53.299727 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:53.299664    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/55654e68-dd17-47b9-84fc-aa5055f0652d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-rb7ns\" (UID: \"55654e68-dd17-47b9-84fc-aa5055f0652d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rb7ns"
Jul 05 13:23:53.299727 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:53.299706    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/55654e68-dd17-47b9-84fc-aa5055f0652d-cacerts\") pod \"istiod-openshift-gateway-7574459656-rb7ns\" (UID: \"55654e68-dd17-47b9-84fc-aa5055f0652d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rb7ns"
Jul 05 13:23:53.299935 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:53.299754    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/55654e68-dd17-47b9-84fc-aa5055f0652d-local-certs\") pod \"istiod-openshift-gateway-7574459656-rb7ns\" (UID: \"55654e68-dd17-47b9-84fc-aa5055f0652d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rb7ns"
Jul 05 13:23:53.299935 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:53.299780    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/55654e68-dd17-47b9-84fc-aa5055f0652d-istio-token\") pod \"istiod-openshift-gateway-7574459656-rb7ns\" (UID: \"55654e68-dd17-47b9-84fc-aa5055f0652d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rb7ns"
Jul 05 13:23:53.380100 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:53.380042    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-mlntb" podStartSLOduration=2.327737231 podStartE2EDuration="5.38002568s" totalImagesPullingTime="3.052288449s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:23:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:23:53.379968743 +0000 UTC m=+513.473854390" watchObservedRunningTime="2026-07-05 13:23:53.38002568 +0000 UTC m=+513.473911305"
Jul 05 13:23:53.400928 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:53.400899    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/55654e68-dd17-47b9-84fc-aa5055f0652d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-rb7ns\" (UID: \"55654e68-dd17-47b9-84fc-aa5055f0652d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rb7ns"
Jul 05 13:23:53.401125 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:53.400936    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/55654e68-dd17-47b9-84fc-aa5055f0652d-cacerts\") pod \"istiod-openshift-gateway-7574459656-rb7ns\" (UID: \"55654e68-dd17-47b9-84fc-aa5055f0652d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rb7ns"
Jul 05 13:23:53.401125 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:53.400978    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/55654e68-dd17-47b9-84fc-aa5055f0652d-local-certs\") pod \"istiod-openshift-gateway-7574459656-rb7ns\" (UID: \"55654e68-dd17-47b9-84fc-aa5055f0652d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rb7ns"
Jul 05 13:23:53.401125 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:53.401002    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/55654e68-dd17-47b9-84fc-aa5055f0652d-istio-token\") pod \"istiod-openshift-gateway-7574459656-rb7ns\" (UID: \"55654e68-dd17-47b9-84fc-aa5055f0652d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rb7ns"
Jul 05 13:23:53.401125 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:53.401054    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkj4c\" (UniqueName: \"kubernetes.io/projected/55654e68-dd17-47b9-84fc-aa5055f0652d-kube-api-access-bkj4c\") pod \"istiod-openshift-gateway-7574459656-rb7ns\" (UID: \"55654e68-dd17-47b9-84fc-aa5055f0652d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rb7ns"
Jul 05 13:23:53.401125 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:53.401094    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/55654e68-dd17-47b9-84fc-aa5055f0652d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-rb7ns\" (UID: \"55654e68-dd17-47b9-84fc-aa5055f0652d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rb7ns"
Jul 05 13:23:53.401125 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:53.401118    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/55654e68-dd17-47b9-84fc-aa5055f0652d-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-rb7ns\" (UID: \"55654e68-dd17-47b9-84fc-aa5055f0652d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rb7ns"
Jul 05 13:23:53.401540 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:53.401519    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/55654e68-dd17-47b9-84fc-aa5055f0652d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-rb7ns\" (UID: \"55654e68-dd17-47b9-84fc-aa5055f0652d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rb7ns"
Jul 05 13:23:53.403164 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:53.403145    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/55654e68-dd17-47b9-84fc-aa5055f0652d-local-certs\") pod \"istiod-openshift-gateway-7574459656-rb7ns\" (UID: \"55654e68-dd17-47b9-84fc-aa5055f0652d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rb7ns"
Jul 05 13:23:53.423650 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:53.423621    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkj4c\" (UniqueName: \"kubernetes.io/projected/55654e68-dd17-47b9-84fc-aa5055f0652d-kube-api-access-bkj4c\") pod \"istiod-openshift-gateway-7574459656-rb7ns\" (UID: \"55654e68-dd17-47b9-84fc-aa5055f0652d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rb7ns"
Jul 05 13:23:53.435993 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:53.435972    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/55654e68-dd17-47b9-84fc-aa5055f0652d-istio-token\") pod \"istiod-openshift-gateway-7574459656-rb7ns\" (UID: \"55654e68-dd17-47b9-84fc-aa5055f0652d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rb7ns"
Jul 05 13:23:53.465715 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:53.465660    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7bcdf4856b-4fv6n" podStartSLOduration=1.445352272 podStartE2EDuration="5.465646281s" totalImagesPullingTime="4.020294009s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:23:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:23:53.465377922 +0000 UTC m=+513.559263546" watchObservedRunningTime="2026-07-05 13:23:53.465646281 +0000 UTC m=+513.559531925"
Jul 05 13:23:53.517111 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:53.517030    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:23:54.124904 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:54.124864    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 05 13:23:54.134624 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:54.134593    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/55654e68-dd17-47b9-84fc-aa5055f0652d-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-rb7ns\" (UID: \"55654e68-dd17-47b9-84fc-aa5055f0652d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rb7ns"
Jul 05 13:23:54.194447 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:54.194413    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 05 13:23:54.197917 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:54.197884    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-qlqcv" event={"ID":"f0d5a21c-1cf9-4102-b1f4-9b43e2e0842e","Type":"ContainerStarted","Data":"133692301be361054ea977fe8be3c51bf3301f046d1d38e97d43b1bd26553308"}
Jul 05 13:23:54.203778 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:54.203747    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/55654e68-dd17-47b9-84fc-aa5055f0652d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-rb7ns\" (UID: \"55654e68-dd17-47b9-84fc-aa5055f0652d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rb7ns"
Jul 05 13:23:54.302780 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:54.302745    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-xxqqd\""
Jul 05 13:23:54.401937 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:23:54.401851    2563 secret.go:189] Couldn't get secret openshift-ingress/cacerts: failed to sync secret cache: timed out waiting for the condition
Jul 05 13:23:54.402084 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:23:54.401943    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55654e68-dd17-47b9-84fc-aa5055f0652d-cacerts podName:55654e68-dd17-47b9-84fc-aa5055f0652d nodeName:}" failed. No retries permitted until 2026-07-05 13:23:54.901927706 +0000 UTC m=+514.995813309 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cacerts" (UniqueName: "kubernetes.io/secret/55654e68-dd17-47b9-84fc-aa5055f0652d-cacerts") pod "istiod-openshift-gateway-7574459656-rb7ns" (UID: "55654e68-dd17-47b9-84fc-aa5055f0652d") : failed to sync secret cache: timed out waiting for the condition
Jul 05 13:23:54.559733 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:54.559706    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 05 13:23:54.915341 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:54.915305    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/55654e68-dd17-47b9-84fc-aa5055f0652d-cacerts\") pod \"istiod-openshift-gateway-7574459656-rb7ns\" (UID: \"55654e68-dd17-47b9-84fc-aa5055f0652d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rb7ns"
Jul 05 13:23:54.917690 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:54.917666    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/55654e68-dd17-47b9-84fc-aa5055f0652d-cacerts\") pod \"istiod-openshift-gateway-7574459656-rb7ns\" (UID: \"55654e68-dd17-47b9-84fc-aa5055f0652d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-rb7ns"
Jul 05 13:23:54.984873 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:54.984840    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-rb7ns"
Jul 05 13:23:55.198171 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:55.198138    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-rb7ns"]
Jul 05 13:23:55.199668 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:23:55.199643    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55654e68_dd17_47b9_84fc_aa5055f0652d.slice/crio-6090fb7ea54591f2e45cc0937ce2ab72ac6126216ae12783a66eeac1a4407c43 WatchSource:0}: Error finding container 6090fb7ea54591f2e45cc0937ce2ab72ac6126216ae12783a66eeac1a4407c43: Status 404 returned error can't find the container with id 6090fb7ea54591f2e45cc0937ce2ab72ac6126216ae12783a66eeac1a4407c43
Jul 05 13:23:55.203514 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:55.203478    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-qlqcv" event={"ID":"f0d5a21c-1cf9-4102-b1f4-9b43e2e0842e","Type":"ContainerStarted","Data":"2492fca9904d863a886a373afceb120649d3619eda0e70fb2909ebe9bdab08d8"}
Jul 05 13:23:55.203605 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:55.203562    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-qlqcv"
Jul 05 13:23:55.284944 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:55.284885    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-qlqcv" podStartSLOduration=4.046023426 podStartE2EDuration="5.284869201s" totalImagesPullingTime="1.238845775s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:23:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:23:55.28403215 +0000 UTC m=+515.377917775" watchObservedRunningTime="2026-07-05 13:23:55.284869201 +0000 UTC m=+515.378754826"
Jul 05 13:23:56.212367 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:56.212327    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-rb7ns" event={"ID":"55654e68-dd17-47b9-84fc-aa5055f0652d","Type":"ContainerStarted","Data":"6090fb7ea54591f2e45cc0937ce2ab72ac6126216ae12783a66eeac1a4407c43"}
Jul 05 13:23:57.791344 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:57.791305    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 05 13:23:57.791601 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:57.791375    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 05 13:23:58.118893 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:58.118777    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:23:58.230132 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:58.230097    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-rb7ns" event={"ID":"55654e68-dd17-47b9-84fc-aa5055f0652d","Type":"ContainerStarted","Data":"19a475ee552ab4b2724a3fe4785dc6555d724456c6513625f91efd6b706dd218"}
Jul 05 13:23:58.230332 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:58.230311    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-rb7ns"
Jul 05 13:23:58.232290 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:58.232263    2563 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-rb7ns container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 05 13:23:58.232419 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:58.232310    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-rb7ns" podUID="55654e68-dd17-47b9-84fc-aa5055f0652d" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 05 13:23:58.292810 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:58.292744    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-rb7ns" podStartSLOduration=2.703835657 podStartE2EDuration="5.292722013s" totalImagesPullingTime="2.588886356s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:23:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:23:58.289964222 +0000 UTC m=+518.383849848" watchObservedRunningTime="2026-07-05 13:23:58.292722013 +0000 UTC m=+518.386607640"
Jul 05 13:23:58.971640 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:58.971604    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:23:59.235972 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:59.235891    2563 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-rb7ns container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 05 13:23:59.235972 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:59.235953    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-rb7ns" podUID="55654e68-dd17-47b9-84fc-aa5055f0652d" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 05 13:23:59.252453 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:59.252401    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:23:59.552816 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:59.552786    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:23:59.890707 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:23:59.890680    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:24:01.581849 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:01.581810    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:24:01.964171 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:01.964093    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:24:02.236366 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:02.236279    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-rb7ns"
Jul 05 13:24:02.496711 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:02.496626    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:24:02.747693 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:02.747608    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:24:03.143156 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:03.143125    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9vcsg"]
Jul 05 13:24:03.152029 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:03.152006    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9vcsg"
Jul 05 13:24:03.239273 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:03.239237    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9vcsg"]
Jul 05 13:24:03.289008 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:03.288969    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/897d1326-9bac-467f-bacd-6c9ac0f4a87c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-9vcsg\" (UID: \"897d1326-9bac-467f-bacd-6c9ac0f4a87c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9vcsg"
Jul 05 13:24:03.289205 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:03.289017    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/897d1326-9bac-467f-bacd-6c9ac0f4a87c-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-9vcsg\" (UID: \"897d1326-9bac-467f-bacd-6c9ac0f4a87c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9vcsg"
Jul 05 13:24:03.289205 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:03.289076    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h94g7\" (UniqueName: \"kubernetes.io/projected/897d1326-9bac-467f-bacd-6c9ac0f4a87c-kube-api-access-h94g7\") pod \"istiod-openshift-gateway-94bb8fbfd-9vcsg\" (UID: \"897d1326-9bac-467f-bacd-6c9ac0f4a87c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9vcsg"
Jul 05 13:24:03.289205 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:03.289120    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/897d1326-9bac-467f-bacd-6c9ac0f4a87c-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-9vcsg\" (UID: \"897d1326-9bac-467f-bacd-6c9ac0f4a87c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9vcsg"
Jul 05 13:24:03.289205 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:03.289149    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/897d1326-9bac-467f-bacd-6c9ac0f4a87c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-9vcsg\" (UID: \"897d1326-9bac-467f-bacd-6c9ac0f4a87c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9vcsg"
Jul 05 13:24:03.289205 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:03.289181    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/897d1326-9bac-467f-bacd-6c9ac0f4a87c-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-9vcsg\" (UID: \"897d1326-9bac-467f-bacd-6c9ac0f4a87c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9vcsg"
Jul 05 13:24:03.289205 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:03.289197    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/897d1326-9bac-467f-bacd-6c9ac0f4a87c-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-9vcsg\" (UID: \"897d1326-9bac-467f-bacd-6c9ac0f4a87c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9vcsg"
Jul 05 13:24:03.389934 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:03.389900    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/897d1326-9bac-467f-bacd-6c9ac0f4a87c-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-9vcsg\" (UID: \"897d1326-9bac-467f-bacd-6c9ac0f4a87c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9vcsg"
Jul 05 13:24:03.390109 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:03.389950    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h94g7\" (UniqueName: \"kubernetes.io/projected/897d1326-9bac-467f-bacd-6c9ac0f4a87c-kube-api-access-h94g7\") pod \"istiod-openshift-gateway-94bb8fbfd-9vcsg\" (UID: \"897d1326-9bac-467f-bacd-6c9ac0f4a87c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9vcsg"
Jul 05 13:24:03.390109 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:03.389989    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/897d1326-9bac-467f-bacd-6c9ac0f4a87c-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-9vcsg\" (UID: \"897d1326-9bac-467f-bacd-6c9ac0f4a87c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9vcsg"
Jul 05 13:24:03.390109 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:03.390016    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/897d1326-9bac-467f-bacd-6c9ac0f4a87c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-9vcsg\" (UID: \"897d1326-9bac-467f-bacd-6c9ac0f4a87c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9vcsg"
Jul 05 13:24:03.390109 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:03.390039    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/897d1326-9bac-467f-bacd-6c9ac0f4a87c-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-9vcsg\" (UID: \"897d1326-9bac-467f-bacd-6c9ac0f4a87c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9vcsg"
Jul 05 13:24:03.390109 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:03.390060    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/897d1326-9bac-467f-bacd-6c9ac0f4a87c-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-9vcsg\" (UID: \"897d1326-9bac-467f-bacd-6c9ac0f4a87c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9vcsg"
Jul 05 13:24:03.390426 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:03.390104    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/897d1326-9bac-467f-bacd-6c9ac0f4a87c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-9vcsg\" (UID: \"897d1326-9bac-467f-bacd-6c9ac0f4a87c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9vcsg"
Jul 05 13:24:03.391124 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:03.391095    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/897d1326-9bac-467f-bacd-6c9ac0f4a87c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-9vcsg\" (UID: \"897d1326-9bac-467f-bacd-6c9ac0f4a87c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9vcsg"
Jul 05 13:24:03.392538 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:03.392511    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/897d1326-9bac-467f-bacd-6c9ac0f4a87c-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-9vcsg\" (UID: \"897d1326-9bac-467f-bacd-6c9ac0f4a87c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9vcsg"
Jul 05 13:24:03.392637 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:03.392568    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/897d1326-9bac-467f-bacd-6c9ac0f4a87c-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-9vcsg\" (UID: \"897d1326-9bac-467f-bacd-6c9ac0f4a87c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9vcsg"
Jul 05 13:24:03.392729 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:03.392706    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/897d1326-9bac-467f-bacd-6c9ac0f4a87c-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-9vcsg\" (UID: \"897d1326-9bac-467f-bacd-6c9ac0f4a87c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9vcsg"
Jul 05 13:24:03.392837 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:03.392823    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/897d1326-9bac-467f-bacd-6c9ac0f4a87c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-9vcsg\" (UID: \"897d1326-9bac-467f-bacd-6c9ac0f4a87c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9vcsg"
Jul 05 13:24:03.420673 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:03.420593    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/897d1326-9bac-467f-bacd-6c9ac0f4a87c-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-9vcsg\" (UID: \"897d1326-9bac-467f-bacd-6c9ac0f4a87c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9vcsg"
Jul 05 13:24:03.441440 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:03.441403    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h94g7\" (UniqueName: \"kubernetes.io/projected/897d1326-9bac-467f-bacd-6c9ac0f4a87c-kube-api-access-h94g7\") pod \"istiod-openshift-gateway-94bb8fbfd-9vcsg\" (UID: \"897d1326-9bac-467f-bacd-6c9ac0f4a87c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9vcsg"
Jul 05 13:24:03.461204 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:03.461167    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9vcsg"
Jul 05 13:24:03.824067 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:03.824028    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9vcsg"]
Jul 05 13:24:03.839414 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:24:03.839383    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod897d1326_9bac_467f_bacd_6c9ac0f4a87c.slice/crio-1fa0d1ba814fbc1cb2da569d1e2d07b1bfba4168e401763302539a52c7624fe3 WatchSource:0}: Error finding container 1fa0d1ba814fbc1cb2da569d1e2d07b1bfba4168e401763302539a52c7624fe3: Status 404 returned error can't find the container with id 1fa0d1ba814fbc1cb2da569d1e2d07b1bfba4168e401763302539a52c7624fe3
Jul 05 13:24:03.842450 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:03.842410    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 05 13:24:03.842526 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:03.842487    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 05 13:24:04.200548 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:04.200457    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-mlntb"
Jul 05 13:24:04.259203 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:04.259166    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9vcsg" event={"ID":"897d1326-9bac-467f-bacd-6c9ac0f4a87c","Type":"ContainerStarted","Data":"f3f267b4f317487d7be08738ea5898e38ca679746eda41cbb55dea7446211263"}
Jul 05 13:24:04.259396 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:04.259247    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9vcsg" event={"ID":"897d1326-9bac-467f-bacd-6c9ac0f4a87c","Type":"ContainerStarted","Data":"1fa0d1ba814fbc1cb2da569d1e2d07b1bfba4168e401763302539a52c7624fe3"}
Jul 05 13:24:04.259396 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:04.259383    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9vcsg"
Jul 05 13:24:04.260907 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:04.260875    2563 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-9vcsg container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 05 13:24:04.261026 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:04.260929    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9vcsg" podUID="897d1326-9bac-467f-bacd-6c9ac0f4a87c" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 05 13:24:04.386461 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:04.386397    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9vcsg" podStartSLOduration=2.386371902 podStartE2EDuration="2.386371902s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:24:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:24:04.380605256 +0000 UTC m=+524.474490899" watchObservedRunningTime="2026-07-05 13:24:04.386371902 +0000 UTC m=+524.480257527"
Jul 05 13:24:05.263924 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:05.263887    2563 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-9vcsg container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 05 13:24:05.264402 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:05.263951    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9vcsg" podUID="897d1326-9bac-467f-bacd-6c9ac0f4a87c" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 05 13:24:05.322168 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:05.322134    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:24:05.522456 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:05.522374    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:24:05.781949 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:05.781918    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:24:06.007571 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:06.007541    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:24:06.216383 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:06.216298    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-qlqcv"
Jul 05 13:24:06.252131 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:06.252087    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:24:06.609783 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:06.609750    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:24:06.916995 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:06.916911    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:24:08.264145 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:08.264114    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9vcsg"
Jul 05 13:24:08.423109 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:08.423072    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-rb7ns"]
Jul 05 13:24:08.423329 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:08.423292    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-rb7ns" podUID="55654e68-dd17-47b9-84fc-aa5055f0652d" containerName="discovery" containerID="cri-o://19a475ee552ab4b2724a3fe4785dc6555d724456c6513625f91efd6b706dd218" gracePeriod=30
Jul 05 13:24:08.665097 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:08.665073    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-rb7ns"
Jul 05 13:24:08.837923 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:08.837831    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/55654e68-dd17-47b9-84fc-aa5055f0652d-local-certs\") pod \"55654e68-dd17-47b9-84fc-aa5055f0652d\" (UID: \"55654e68-dd17-47b9-84fc-aa5055f0652d\") "
Jul 05 13:24:08.837923 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:08.837870    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bkj4c\" (UniqueName: \"kubernetes.io/projected/55654e68-dd17-47b9-84fc-aa5055f0652d-kube-api-access-bkj4c\") pod \"55654e68-dd17-47b9-84fc-aa5055f0652d\" (UID: \"55654e68-dd17-47b9-84fc-aa5055f0652d\") "
Jul 05 13:24:08.837923 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:08.837923    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/55654e68-dd17-47b9-84fc-aa5055f0652d-istio-token\") pod \"55654e68-dd17-47b9-84fc-aa5055f0652d\" (UID: \"55654e68-dd17-47b9-84fc-aa5055f0652d\") "
Jul 05 13:24:08.838197 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:08.837961    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/55654e68-dd17-47b9-84fc-aa5055f0652d-cacerts\") pod \"55654e68-dd17-47b9-84fc-aa5055f0652d\" (UID: \"55654e68-dd17-47b9-84fc-aa5055f0652d\") "
Jul 05 13:24:08.838197 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:08.837978    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/55654e68-dd17-47b9-84fc-aa5055f0652d-istio-csr-ca-configmap\") pod \"55654e68-dd17-47b9-84fc-aa5055f0652d\" (UID: \"55654e68-dd17-47b9-84fc-aa5055f0652d\") "
Jul 05 13:24:08.838197 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:08.838009    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/55654e68-dd17-47b9-84fc-aa5055f0652d-istio-csr-dns-cert\") pod \"55654e68-dd17-47b9-84fc-aa5055f0652d\" (UID: \"55654e68-dd17-47b9-84fc-aa5055f0652d\") "
Jul 05 13:24:08.838197 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:08.838034    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/55654e68-dd17-47b9-84fc-aa5055f0652d-istio-kubeconfig\") pod \"55654e68-dd17-47b9-84fc-aa5055f0652d\" (UID: \"55654e68-dd17-47b9-84fc-aa5055f0652d\") "
Jul 05 13:24:08.838486 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:08.838453    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55654e68-dd17-47b9-84fc-aa5055f0652d-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "55654e68-dd17-47b9-84fc-aa5055f0652d" (UID: "55654e68-dd17-47b9-84fc-aa5055f0652d"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 05 13:24:08.840581 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:08.840552    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55654e68-dd17-47b9-84fc-aa5055f0652d-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "55654e68-dd17-47b9-84fc-aa5055f0652d" (UID: "55654e68-dd17-47b9-84fc-aa5055f0652d"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 05 13:24:08.840714 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:08.840672    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55654e68-dd17-47b9-84fc-aa5055f0652d-cacerts" (OuterVolumeSpecName: "cacerts") pod "55654e68-dd17-47b9-84fc-aa5055f0652d" (UID: "55654e68-dd17-47b9-84fc-aa5055f0652d"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 05 13:24:08.840714 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:08.840684    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55654e68-dd17-47b9-84fc-aa5055f0652d-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "55654e68-dd17-47b9-84fc-aa5055f0652d" (UID: "55654e68-dd17-47b9-84fc-aa5055f0652d"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 05 13:24:08.840714 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:08.840679    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55654e68-dd17-47b9-84fc-aa5055f0652d-kube-api-access-bkj4c" (OuterVolumeSpecName: "kube-api-access-bkj4c") pod "55654e68-dd17-47b9-84fc-aa5055f0652d" (UID: "55654e68-dd17-47b9-84fc-aa5055f0652d"). InnerVolumeSpecName "kube-api-access-bkj4c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 13:24:08.840824 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:08.840755    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55654e68-dd17-47b9-84fc-aa5055f0652d-local-certs" (OuterVolumeSpecName: "local-certs") pod "55654e68-dd17-47b9-84fc-aa5055f0652d" (UID: "55654e68-dd17-47b9-84fc-aa5055f0652d"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:24:08.840824 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:08.840762    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55654e68-dd17-47b9-84fc-aa5055f0652d-istio-token" (OuterVolumeSpecName: "istio-token") pod "55654e68-dd17-47b9-84fc-aa5055f0652d" (UID: "55654e68-dd17-47b9-84fc-aa5055f0652d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 13:24:08.939463 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:08.939419    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/55654e68-dd17-47b9-84fc-aa5055f0652d-istio-token\") on node \"ip-10-0-129-239.ec2.internal\" DevicePath \"\""
Jul 05 13:24:08.939463 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:08.939454    2563 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/55654e68-dd17-47b9-84fc-aa5055f0652d-cacerts\") on node \"ip-10-0-129-239.ec2.internal\" DevicePath \"\""
Jul 05 13:24:08.939463 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:08.939464    2563 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/55654e68-dd17-47b9-84fc-aa5055f0652d-istio-csr-ca-configmap\") on node \"ip-10-0-129-239.ec2.internal\" DevicePath \"\""
Jul 05 13:24:08.939463 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:08.939474    2563 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/55654e68-dd17-47b9-84fc-aa5055f0652d-istio-csr-dns-cert\") on node \"ip-10-0-129-239.ec2.internal\" DevicePath \"\""
Jul 05 13:24:08.939745 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:08.939483    2563 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/55654e68-dd17-47b9-84fc-aa5055f0652d-istio-kubeconfig\") on node \"ip-10-0-129-239.ec2.internal\" DevicePath \"\""
Jul 05 13:24:08.939745 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:08.939491    2563 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/55654e68-dd17-47b9-84fc-aa5055f0652d-local-certs\") on node \"ip-10-0-129-239.ec2.internal\" DevicePath \"\""
Jul 05 13:24:08.939745 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:08.939499    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bkj4c\" (UniqueName: \"kubernetes.io/projected/55654e68-dd17-47b9-84fc-aa5055f0652d-kube-api-access-bkj4c\") on node \"ip-10-0-129-239.ec2.internal\" DevicePath \"\""
Jul 05 13:24:09.281915 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:09.281881    2563 generic.go:356] "Generic (PLEG): container finished" podID="55654e68-dd17-47b9-84fc-aa5055f0652d" containerID="19a475ee552ab4b2724a3fe4785dc6555d724456c6513625f91efd6b706dd218" exitCode=0
Jul 05 13:24:09.282377 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:09.281931    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-rb7ns"
Jul 05 13:24:09.282377 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:09.281933    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-rb7ns" event={"ID":"55654e68-dd17-47b9-84fc-aa5055f0652d","Type":"ContainerDied","Data":"19a475ee552ab4b2724a3fe4785dc6555d724456c6513625f91efd6b706dd218"}
Jul 05 13:24:09.282377 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:09.281982    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-rb7ns" event={"ID":"55654e68-dd17-47b9-84fc-aa5055f0652d","Type":"ContainerDied","Data":"6090fb7ea54591f2e45cc0937ce2ab72ac6126216ae12783a66eeac1a4407c43"}
Jul 05 13:24:09.282377 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:09.282009    2563 scope.go:117] "RemoveContainer" containerID="19a475ee552ab4b2724a3fe4785dc6555d724456c6513625f91efd6b706dd218"
Jul 05 13:24:09.290817 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:09.290798    2563 scope.go:117] "RemoveContainer" containerID="19a475ee552ab4b2724a3fe4785dc6555d724456c6513625f91efd6b706dd218"
Jul 05 13:24:09.291073 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:24:09.291057    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19a475ee552ab4b2724a3fe4785dc6555d724456c6513625f91efd6b706dd218\": container with ID starting with 19a475ee552ab4b2724a3fe4785dc6555d724456c6513625f91efd6b706dd218 not found: ID does not exist" containerID="19a475ee552ab4b2724a3fe4785dc6555d724456c6513625f91efd6b706dd218"
Jul 05 13:24:09.291123 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:09.291082    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19a475ee552ab4b2724a3fe4785dc6555d724456c6513625f91efd6b706dd218"} err="failed to get container status \"19a475ee552ab4b2724a3fe4785dc6555d724456c6513625f91efd6b706dd218\": rpc error: code = NotFound desc = could not find container \"19a475ee552ab4b2724a3fe4785dc6555d724456c6513625f91efd6b706dd218\": container with ID starting with 19a475ee552ab4b2724a3fe4785dc6555d724456c6513625f91efd6b706dd218 not found: ID does not exist"
Jul 05 13:24:09.340173 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:09.340135    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-rb7ns"]
Jul 05 13:24:09.347883 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:09.347855    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-rb7ns"]
Jul 05 13:24:10.348328 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:10.348286    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="55654e68-dd17-47b9-84fc-aa5055f0652d" path="/var/lib/kubelet/pods/55654e68-dd17-47b9-84fc-aa5055f0652d/volumes"
Jul 05 13:24:24.489371 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:24.489339    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:24:24.667403 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:24:24.667370    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:25:06.037437 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:06.037408    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:25:06.150678 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:06.150645    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:25:09.843447 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:09.843414    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:25:09.940178 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:09.940143    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-l94kd"]
Jul 05 13:25:09.940512 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:09.940499    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55654e68-dd17-47b9-84fc-aa5055f0652d" containerName="discovery"
Jul 05 13:25:09.940562 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:09.940514    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="55654e68-dd17-47b9-84fc-aa5055f0652d" containerName="discovery"
Jul 05 13:25:09.940596 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:09.940567    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="55654e68-dd17-47b9-84fc-aa5055f0652d" containerName="discovery"
Jul 05 13:25:09.943573 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:09.943548    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-l94kd"
Jul 05 13:25:09.956689 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:09.956665    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-r4ddc\""
Jul 05 13:25:09.960310 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:09.960291    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 05 13:25:09.960956 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:09.960935    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 05 13:25:09.985006 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:09.984978    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-l94kd"]
Jul 05 13:25:10.023985 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:10.023949    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7l8b7\" (UniqueName: \"kubernetes.io/projected/ee944194-c716-40cb-a180-f4f7943ab4f2-kube-api-access-7l8b7\") pod \"kuadrant-operator-catalog-l94kd\" (UID: \"ee944194-c716-40cb-a180-f4f7943ab4f2\") " pod="kuadrant-system/kuadrant-operator-catalog-l94kd"
Jul 05 13:25:10.113132 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:10.113047    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:25:10.125228 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:10.125196    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7l8b7\" (UniqueName: \"kubernetes.io/projected/ee944194-c716-40cb-a180-f4f7943ab4f2-kube-api-access-7l8b7\") pod \"kuadrant-operator-catalog-l94kd\" (UID: \"ee944194-c716-40cb-a180-f4f7943ab4f2\") " pod="kuadrant-system/kuadrant-operator-catalog-l94kd"
Jul 05 13:25:10.138969 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:10.138943    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7l8b7\" (UniqueName: \"kubernetes.io/projected/ee944194-c716-40cb-a180-f4f7943ab4f2-kube-api-access-7l8b7\") pod \"kuadrant-operator-catalog-l94kd\" (UID: \"ee944194-c716-40cb-a180-f4f7943ab4f2\") " pod="kuadrant-system/kuadrant-operator-catalog-l94kd"
Jul 05 13:25:10.161578 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:10.161539    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-l94kd"]
Jul 05 13:25:10.161890 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:10.161872    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-l94kd"
Jul 05 13:25:10.306922 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:10.306761    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-l94kd"]
Jul 05 13:25:10.309706 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:25:10.309680    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee944194_c716_40cb_a180_f4f7943ab4f2.slice/crio-67efc4a9987e3b23c1b58d71802612702bbe97b41653e7e87b4eb94afaf9c06e WatchSource:0}: Error finding container 67efc4a9987e3b23c1b58d71802612702bbe97b41653e7e87b4eb94afaf9c06e: Status 404 returned error can't find the container with id 67efc4a9987e3b23c1b58d71802612702bbe97b41653e7e87b4eb94afaf9c06e
Jul 05 13:25:10.383383 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:10.383295    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wz7lb"]
Jul 05 13:25:10.387908 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:10.387883    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wz7lb"
Jul 05 13:25:10.399894 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:10.399867    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wz7lb"]
Jul 05 13:25:10.530212 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:10.530174    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tz7vb\" (UniqueName: \"kubernetes.io/projected/e0ce42d3-f45a-4788-ae2b-832cac2f16d1-kube-api-access-tz7vb\") pod \"kuadrant-operator-catalog-wz7lb\" (UID: \"e0ce42d3-f45a-4788-ae2b-832cac2f16d1\") " pod="kuadrant-system/kuadrant-operator-catalog-wz7lb"
Jul 05 13:25:10.542326 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:10.542291    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-l94kd" event={"ID":"ee944194-c716-40cb-a180-f4f7943ab4f2","Type":"ContainerStarted","Data":"67efc4a9987e3b23c1b58d71802612702bbe97b41653e7e87b4eb94afaf9c06e"}
Jul 05 13:25:10.631070 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:10.631037    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tz7vb\" (UniqueName: \"kubernetes.io/projected/e0ce42d3-f45a-4788-ae2b-832cac2f16d1-kube-api-access-tz7vb\") pod \"kuadrant-operator-catalog-wz7lb\" (UID: \"e0ce42d3-f45a-4788-ae2b-832cac2f16d1\") " pod="kuadrant-system/kuadrant-operator-catalog-wz7lb"
Jul 05 13:25:10.643059 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:10.642983    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tz7vb\" (UniqueName: \"kubernetes.io/projected/e0ce42d3-f45a-4788-ae2b-832cac2f16d1-kube-api-access-tz7vb\") pod \"kuadrant-operator-catalog-wz7lb\" (UID: \"e0ce42d3-f45a-4788-ae2b-832cac2f16d1\") " pod="kuadrant-system/kuadrant-operator-catalog-wz7lb"
Jul 05 13:25:10.698508 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:10.698469    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wz7lb"
Jul 05 13:25:10.878450 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:10.878313    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wz7lb"]
Jul 05 13:25:10.880901 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:25:10.880873    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0ce42d3_f45a_4788_ae2b_832cac2f16d1.slice/crio-1569c014c4d6f9fbcef1add14ee18c1629c68154bb1ce8bc5cb5261669b3336d WatchSource:0}: Error finding container 1569c014c4d6f9fbcef1add14ee18c1629c68154bb1ce8bc5cb5261669b3336d: Status 404 returned error can't find the container with id 1569c014c4d6f9fbcef1add14ee18c1629c68154bb1ce8bc5cb5261669b3336d
Jul 05 13:25:11.548463 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:11.548422    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wz7lb" event={"ID":"e0ce42d3-f45a-4788-ae2b-832cac2f16d1","Type":"ContainerStarted","Data":"1569c014c4d6f9fbcef1add14ee18c1629c68154bb1ce8bc5cb5261669b3336d"}
Jul 05 13:25:13.557904 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:13.557864    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-l94kd" event={"ID":"ee944194-c716-40cb-a180-f4f7943ab4f2","Type":"ContainerStarted","Data":"65a57fdb22af0a4cd64f828425e627da78d29521b0c51ee74f00db9f791d0e25"}
Jul 05 13:25:13.558390 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:13.557934    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-l94kd" podUID="ee944194-c716-40cb-a180-f4f7943ab4f2" containerName="registry-server" containerID="cri-o://65a57fdb22af0a4cd64f828425e627da78d29521b0c51ee74f00db9f791d0e25" gracePeriod=2
Jul 05 13:25:13.559657 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:13.559627    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wz7lb" event={"ID":"e0ce42d3-f45a-4788-ae2b-832cac2f16d1","Type":"ContainerStarted","Data":"bd961997ea48adffa68d0c0e635666a7e1dc1738453bb0b2cda0b062e46c8421"}
Jul 05 13:25:13.587787 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:13.587734    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-l94kd" podStartSLOduration=2.384928631 podStartE2EDuration="4.587717733s" totalImagesPullingTime="2.202789102s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:25:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:25:13.586515111 +0000 UTC m=+593.680400755" watchObservedRunningTime="2026-07-05 13:25:13.587717733 +0000 UTC m=+593.681603358"
Jul 05 13:25:13.615021 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:13.614953    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-wz7lb" podStartSLOduration=1.982646168 podStartE2EDuration="3.614935638s" totalImagesPullingTime="1.63228947s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:25:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:25:13.613827102 +0000 UTC m=+593.707712727" watchObservedRunningTime="2026-07-05 13:25:13.614935638 +0000 UTC m=+593.708821262"
Jul 05 13:25:13.820441 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:13.820369    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-l94kd"
Jul 05 13:25:13.960438 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:13.960399    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7l8b7\" (UniqueName: \"kubernetes.io/projected/ee944194-c716-40cb-a180-f4f7943ab4f2-kube-api-access-7l8b7\") pod \"ee944194-c716-40cb-a180-f4f7943ab4f2\" (UID: \"ee944194-c716-40cb-a180-f4f7943ab4f2\") "
Jul 05 13:25:13.962629 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:13.962598    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee944194-c716-40cb-a180-f4f7943ab4f2-kube-api-access-7l8b7" (OuterVolumeSpecName: "kube-api-access-7l8b7") pod "ee944194-c716-40cb-a180-f4f7943ab4f2" (UID: "ee944194-c716-40cb-a180-f4f7943ab4f2"). InnerVolumeSpecName "kube-api-access-7l8b7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 13:25:14.061178 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:14.061140    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7l8b7\" (UniqueName: \"kubernetes.io/projected/ee944194-c716-40cb-a180-f4f7943ab4f2-kube-api-access-7l8b7\") on node \"ip-10-0-129-239.ec2.internal\" DevicePath \"\""
Jul 05 13:25:14.565171 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:14.565137    2563 generic.go:356] "Generic (PLEG): container finished" podID="ee944194-c716-40cb-a180-f4f7943ab4f2" containerID="65a57fdb22af0a4cd64f828425e627da78d29521b0c51ee74f00db9f791d0e25" exitCode=0
Jul 05 13:25:14.565647 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:14.565181    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-l94kd"
Jul 05 13:25:14.565647 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:14.565241    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-l94kd" event={"ID":"ee944194-c716-40cb-a180-f4f7943ab4f2","Type":"ContainerDied","Data":"65a57fdb22af0a4cd64f828425e627da78d29521b0c51ee74f00db9f791d0e25"}
Jul 05 13:25:14.565647 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:14.565281    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-l94kd" event={"ID":"ee944194-c716-40cb-a180-f4f7943ab4f2","Type":"ContainerDied","Data":"67efc4a9987e3b23c1b58d71802612702bbe97b41653e7e87b4eb94afaf9c06e"}
Jul 05 13:25:14.565647 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:14.565300    2563 scope.go:117] "RemoveContainer" containerID="65a57fdb22af0a4cd64f828425e627da78d29521b0c51ee74f00db9f791d0e25"
Jul 05 13:25:14.574496 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:14.574473    2563 scope.go:117] "RemoveContainer" containerID="65a57fdb22af0a4cd64f828425e627da78d29521b0c51ee74f00db9f791d0e25"
Jul 05 13:25:14.574758 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:25:14.574739    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65a57fdb22af0a4cd64f828425e627da78d29521b0c51ee74f00db9f791d0e25\": container with ID starting with 65a57fdb22af0a4cd64f828425e627da78d29521b0c51ee74f00db9f791d0e25 not found: ID does not exist" containerID="65a57fdb22af0a4cd64f828425e627da78d29521b0c51ee74f00db9f791d0e25"
Jul 05 13:25:14.574816 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:14.574766    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65a57fdb22af0a4cd64f828425e627da78d29521b0c51ee74f00db9f791d0e25"} err="failed to get container status \"65a57fdb22af0a4cd64f828425e627da78d29521b0c51ee74f00db9f791d0e25\": rpc error: code = NotFound desc = could not find container \"65a57fdb22af0a4cd64f828425e627da78d29521b0c51ee74f00db9f791d0e25\": container with ID starting with 65a57fdb22af0a4cd64f828425e627da78d29521b0c51ee74f00db9f791d0e25 not found: ID does not exist"
Jul 05 13:25:14.598397 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:14.598363    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-l94kd"]
Jul 05 13:25:14.601738 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:14.601711    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-l94kd"]
Jul 05 13:25:16.348653 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:16.348619    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee944194-c716-40cb-a180-f4f7943ab4f2" path="/var/lib/kubelet/pods/ee944194-c716-40cb-a180-f4f7943ab4f2/volumes"
Jul 05 13:25:20.493486 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:20.493380    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:25:20.699598 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:20.699552    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-wz7lb"
Jul 05 13:25:20.699598 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:20.699619    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-wz7lb"
Jul 05 13:25:20.723096 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:20.723070    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-wz7lb"
Jul 05 13:25:21.616951 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:21.616919    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-wz7lb"
Jul 05 13:25:33.277750 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:33.277720    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:25:33.463108 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:33.463074    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:25:34.981962 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:34.981930    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:25:35.559255 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:35.559200    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:25:38.020664 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:38.020629    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-z847s"]
Jul 05 13:25:38.021073 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:38.020955    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee944194-c716-40cb-a180-f4f7943ab4f2" containerName="registry-server"
Jul 05 13:25:38.021073 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:38.020970    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee944194-c716-40cb-a180-f4f7943ab4f2" containerName="registry-server"
Jul 05 13:25:38.021073 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:38.021036    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee944194-c716-40cb-a180-f4f7943ab4f2" containerName="registry-server"
Jul 05 13:25:38.024076 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:38.024057    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-z847s"
Jul 05 13:25:38.031689 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:38.031668    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 05 13:25:38.035030 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:38.035007    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-772pm\""
Jul 05 13:25:38.050509 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:38.050474    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzmz2\" (UniqueName: \"kubernetes.io/projected/ae0fcba1-fac4-4c0a-8d03-376dd637f68b-kube-api-access-hzmz2\") pod \"dns-operator-controller-manager-864dd78c4c-z847s\" (UID: \"ae0fcba1-fac4-4c0a-8d03-376dd637f68b\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-z847s"
Jul 05 13:25:38.080101 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:38.080065    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-z847s"]
Jul 05 13:25:38.151274 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:38.151212    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzmz2\" (UniqueName: \"kubernetes.io/projected/ae0fcba1-fac4-4c0a-8d03-376dd637f68b-kube-api-access-hzmz2\") pod \"dns-operator-controller-manager-864dd78c4c-z847s\" (UID: \"ae0fcba1-fac4-4c0a-8d03-376dd637f68b\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-z847s"
Jul 05 13:25:38.178239 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:38.178189    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzmz2\" (UniqueName: \"kubernetes.io/projected/ae0fcba1-fac4-4c0a-8d03-376dd637f68b-kube-api-access-hzmz2\") pod \"dns-operator-controller-manager-864dd78c4c-z847s\" (UID: \"ae0fcba1-fac4-4c0a-8d03-376dd637f68b\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-z847s"
Jul 05 13:25:38.335480 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:38.335438    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-z847s"
Jul 05 13:25:38.523798 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:38.523765    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-z847s"]
Jul 05 13:25:38.526942 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:25:38.526915    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae0fcba1_fac4_4c0a_8d03_376dd637f68b.slice/crio-459d3e8a41e3adbcaf015f80d4c830f686e6e8bb3514bce3464ae36201be58d6 WatchSource:0}: Error finding container 459d3e8a41e3adbcaf015f80d4c830f686e6e8bb3514bce3464ae36201be58d6: Status 404 returned error can't find the container with id 459d3e8a41e3adbcaf015f80d4c830f686e6e8bb3514bce3464ae36201be58d6
Jul 05 13:25:38.528788 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:38.528771    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 05 13:25:38.665364 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:38.665263    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-z847s" event={"ID":"ae0fcba1-fac4-4c0a-8d03-376dd637f68b","Type":"ContainerStarted","Data":"459d3e8a41e3adbcaf015f80d4c830f686e6e8bb3514bce3464ae36201be58d6"}
Jul 05 13:25:39.309252 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:39.309187    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:25:40.676480 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:40.676445    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-z847s" event={"ID":"ae0fcba1-fac4-4c0a-8d03-376dd637f68b","Type":"ContainerStarted","Data":"f08f1a593066cdc1c792bbd6f759f25dde9010fb98f6c28223ae5550c7dd51dc"}
Jul 05 13:25:40.676909 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:40.676558    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-z847s"
Jul 05 13:25:40.729917 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:40.729857    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-z847s" podStartSLOduration=1.9961675049999998 podStartE2EDuration="3.729840292s" totalImagesPullingTime="1.733672787s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:25:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:25:40.72884159 +0000 UTC m=+620.822727215" watchObservedRunningTime="2026-07-05 13:25:40.729840292 +0000 UTC m=+620.823725917"
Jul 05 13:25:41.481388 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:41.481353    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6rw4v"]
Jul 05 13:25:41.484818 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:41.484800    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6rw4v"
Jul 05 13:25:41.488923 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:41.488900    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-k25kp\""
Jul 05 13:25:41.517594 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:41.517564    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6rw4v"]
Jul 05 13:25:41.580175 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:41.580133    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwvdg\" (UniqueName: \"kubernetes.io/projected/9681c784-59f8-47fd-a6bc-0d731bd5412a-kube-api-access-lwvdg\") pod \"limitador-operator-controller-manager-859d7b78bd-6rw4v\" (UID: \"9681c784-59f8-47fd-a6bc-0d731bd5412a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6rw4v"
Jul 05 13:25:41.680888 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:41.680856    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwvdg\" (UniqueName: \"kubernetes.io/projected/9681c784-59f8-47fd-a6bc-0d731bd5412a-kube-api-access-lwvdg\") pod \"limitador-operator-controller-manager-859d7b78bd-6rw4v\" (UID: \"9681c784-59f8-47fd-a6bc-0d731bd5412a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6rw4v"
Jul 05 13:25:41.720488 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:41.720455    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwvdg\" (UniqueName: \"kubernetes.io/projected/9681c784-59f8-47fd-a6bc-0d731bd5412a-kube-api-access-lwvdg\") pod \"limitador-operator-controller-manager-859d7b78bd-6rw4v\" (UID: \"9681c784-59f8-47fd-a6bc-0d731bd5412a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6rw4v"
Jul 05 13:25:41.795503 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:41.795475    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6rw4v"
Jul 05 13:25:42.198004 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:42.197882    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6rw4v"]
Jul 05 13:25:42.232676 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:25:42.232644    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9681c784_59f8_47fd_a6bc_0d731bd5412a.slice/crio-b5b16f1ed7a20d07a3e2d98be2570149ffc18aefd57e83f623d31452d199aad0 WatchSource:0}: Error finding container b5b16f1ed7a20d07a3e2d98be2570149ffc18aefd57e83f623d31452d199aad0: Status 404 returned error can't find the container with id b5b16f1ed7a20d07a3e2d98be2570149ffc18aefd57e83f623d31452d199aad0
Jul 05 13:25:42.268359 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:42.268316    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:25:42.686947 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:42.686908    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6rw4v" event={"ID":"9681c784-59f8-47fd-a6bc-0d731bd5412a","Type":"ContainerStarted","Data":"b5b16f1ed7a20d07a3e2d98be2570149ffc18aefd57e83f623d31452d199aad0"}
Jul 05 13:25:42.691712 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:42.691684    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:25:43.700365 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:43.700327    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6rw4v" event={"ID":"9681c784-59f8-47fd-a6bc-0d731bd5412a","Type":"ContainerStarted","Data":"7b50d00a6ffa4fde994288cbf72a7517f28286102fff9d2a6257b144a1416b12"}
Jul 05 13:25:43.700767 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:43.700432    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6rw4v"
Jul 05 13:25:43.773581 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:43.773478    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6rw4v" podStartSLOduration=1.55299199 podStartE2EDuration="2.773460973s" totalImagesPullingTime="1.220468983s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:25:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:25:43.769845908 +0000 UTC m=+623.863731552" watchObservedRunningTime="2026-07-05 13:25:43.773460973 +0000 UTC m=+623.867346598"
Jul 05 13:25:44.462019 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:44.461986    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:25:44.851391 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:44.851363    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:25:47.126817 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:47.126784    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:25:47.432593 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:47.432480    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:25:49.214264 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:49.214214    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:25:51.243821 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:51.243784    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2rs88"]
Jul 05 13:25:51.252274 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:51.252248    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2rs88"
Jul 05 13:25:51.258499 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:51.258472    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-6dmlp\""
Jul 05 13:25:51.282317 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:51.282280    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2rs88"]
Jul 05 13:25:51.367444 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:51.367393    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhjcd\" (UniqueName: \"kubernetes.io/projected/effb101b-30fa-4392-9870-472afadfa856-kube-api-access-xhjcd\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2rs88\" (UID: \"effb101b-30fa-4392-9870-472afadfa856\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2rs88"
Jul 05 13:25:51.367634 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:51.367497    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/effb101b-30fa-4392-9870-472afadfa856-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2rs88\" (UID: \"effb101b-30fa-4392-9870-472afadfa856\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2rs88"
Jul 05 13:25:51.468351 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:51.468316    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/effb101b-30fa-4392-9870-472afadfa856-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2rs88\" (UID: \"effb101b-30fa-4392-9870-472afadfa856\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2rs88"
Jul 05 13:25:51.468515 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:51.468368    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhjcd\" (UniqueName: \"kubernetes.io/projected/effb101b-30fa-4392-9870-472afadfa856-kube-api-access-xhjcd\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2rs88\" (UID: \"effb101b-30fa-4392-9870-472afadfa856\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2rs88"
Jul 05 13:25:51.468840 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:51.468818    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/effb101b-30fa-4392-9870-472afadfa856-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2rs88\" (UID: \"effb101b-30fa-4392-9870-472afadfa856\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2rs88"
Jul 05 13:25:51.659563 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:51.659528    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhjcd\" (UniqueName: \"kubernetes.io/projected/effb101b-30fa-4392-9870-472afadfa856-kube-api-access-xhjcd\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2rs88\" (UID: \"effb101b-30fa-4392-9870-472afadfa856\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2rs88"
Jul 05 13:25:51.683361 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:51.683332    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-z847s"
Jul 05 13:25:51.856680 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:51.856590    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:25:51.862604 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:51.862579    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2rs88"
Jul 05 13:25:52.148782 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:52.148750    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2rs88"]
Jul 05 13:25:52.152757 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:25:52.152730    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeffb101b_30fa_4392_9870_472afadfa856.slice/crio-ccbbeda33e2d2b38cb9662fa6e42d02c3eaf2b5f3d0694cd61963b05f38534ab WatchSource:0}: Error finding container ccbbeda33e2d2b38cb9662fa6e42d02c3eaf2b5f3d0694cd61963b05f38534ab: Status 404 returned error can't find the container with id ccbbeda33e2d2b38cb9662fa6e42d02c3eaf2b5f3d0694cd61963b05f38534ab
Jul 05 13:25:52.416248 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:52.416169    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:25:52.741266 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:52.741163    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2rs88" event={"ID":"effb101b-30fa-4392-9870-472afadfa856","Type":"ContainerStarted","Data":"ccbbeda33e2d2b38cb9662fa6e42d02c3eaf2b5f3d0694cd61963b05f38534ab"}
Jul 05 13:25:52.981656 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:52.981618    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:25:54.356993 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:54.356958    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:25:54.706936 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:54.706855    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6rw4v"
Jul 05 13:25:55.403674 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:55.403605    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:25:56.762674 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:56.762637    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2rs88" event={"ID":"effb101b-30fa-4392-9870-472afadfa856","Type":"ContainerStarted","Data":"fe7d71dab4d3079b3723403bd3d6e1c8cbfe383cd15b01f8f30103e1ebc06879"}
Jul 05 13:25:56.763073 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:56.762777    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2rs88"
Jul 05 13:25:56.843672 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:56.843637    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:25:57.359119 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:25:57.359088    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:26:00.179913 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:00.179871    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:26:00.451241 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:00.451106    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:26:05.777392 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:05.777357    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:26:06.026780 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:06.026729    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:26:06.347974 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:06.347929    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:26:07.769014 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:07.768984    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2rs88"
Jul 05 13:26:07.858141 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:07.858082    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2rs88" podStartSLOduration=12.74320692 podStartE2EDuration="16.858066295s" totalImagesPullingTime="4.114859375s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:25:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:25:56.900261625 +0000 UTC m=+636.994147250" watchObservedRunningTime="2026-07-05 13:26:07.858066295 +0000 UTC m=+647.951951920"
Jul 05 13:26:08.496590 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:08.496555    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:26:08.686205 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:08.686168    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:26:10.135915 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:10.135878    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2rs88"]
Jul 05 13:26:10.136468 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:10.136166    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2rs88" podUID="effb101b-30fa-4392-9870-472afadfa856" containerName="manager" containerID="cri-o://fe7d71dab4d3079b3723403bd3d6e1c8cbfe383cd15b01f8f30103e1ebc06879" gracePeriod=2
Jul 05 13:26:10.144016 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:10.143981    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2rs88"]
Jul 05 13:26:10.162880 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:10.162843    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6rw4v"]
Jul 05 13:26:10.163066 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:10.163047    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6rw4v" podUID="9681c784-59f8-47fd-a6bc-0d731bd5412a" containerName="manager" containerID="cri-o://7b50d00a6ffa4fde994288cbf72a7517f28286102fff9d2a6257b144a1416b12" gracePeriod=2
Jul 05 13:26:10.175923 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:10.175892    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6rw4v"]
Jul 05 13:26:10.181400 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:26:10.181363    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-2rs88\" is forbidden: User \"system:node:ip-10-0-129-239.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-239.ec2.internal' and this object" podUID="effb101b-30fa-4392-9870-472afadfa856" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2rs88"
Jul 05 13:26:10.257745 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:10.257715    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jdgv9"]
Jul 05 13:26:10.258212 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:10.258188    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9681c784-59f8-47fd-a6bc-0d731bd5412a" containerName="manager"
Jul 05 13:26:10.258348 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:10.258212    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9681c784-59f8-47fd-a6bc-0d731bd5412a" containerName="manager"
Jul 05 13:26:10.258348 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:10.258274    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="effb101b-30fa-4392-9870-472afadfa856" containerName="manager"
Jul 05 13:26:10.258348 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:10.258283    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="effb101b-30fa-4392-9870-472afadfa856" containerName="manager"
Jul 05 13:26:10.258500 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:10.258362    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="9681c784-59f8-47fd-a6bc-0d731bd5412a" containerName="manager"
Jul 05 13:26:10.258500 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:10.258375    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="effb101b-30fa-4392-9870-472afadfa856" containerName="manager"
Jul 05 13:26:10.261214 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:10.261195    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9ctvx"]
Jul 05 13:26:10.261327 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:10.261309    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jdgv9"
Jul 05 13:26:10.264269 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:10.264204    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9ctvx"
Jul 05 13:26:10.276639 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:26:10.276600    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-6rw4v\" is forbidden: User \"system:node:ip-10-0-129-239.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-239.ec2.internal' and this object" podUID="9681c784-59f8-47fd-a6bc-0d731bd5412a" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6rw4v"
Jul 05 13:26:10.279443 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:26:10.279415    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-2rs88\" is forbidden: User \"system:node:ip-10-0-129-239.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-239.ec2.internal' and this object" podUID="effb101b-30fa-4392-9870-472afadfa856" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2rs88"
Jul 05 13:26:10.286286 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:10.286241    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9ctvx"]
Jul 05 13:26:10.290203 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:10.290177    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jdgv9"]
Jul 05 13:26:10.324839 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:26:10.324788    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-6rw4v\" is forbidden: User \"system:node:ip-10-0-129-239.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-239.ec2.internal' and this object" podUID="9681c784-59f8-47fd-a6bc-0d731bd5412a" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6rw4v"
Jul 05 13:26:10.340026 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:10.339988    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7j5hw\" (UniqueName: \"kubernetes.io/projected/813a0616-4142-4f0e-b2cd-6f569e1b43ca-kube-api-access-7j5hw\") pod \"limitador-operator-controller-manager-859d7b78bd-jdgv9\" (UID: \"813a0616-4142-4f0e-b2cd-6f569e1b43ca\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jdgv9"
Jul 05 13:26:10.340214 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:10.340041    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9whh\" (UniqueName: \"kubernetes.io/projected/66cae384-9513-48f2-a08f-b467d8208056-kube-api-access-r9whh\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9ctvx\" (UID: \"66cae384-9513-48f2-a08f-b467d8208056\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9ctvx"
Jul 05 13:26:10.340214 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:10.340153    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/66cae384-9513-48f2-a08f-b467d8208056-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9ctvx\" (UID: \"66cae384-9513-48f2-a08f-b467d8208056\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9ctvx"
Jul 05 13:26:10.381391 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:26:10.381346    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-2rs88\" is forbidden: User \"system:node:ip-10-0-129-239.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-239.ec2.internal' and this object" podUID="effb101b-30fa-4392-9870-472afadfa856" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2rs88"
Jul 05 13:26:10.425367 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:10.425338    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2rs88"
Jul 05 13:26:10.428519 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:10.428496    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6rw4v"
Jul 05 13:26:10.429998 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:26:10.429964    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-2rs88\" is forbidden: User \"system:node:ip-10-0-129-239.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-239.ec2.internal' and this object" podUID="effb101b-30fa-4392-9870-472afadfa856" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2rs88"
Jul 05 13:26:10.440606 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:10.440579    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7j5hw\" (UniqueName: \"kubernetes.io/projected/813a0616-4142-4f0e-b2cd-6f569e1b43ca-kube-api-access-7j5hw\") pod \"limitador-operator-controller-manager-859d7b78bd-jdgv9\" (UID: \"813a0616-4142-4f0e-b2cd-6f569e1b43ca\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jdgv9"
Jul 05 13:26:10.440785 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:10.440623    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9whh\" (UniqueName: \"kubernetes.io/projected/66cae384-9513-48f2-a08f-b467d8208056-kube-api-access-r9whh\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9ctvx\" (UID: \"66cae384-9513-48f2-a08f-b467d8208056\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9ctvx"
Jul 05 13:26:10.440785 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:10.440705    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/66cae384-9513-48f2-a08f-b467d8208056-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9ctvx\" (UID: \"66cae384-9513-48f2-a08f-b467d8208056\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9ctvx"
Jul 05 13:26:10.441106 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:10.441083    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/66cae384-9513-48f2-a08f-b467d8208056-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9ctvx\" (UID: \"66cae384-9513-48f2-a08f-b467d8208056\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9ctvx"
Jul 05 13:26:10.445312 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:26:10.445288    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-6rw4v\" is forbidden: User \"system:node:ip-10-0-129-239.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-239.ec2.internal' and this object" podUID="9681c784-59f8-47fd-a6bc-0d731bd5412a" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6rw4v"
Jul 05 13:26:10.453596 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:26:10.453567    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-2rs88\" is forbidden: User \"system:node:ip-10-0-129-239.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-239.ec2.internal' and this object" podUID="effb101b-30fa-4392-9870-472afadfa856" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2rs88"
Jul 05 13:26:10.471716 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:10.471686    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9whh\" (UniqueName: \"kubernetes.io/projected/66cae384-9513-48f2-a08f-b467d8208056-kube-api-access-r9whh\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9ctvx\" (UID: \"66cae384-9513-48f2-a08f-b467d8208056\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9ctvx"
Jul 05 13:26:10.487663 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:10.487635    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7j5hw\" (UniqueName: \"kubernetes.io/projected/813a0616-4142-4f0e-b2cd-6f569e1b43ca-kube-api-access-7j5hw\") pod \"limitador-operator-controller-manager-859d7b78bd-jdgv9\" (UID: \"813a0616-4142-4f0e-b2cd-6f569e1b43ca\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jdgv9"
Jul 05 13:26:10.541290 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:10.541258    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lwvdg\" (UniqueName: \"kubernetes.io/projected/9681c784-59f8-47fd-a6bc-0d731bd5412a-kube-api-access-lwvdg\") pod \"9681c784-59f8-47fd-a6bc-0d731bd5412a\" (UID: \"9681c784-59f8-47fd-a6bc-0d731bd5412a\") "
Jul 05 13:26:10.541462 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:10.541333    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/effb101b-30fa-4392-9870-472afadfa856-extensions-socket-volume\") pod \"effb101b-30fa-4392-9870-472afadfa856\" (UID: \"effb101b-30fa-4392-9870-472afadfa856\") "
Jul 05 13:26:10.541462 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:10.541368    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xhjcd\" (UniqueName: \"kubernetes.io/projected/effb101b-30fa-4392-9870-472afadfa856-kube-api-access-xhjcd\") pod \"effb101b-30fa-4392-9870-472afadfa856\" (UID: \"effb101b-30fa-4392-9870-472afadfa856\") "
Jul 05 13:26:10.541897 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:10.541863    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/effb101b-30fa-4392-9870-472afadfa856-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "effb101b-30fa-4392-9870-472afadfa856" (UID: "effb101b-30fa-4392-9870-472afadfa856"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:26:10.543348 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:10.543318    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9681c784-59f8-47fd-a6bc-0d731bd5412a-kube-api-access-lwvdg" (OuterVolumeSpecName: "kube-api-access-lwvdg") pod "9681c784-59f8-47fd-a6bc-0d731bd5412a" (UID: "9681c784-59f8-47fd-a6bc-0d731bd5412a"). InnerVolumeSpecName "kube-api-access-lwvdg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 13:26:10.543455 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:10.543433    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/effb101b-30fa-4392-9870-472afadfa856-kube-api-access-xhjcd" (OuterVolumeSpecName: "kube-api-access-xhjcd") pod "effb101b-30fa-4392-9870-472afadfa856" (UID: "effb101b-30fa-4392-9870-472afadfa856"). InnerVolumeSpecName "kube-api-access-xhjcd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 13:26:10.581809 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:10.581779    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jdgv9"
Jul 05 13:26:10.591014 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:10.590990    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9ctvx"
Jul 05 13:26:10.642523 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:10.642444    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lwvdg\" (UniqueName: \"kubernetes.io/projected/9681c784-59f8-47fd-a6bc-0d731bd5412a-kube-api-access-lwvdg\") on node \"ip-10-0-129-239.ec2.internal\" DevicePath \"\""
Jul 05 13:26:10.642523 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:10.642478    2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/effb101b-30fa-4392-9870-472afadfa856-extensions-socket-volume\") on node \"ip-10-0-129-239.ec2.internal\" DevicePath \"\""
Jul 05 13:26:10.642523 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:10.642495    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xhjcd\" (UniqueName: \"kubernetes.io/projected/effb101b-30fa-4392-9870-472afadfa856-kube-api-access-xhjcd\") on node \"ip-10-0-129-239.ec2.internal\" DevicePath \"\""
Jul 05 13:26:10.761290 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:10.761257    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jdgv9"]
Jul 05 13:26:10.766067 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:26:10.766036    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod813a0616_4142_4f0e_b2cd_6f569e1b43ca.slice/crio-77faa3ab576773a4215f6514a018da3e4f5b9c73a17426b77301dd4f52fdc3d9 WatchSource:0}: Error finding container 77faa3ab576773a4215f6514a018da3e4f5b9c73a17426b77301dd4f52fdc3d9: Status 404 returned error can't find the container with id 77faa3ab576773a4215f6514a018da3e4f5b9c73a17426b77301dd4f52fdc3d9
Jul 05 13:26:10.825526 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:10.825494    2563 generic.go:356] "Generic (PLEG): container finished" podID="9681c784-59f8-47fd-a6bc-0d731bd5412a" containerID="7b50d00a6ffa4fde994288cbf72a7517f28286102fff9d2a6257b144a1416b12" exitCode=0
Jul 05 13:26:10.825656 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:10.825536    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6rw4v"
Jul 05 13:26:10.825656 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:10.825592    2563 scope.go:117] "RemoveContainer" containerID="7b50d00a6ffa4fde994288cbf72a7517f28286102fff9d2a6257b144a1416b12"
Jul 05 13:26:10.827452 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:10.827426    2563 generic.go:356] "Generic (PLEG): container finished" podID="effb101b-30fa-4392-9870-472afadfa856" containerID="fe7d71dab4d3079b3723403bd3d6e1c8cbfe383cd15b01f8f30103e1ebc06879" exitCode=0
Jul 05 13:26:10.827719 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:10.827480    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2rs88"
Jul 05 13:26:10.828647 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:26:10.828511    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-6rw4v\" is forbidden: User \"system:node:ip-10-0-129-239.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-239.ec2.internal' and this object" podUID="9681c784-59f8-47fd-a6bc-0d731bd5412a" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6rw4v"
Jul 05 13:26:10.829882 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:10.829855    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jdgv9" event={"ID":"813a0616-4142-4f0e-b2cd-6f569e1b43ca","Type":"ContainerStarted","Data":"77faa3ab576773a4215f6514a018da3e4f5b9c73a17426b77301dd4f52fdc3d9"}
Jul 05 13:26:10.831196 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:26:10.831170    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-2rs88\" is forbidden: User \"system:node:ip-10-0-129-239.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-239.ec2.internal' and this object" podUID="effb101b-30fa-4392-9870-472afadfa856" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2rs88"
Jul 05 13:26:10.835496 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:26:10.835447    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-6rw4v\" is forbidden: User \"system:node:ip-10-0-129-239.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-239.ec2.internal' and this object" podUID="9681c784-59f8-47fd-a6bc-0d731bd5412a" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6rw4v"
Jul 05 13:26:10.835863 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:10.835840    2563 scope.go:117] "RemoveContainer" containerID="7b50d00a6ffa4fde994288cbf72a7517f28286102fff9d2a6257b144a1416b12"
Jul 05 13:26:10.836143 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:26:10.836126    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b50d00a6ffa4fde994288cbf72a7517f28286102fff9d2a6257b144a1416b12\": container with ID starting with 7b50d00a6ffa4fde994288cbf72a7517f28286102fff9d2a6257b144a1416b12 not found: ID does not exist" containerID="7b50d00a6ffa4fde994288cbf72a7517f28286102fff9d2a6257b144a1416b12"
Jul 05 13:26:10.836232 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:10.836155    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b50d00a6ffa4fde994288cbf72a7517f28286102fff9d2a6257b144a1416b12"} err="failed to get container status \"7b50d00a6ffa4fde994288cbf72a7517f28286102fff9d2a6257b144a1416b12\": rpc error: code = NotFound desc = could not find container \"7b50d00a6ffa4fde994288cbf72a7517f28286102fff9d2a6257b144a1416b12\": container with ID starting with 7b50d00a6ffa4fde994288cbf72a7517f28286102fff9d2a6257b144a1416b12 not found: ID does not exist"
Jul 05 13:26:10.836232 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:10.836178    2563 scope.go:117] "RemoveContainer" containerID="fe7d71dab4d3079b3723403bd3d6e1c8cbfe383cd15b01f8f30103e1ebc06879"
Jul 05 13:26:10.838099 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:26:10.838074    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-2rs88\" is forbidden: User \"system:node:ip-10-0-129-239.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-239.ec2.internal' and this object" podUID="effb101b-30fa-4392-9870-472afadfa856" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2rs88"
Jul 05 13:26:10.843658 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:26:10.843629    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-2rs88\" is forbidden: User \"system:node:ip-10-0-129-239.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-239.ec2.internal' and this object" podUID="effb101b-30fa-4392-9870-472afadfa856" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2rs88"
Jul 05 13:26:10.844074 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:10.844057    2563 scope.go:117] "RemoveContainer" containerID="fe7d71dab4d3079b3723403bd3d6e1c8cbfe383cd15b01f8f30103e1ebc06879"
Jul 05 13:26:10.844422 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:26:10.844403    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe7d71dab4d3079b3723403bd3d6e1c8cbfe383cd15b01f8f30103e1ebc06879\": container with ID starting with fe7d71dab4d3079b3723403bd3d6e1c8cbfe383cd15b01f8f30103e1ebc06879 not found: ID does not exist" containerID="fe7d71dab4d3079b3723403bd3d6e1c8cbfe383cd15b01f8f30103e1ebc06879"
Jul 05 13:26:10.844476 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:10.844430    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe7d71dab4d3079b3723403bd3d6e1c8cbfe383cd15b01f8f30103e1ebc06879"} err="failed to get container status \"fe7d71dab4d3079b3723403bd3d6e1c8cbfe383cd15b01f8f30103e1ebc06879\": rpc error: code = NotFound desc = could not find container \"fe7d71dab4d3079b3723403bd3d6e1c8cbfe383cd15b01f8f30103e1ebc06879\": container with ID starting with fe7d71dab4d3079b3723403bd3d6e1c8cbfe383cd15b01f8f30103e1ebc06879 not found: ID does not exist"
Jul 05 13:26:10.849761 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:26:10.849738    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-6rw4v\" is forbidden: User \"system:node:ip-10-0-129-239.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-239.ec2.internal' and this object" podUID="9681c784-59f8-47fd-a6bc-0d731bd5412a" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6rw4v"
Jul 05 13:26:10.861340 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:10.861317    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9ctvx"]
Jul 05 13:26:10.863581 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:26:10.863537    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66cae384_9513_48f2_a08f_b467d8208056.slice/crio-8dd85c936cd9f297ccf7c4c191bd3afbeb6c4ee020077c219ec99485974517f7 WatchSource:0}: Error finding container 8dd85c936cd9f297ccf7c4c191bd3afbeb6c4ee020077c219ec99485974517f7: Status 404 returned error can't find the container with id 8dd85c936cd9f297ccf7c4c191bd3afbeb6c4ee020077c219ec99485974517f7
Jul 05 13:26:11.346804 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:11.346763    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:26:11.479829 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:11.479797    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:26:11.837244 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:11.837192    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jdgv9" event={"ID":"813a0616-4142-4f0e-b2cd-6f569e1b43ca","Type":"ContainerStarted","Data":"6578bc21bd4533eab87a3f230340c96da2f93e7b6ac507f0fa62d2fae274c6ae"}
Jul 05 13:26:11.837443 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:11.837312    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jdgv9"
Jul 05 13:26:11.838931 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:11.838907    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9ctvx" event={"ID":"66cae384-9513-48f2-a08f-b467d8208056","Type":"ContainerStarted","Data":"1663a0fdc87514d527bb32ac2b6b2b6745834999c9235df7dfc6e9db0d814687"}
Jul 05 13:26:11.839048 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:11.838954    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9ctvx" event={"ID":"66cae384-9513-48f2-a08f-b467d8208056","Type":"ContainerStarted","Data":"8dd85c936cd9f297ccf7c4c191bd3afbeb6c4ee020077c219ec99485974517f7"}
Jul 05 13:26:11.839048 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:11.838987    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9ctvx"
Jul 05 13:26:11.840330 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:26:11.840305    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-6rw4v\" is forbidden: User \"system:node:ip-10-0-129-239.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-239.ec2.internal' and this object" podUID="9681c784-59f8-47fd-a6bc-0d731bd5412a" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6rw4v"
Jul 05 13:26:11.844116 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:26:11.844085    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-2rs88\" is forbidden: User \"system:node:ip-10-0-129-239.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-239.ec2.internal' and this object" podUID="effb101b-30fa-4392-9870-472afadfa856" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2rs88"
Jul 05 13:26:11.883622 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:11.883569    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jdgv9" podStartSLOduration=1.883553365 podStartE2EDuration="1.883553365s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:26:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:26:11.882398081 +0000 UTC m=+651.976283707" watchObservedRunningTime="2026-07-05 13:26:11.883553365 +0000 UTC m=+651.977438990"
Jul 05 13:26:11.885710 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:26:11.885684    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-2rs88\" is forbidden: User \"system:node:ip-10-0-129-239.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-239.ec2.internal' and this object" podUID="effb101b-30fa-4392-9870-472afadfa856" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2rs88"
Jul 05 13:26:11.888652 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:26:11.888632    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-6rw4v\" is forbidden: User \"system:node:ip-10-0-129-239.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-239.ec2.internal' and this object" podUID="9681c784-59f8-47fd-a6bc-0d731bd5412a" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6rw4v"
Jul 05 13:26:11.924769 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:11.924717    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9ctvx" podStartSLOduration=1.924700978 podStartE2EDuration="1.924700978s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:26:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:26:11.922786857 +0000 UTC m=+652.016672505" watchObservedRunningTime="2026-07-05 13:26:11.924700978 +0000 UTC m=+652.018586602"
Jul 05 13:26:12.349144 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:12.349109    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9681c784-59f8-47fd-a6bc-0d731bd5412a" path="/var/lib/kubelet/pods/9681c784-59f8-47fd-a6bc-0d731bd5412a/volumes"
Jul 05 13:26:12.349585 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:12.349491    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="effb101b-30fa-4392-9870-472afadfa856" path="/var/lib/kubelet/pods/effb101b-30fa-4392-9870-472afadfa856/volumes"
Jul 05 13:26:13.837897 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:13.837859    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n9dv4"]
Jul 05 13:26:13.844896 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:13.844871    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n9dv4"
Jul 05 13:26:13.872720 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:13.872687    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n9dv4"]
Jul 05 13:26:13.972612 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:13.972566    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c673fb68-a1c4-4ab1-9e52-6ad425a68d78-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-n9dv4\" (UID: \"c673fb68-a1c4-4ab1-9e52-6ad425a68d78\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n9dv4"
Jul 05 13:26:13.972793 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:13.972630    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7b4b2\" (UniqueName: \"kubernetes.io/projected/c673fb68-a1c4-4ab1-9e52-6ad425a68d78-kube-api-access-7b4b2\") pod \"kuadrant-operator-controller-manager-86878c769f-n9dv4\" (UID: \"c673fb68-a1c4-4ab1-9e52-6ad425a68d78\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n9dv4"
Jul 05 13:26:14.073792 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:14.073755    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7b4b2\" (UniqueName: \"kubernetes.io/projected/c673fb68-a1c4-4ab1-9e52-6ad425a68d78-kube-api-access-7b4b2\") pod \"kuadrant-operator-controller-manager-86878c769f-n9dv4\" (UID: \"c673fb68-a1c4-4ab1-9e52-6ad425a68d78\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n9dv4"
Jul 05 13:26:14.073879 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:14.073848    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c673fb68-a1c4-4ab1-9e52-6ad425a68d78-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-n9dv4\" (UID: \"c673fb68-a1c4-4ab1-9e52-6ad425a68d78\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n9dv4"
Jul 05 13:26:14.074286 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:14.074268    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c673fb68-a1c4-4ab1-9e52-6ad425a68d78-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-n9dv4\" (UID: \"c673fb68-a1c4-4ab1-9e52-6ad425a68d78\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n9dv4"
Jul 05 13:26:14.099865 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:14.099793    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7b4b2\" (UniqueName: \"kubernetes.io/projected/c673fb68-a1c4-4ab1-9e52-6ad425a68d78-kube-api-access-7b4b2\") pod \"kuadrant-operator-controller-manager-86878c769f-n9dv4\" (UID: \"c673fb68-a1c4-4ab1-9e52-6ad425a68d78\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n9dv4"
Jul 05 13:26:14.154711 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:14.154672    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n9dv4"
Jul 05 13:26:14.416822 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:14.416800    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n9dv4"]
Jul 05 13:26:14.418844 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:26:14.418815    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc673fb68_a1c4_4ab1_9e52_6ad425a68d78.slice/crio-e34983eb438a9894b7fb4b89e21245e4bc3b922013e6cf2a88128325fbf96e5d WatchSource:0}: Error finding container e34983eb438a9894b7fb4b89e21245e4bc3b922013e6cf2a88128325fbf96e5d: Status 404 returned error can't find the container with id e34983eb438a9894b7fb4b89e21245e4bc3b922013e6cf2a88128325fbf96e5d
Jul 05 13:26:14.856357 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:14.856324    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n9dv4" event={"ID":"c673fb68-a1c4-4ab1-9e52-6ad425a68d78","Type":"ContainerStarted","Data":"5746c8a10eb9e169aad58ed6c39ed365d083922fd3aefbbbc8592ee39604b395"}
Jul 05 13:26:14.856756 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:14.856374    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n9dv4" event={"ID":"c673fb68-a1c4-4ab1-9e52-6ad425a68d78","Type":"ContainerStarted","Data":"e34983eb438a9894b7fb4b89e21245e4bc3b922013e6cf2a88128325fbf96e5d"}
Jul 05 13:26:14.856756 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:14.856450    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n9dv4"
Jul 05 13:26:14.908792 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:14.908712    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n9dv4" podStartSLOduration=1.90868747 podStartE2EDuration="1.90868747s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:26:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:26:14.908069824 +0000 UTC m=+655.001955450" watchObservedRunningTime="2026-07-05 13:26:14.90868747 +0000 UTC m=+655.002573095"
Jul 05 13:26:15.199337 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:15.199253    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:26:15.395494 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:15.395461    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:26:22.846836 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:22.846802    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jdgv9"
Jul 05 13:26:22.847263 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:22.847070    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9ctvx"
Jul 05 13:26:24.029801 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:24.029764    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:26:24.234060 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:24.234026    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:26:24.472016 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:24.471986    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:26:25.863016 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:25.862982    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n9dv4"
Jul 05 13:26:26.054509 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:26.054471    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9ctvx"]
Jul 05 13:26:26.054689 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:26.054651    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9ctvx" podUID="66cae384-9513-48f2-a08f-b467d8208056" containerName="manager" containerID="cri-o://1663a0fdc87514d527bb32ac2b6b2b6745834999c9235df7dfc6e9db0d814687" gracePeriod=10
Jul 05 13:26:26.308409 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:26.308384    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9ctvx"
Jul 05 13:26:26.377329 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:26.377303    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/66cae384-9513-48f2-a08f-b467d8208056-extensions-socket-volume\") pod \"66cae384-9513-48f2-a08f-b467d8208056\" (UID: \"66cae384-9513-48f2-a08f-b467d8208056\") "
Jul 05 13:26:26.377491 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:26.377375    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r9whh\" (UniqueName: \"kubernetes.io/projected/66cae384-9513-48f2-a08f-b467d8208056-kube-api-access-r9whh\") pod \"66cae384-9513-48f2-a08f-b467d8208056\" (UID: \"66cae384-9513-48f2-a08f-b467d8208056\") "
Jul 05 13:26:26.377708 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:26.377687    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66cae384-9513-48f2-a08f-b467d8208056-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "66cae384-9513-48f2-a08f-b467d8208056" (UID: "66cae384-9513-48f2-a08f-b467d8208056"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:26:26.379485 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:26.379446    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66cae384-9513-48f2-a08f-b467d8208056-kube-api-access-r9whh" (OuterVolumeSpecName: "kube-api-access-r9whh") pod "66cae384-9513-48f2-a08f-b467d8208056" (UID: "66cae384-9513-48f2-a08f-b467d8208056"). InnerVolumeSpecName "kube-api-access-r9whh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 13:26:26.478234 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:26.478185    2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/66cae384-9513-48f2-a08f-b467d8208056-extensions-socket-volume\") on node \"ip-10-0-129-239.ec2.internal\" DevicePath \"\""
Jul 05 13:26:26.478234 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:26.478213    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r9whh\" (UniqueName: \"kubernetes.io/projected/66cae384-9513-48f2-a08f-b467d8208056-kube-api-access-r9whh\") on node \"ip-10-0-129-239.ec2.internal\" DevicePath \"\""
Jul 05 13:26:26.860313 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:26.860276    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:26:26.916336 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:26.916305    2563 generic.go:356] "Generic (PLEG): container finished" podID="66cae384-9513-48f2-a08f-b467d8208056" containerID="1663a0fdc87514d527bb32ac2b6b2b6745834999c9235df7dfc6e9db0d814687" exitCode=0
Jul 05 13:26:26.916743 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:26.916348    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9ctvx"
Jul 05 13:26:26.916743 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:26.916369    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9ctvx" event={"ID":"66cae384-9513-48f2-a08f-b467d8208056","Type":"ContainerDied","Data":"1663a0fdc87514d527bb32ac2b6b2b6745834999c9235df7dfc6e9db0d814687"}
Jul 05 13:26:26.916743 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:26.916411    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9ctvx" event={"ID":"66cae384-9513-48f2-a08f-b467d8208056","Type":"ContainerDied","Data":"8dd85c936cd9f297ccf7c4c191bd3afbeb6c4ee020077c219ec99485974517f7"}
Jul 05 13:26:26.916743 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:26.916434    2563 scope.go:117] "RemoveContainer" containerID="1663a0fdc87514d527bb32ac2b6b2b6745834999c9235df7dfc6e9db0d814687"
Jul 05 13:26:26.925719 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:26.925699    2563 scope.go:117] "RemoveContainer" containerID="1663a0fdc87514d527bb32ac2b6b2b6745834999c9235df7dfc6e9db0d814687"
Jul 05 13:26:26.926001 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:26:26.925980    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1663a0fdc87514d527bb32ac2b6b2b6745834999c9235df7dfc6e9db0d814687\": container with ID starting with 1663a0fdc87514d527bb32ac2b6b2b6745834999c9235df7dfc6e9db0d814687 not found: ID does not exist" containerID="1663a0fdc87514d527bb32ac2b6b2b6745834999c9235df7dfc6e9db0d814687"
Jul 05 13:26:26.926072 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:26.926010    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1663a0fdc87514d527bb32ac2b6b2b6745834999c9235df7dfc6e9db0d814687"} err="failed to get container status \"1663a0fdc87514d527bb32ac2b6b2b6745834999c9235df7dfc6e9db0d814687\": rpc error: code = NotFound desc = could not find container \"1663a0fdc87514d527bb32ac2b6b2b6745834999c9235df7dfc6e9db0d814687\": container with ID starting with 1663a0fdc87514d527bb32ac2b6b2b6745834999c9235df7dfc6e9db0d814687 not found: ID does not exist"
Jul 05 13:26:26.968700 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:26.968663    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9ctvx"]
Jul 05 13:26:26.981316 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:26.981289    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9ctvx"]
Jul 05 13:26:27.104383 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:27.104353    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:26:28.348908 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:28.348877    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="66cae384-9513-48f2-a08f-b467d8208056" path="/var/lib/kubelet/pods/66cae384-9513-48f2-a08f-b467d8208056/volumes"
Jul 05 13:26:30.067101 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:30.067065    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:26:30.236025 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:30.235994    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:26:35.061194 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:35.061156    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:26:35.281915 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:35.281883    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:26:42.796306 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:42.796274    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:26:42.951001 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:42.950968    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:26:43.609885 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:43.609853    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:26:43.707379 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:43.707347    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:26:45.203761 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:45.203731    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:26:45.205793 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:45.205767    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mjctx"]
Jul 05 13:26:45.206182 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:45.206165    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66cae384-9513-48f2-a08f-b467d8208056" containerName="manager"
Jul 05 13:26:45.206182 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:45.206182    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="66cae384-9513-48f2-a08f-b467d8208056" containerName="manager"
Jul 05 13:26:45.206280 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:45.206257    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="66cae384-9513-48f2-a08f-b467d8208056" containerName="manager"
Jul 05 13:26:45.209433 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:45.209405    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-mjctx"
Jul 05 13:26:45.219949 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:45.219735    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-vkw6q\""
Jul 05 13:26:45.220155 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:45.220056    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 05 13:26:45.275686 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:45.275642    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mjctx"]
Jul 05 13:26:45.307407 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:45.307372    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mjctx"]
Jul 05 13:26:45.343094 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:45.343047    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72fcb\" (UniqueName: \"kubernetes.io/projected/b9afac70-0029-4218-8225-41fd51120598-kube-api-access-72fcb\") pod \"limitador-limitador-64c94fd64f-mjctx\" (UID: \"b9afac70-0029-4218-8225-41fd51120598\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-mjctx"
Jul 05 13:26:45.343316 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:45.343139    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b9afac70-0029-4218-8225-41fd51120598-config-file\") pod \"limitador-limitador-64c94fd64f-mjctx\" (UID: \"b9afac70-0029-4218-8225-41fd51120598\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-mjctx"
Jul 05 13:26:45.353060 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:45.353025    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:26:45.443764 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:45.443723    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72fcb\" (UniqueName: \"kubernetes.io/projected/b9afac70-0029-4218-8225-41fd51120598-kube-api-access-72fcb\") pod \"limitador-limitador-64c94fd64f-mjctx\" (UID: \"b9afac70-0029-4218-8225-41fd51120598\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-mjctx"
Jul 05 13:26:45.443950 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:45.443782    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b9afac70-0029-4218-8225-41fd51120598-config-file\") pod \"limitador-limitador-64c94fd64f-mjctx\" (UID: \"b9afac70-0029-4218-8225-41fd51120598\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-mjctx"
Jul 05 13:26:45.444452 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:45.444434    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b9afac70-0029-4218-8225-41fd51120598-config-file\") pod \"limitador-limitador-64c94fd64f-mjctx\" (UID: \"b9afac70-0029-4218-8225-41fd51120598\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-mjctx"
Jul 05 13:26:45.460146 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:45.460068    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-72fcb\" (UniqueName: \"kubernetes.io/projected/b9afac70-0029-4218-8225-41fd51120598-kube-api-access-72fcb\") pod \"limitador-limitador-64c94fd64f-mjctx\" (UID: \"b9afac70-0029-4218-8225-41fd51120598\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-mjctx"
Jul 05 13:26:45.523649 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:45.523619    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-mjctx"
Jul 05 13:26:45.686658 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:45.686625    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mjctx"]
Jul 05 13:26:45.689923 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:26:45.689890    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9afac70_0029_4218_8225_41fd51120598.slice/crio-368080eb047952a7a5e2f34348600daf9d7b96676cb83dd8521fb59af7e92896 WatchSource:0}: Error finding container 368080eb047952a7a5e2f34348600daf9d7b96676cb83dd8521fb59af7e92896: Status 404 returned error can't find the container with id 368080eb047952a7a5e2f34348600daf9d7b96676cb83dd8521fb59af7e92896
Jul 05 13:26:46.011310 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:46.011256    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-mjctx" event={"ID":"b9afac70-0029-4218-8225-41fd51120598","Type":"ContainerStarted","Data":"368080eb047952a7a5e2f34348600daf9d7b96676cb83dd8521fb59af7e92896"}
Jul 05 13:26:46.245008 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:46.244978    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:26:46.369928 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:46.369892    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:26:47.348429 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:47.348394    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:26:47.551696 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:47.551658    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:26:49.029186 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:49.029153    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-mjctx" event={"ID":"b9afac70-0029-4218-8225-41fd51120598","Type":"ContainerStarted","Data":"86b849e7b46a21edd80ba8641d31d098655486a91b28263c099e35f0d4ca8512"}
Jul 05 13:26:49.029611 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:49.029278    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-mjctx"
Jul 05 13:26:49.066449 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:49.066382    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-mjctx" podStartSLOduration=1.399541814 podStartE2EDuration="4.066359235s" totalImagesPullingTime="2.666817421s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:26:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:26:49.064447853 +0000 UTC m=+689.158333498" watchObservedRunningTime="2026-07-05 13:26:49.066359235 +0000 UTC m=+689.160244862"
Jul 05 13:26:59.874706 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:59.874665    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mjctx"]
Jul 05 13:26:59.875185 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:59.874943    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-mjctx" podUID="b9afac70-0029-4218-8225-41fd51120598" containerName="limitador" containerID="cri-o://86b849e7b46a21edd80ba8641d31d098655486a91b28263c099e35f0d4ca8512" gracePeriod=30
Jul 05 13:26:59.875687 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:26:59.875632    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-mjctx"
Jul 05 13:27:00.422793 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:00.422764    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-mjctx"
Jul 05 13:27:00.574562 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:00.574522    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-72fcb\" (UniqueName: \"kubernetes.io/projected/b9afac70-0029-4218-8225-41fd51120598-kube-api-access-72fcb\") pod \"b9afac70-0029-4218-8225-41fd51120598\" (UID: \"b9afac70-0029-4218-8225-41fd51120598\") "
Jul 05 13:27:00.574562 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:00.574568    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b9afac70-0029-4218-8225-41fd51120598-config-file\") pod \"b9afac70-0029-4218-8225-41fd51120598\" (UID: \"b9afac70-0029-4218-8225-41fd51120598\") "
Jul 05 13:27:00.574949 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:00.574925    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9afac70-0029-4218-8225-41fd51120598-config-file" (OuterVolumeSpecName: "config-file") pod "b9afac70-0029-4218-8225-41fd51120598" (UID: "b9afac70-0029-4218-8225-41fd51120598"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 05 13:27:00.576637 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:00.576615    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9afac70-0029-4218-8225-41fd51120598-kube-api-access-72fcb" (OuterVolumeSpecName: "kube-api-access-72fcb") pod "b9afac70-0029-4218-8225-41fd51120598" (UID: "b9afac70-0029-4218-8225-41fd51120598"). InnerVolumeSpecName "kube-api-access-72fcb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 13:27:00.676108 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:00.676055    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-72fcb\" (UniqueName: \"kubernetes.io/projected/b9afac70-0029-4218-8225-41fd51120598-kube-api-access-72fcb\") on node \"ip-10-0-129-239.ec2.internal\" DevicePath \"\""
Jul 05 13:27:00.676108 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:00.676102    2563 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b9afac70-0029-4218-8225-41fd51120598-config-file\") on node \"ip-10-0-129-239.ec2.internal\" DevicePath \"\""
Jul 05 13:27:01.082628 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:01.082594    2563 generic.go:356] "Generic (PLEG): container finished" podID="b9afac70-0029-4218-8225-41fd51120598" containerID="86b849e7b46a21edd80ba8641d31d098655486a91b28263c099e35f0d4ca8512" exitCode=0
Jul 05 13:27:01.083140 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:01.082641    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-mjctx"
Jul 05 13:27:01.083140 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:01.082641    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-mjctx" event={"ID":"b9afac70-0029-4218-8225-41fd51120598","Type":"ContainerDied","Data":"86b849e7b46a21edd80ba8641d31d098655486a91b28263c099e35f0d4ca8512"}
Jul 05 13:27:01.083140 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:01.082758    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-mjctx" event={"ID":"b9afac70-0029-4218-8225-41fd51120598","Type":"ContainerDied","Data":"368080eb047952a7a5e2f34348600daf9d7b96676cb83dd8521fb59af7e92896"}
Jul 05 13:27:01.083140 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:01.082795    2563 scope.go:117] "RemoveContainer" containerID="86b849e7b46a21edd80ba8641d31d098655486a91b28263c099e35f0d4ca8512"
Jul 05 13:27:01.093508 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:01.093481    2563 scope.go:117] "RemoveContainer" containerID="86b849e7b46a21edd80ba8641d31d098655486a91b28263c099e35f0d4ca8512"
Jul 05 13:27:01.093813 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:27:01.093795    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86b849e7b46a21edd80ba8641d31d098655486a91b28263c099e35f0d4ca8512\": container with ID starting with 86b849e7b46a21edd80ba8641d31d098655486a91b28263c099e35f0d4ca8512 not found: ID does not exist" containerID="86b849e7b46a21edd80ba8641d31d098655486a91b28263c099e35f0d4ca8512"
Jul 05 13:27:01.093864 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:01.093824    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86b849e7b46a21edd80ba8641d31d098655486a91b28263c099e35f0d4ca8512"} err="failed to get container status \"86b849e7b46a21edd80ba8641d31d098655486a91b28263c099e35f0d4ca8512\": rpc error: code = NotFound desc = could not find container \"86b849e7b46a21edd80ba8641d31d098655486a91b28263c099e35f0d4ca8512\": container with ID starting with 86b849e7b46a21edd80ba8641d31d098655486a91b28263c099e35f0d4ca8512 not found: ID does not exist"
Jul 05 13:27:01.122999 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:01.122964    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mjctx"]
Jul 05 13:27:01.137255 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:01.137209    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mjctx"]
Jul 05 13:27:02.349121 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:02.349083    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9afac70-0029-4218-8225-41fd51120598" path="/var/lib/kubelet/pods/b9afac70-0029-4218-8225-41fd51120598/volumes"
Jul 05 13:27:06.669182 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:06.669143    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-dtd5f"]
Jul 05 13:27:06.669579 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:06.669520    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9afac70-0029-4218-8225-41fd51120598" containerName="limitador"
Jul 05 13:27:06.669579 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:06.669534    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9afac70-0029-4218-8225-41fd51120598" containerName="limitador"
Jul 05 13:27:06.669653 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:06.669588    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9afac70-0029-4218-8225-41fd51120598" containerName="limitador"
Jul 05 13:27:06.673782 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:06.673764    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-dtd5f"
Jul 05 13:27:06.676861 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:06.676835    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\""
Jul 05 13:27:06.677470 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:06.677454    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-rdzwh\""
Jul 05 13:27:06.705664 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:06.705629    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-dtd5f"]
Jul 05 13:27:06.776915 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:06.776877    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:27:06.828613 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:06.828578    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e7cc7d59-c515-47c7-8eab-bb92468c73c8-data\") pod \"postgres-69fb4594cf-dtd5f\" (UID: \"e7cc7d59-c515-47c7-8eab-bb92468c73c8\") " pod="opendatahub/postgres-69fb4594cf-dtd5f"
Jul 05 13:27:06.828785 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:06.828643    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ql2g7\" (UniqueName: \"kubernetes.io/projected/e7cc7d59-c515-47c7-8eab-bb92468c73c8-kube-api-access-ql2g7\") pod \"postgres-69fb4594cf-dtd5f\" (UID: \"e7cc7d59-c515-47c7-8eab-bb92468c73c8\") " pod="opendatahub/postgres-69fb4594cf-dtd5f"
Jul 05 13:27:06.930184 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:06.930092    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ql2g7\" (UniqueName: \"kubernetes.io/projected/e7cc7d59-c515-47c7-8eab-bb92468c73c8-kube-api-access-ql2g7\") pod \"postgres-69fb4594cf-dtd5f\" (UID: \"e7cc7d59-c515-47c7-8eab-bb92468c73c8\") " pod="opendatahub/postgres-69fb4594cf-dtd5f"
Jul 05 13:27:06.930373 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:06.930195    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e7cc7d59-c515-47c7-8eab-bb92468c73c8-data\") pod \"postgres-69fb4594cf-dtd5f\" (UID: \"e7cc7d59-c515-47c7-8eab-bb92468c73c8\") " pod="opendatahub/postgres-69fb4594cf-dtd5f"
Jul 05 13:27:06.930605 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:06.930586    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e7cc7d59-c515-47c7-8eab-bb92468c73c8-data\") pod \"postgres-69fb4594cf-dtd5f\" (UID: \"e7cc7d59-c515-47c7-8eab-bb92468c73c8\") " pod="opendatahub/postgres-69fb4594cf-dtd5f"
Jul 05 13:27:06.940400 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:06.940371    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ql2g7\" (UniqueName: \"kubernetes.io/projected/e7cc7d59-c515-47c7-8eab-bb92468c73c8-kube-api-access-ql2g7\") pod \"postgres-69fb4594cf-dtd5f\" (UID: \"e7cc7d59-c515-47c7-8eab-bb92468c73c8\") " pod="opendatahub/postgres-69fb4594cf-dtd5f"
Jul 05 13:27:06.984230 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:06.984177    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-dtd5f"
Jul 05 13:27:07.133913 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:07.133884    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-dtd5f"]
Jul 05 13:27:07.138000 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:27:07.137975    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7cc7d59_c515_47c7_8eab_bb92468c73c8.slice/crio-006fa300c92a668ef9b059a69096824aab035921b1ef1231654203488644bb91 WatchSource:0}: Error finding container 006fa300c92a668ef9b059a69096824aab035921b1ef1231654203488644bb91: Status 404 returned error can't find the container with id 006fa300c92a668ef9b059a69096824aab035921b1ef1231654203488644bb91
Jul 05 13:27:08.121608 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:08.121571    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-dtd5f" event={"ID":"e7cc7d59-c515-47c7-8eab-bb92468c73c8","Type":"ContainerStarted","Data":"006fa300c92a668ef9b059a69096824aab035921b1ef1231654203488644bb91"}
Jul 05 13:27:12.144981 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:12.144945    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-dtd5f" event={"ID":"e7cc7d59-c515-47c7-8eab-bb92468c73c8","Type":"ContainerStarted","Data":"11f8c8dc66d05cee129869e0090ffcdff293249083e64379ccaa9ae0e6f7b94d"}
Jul 05 13:27:13.149680 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:13.149643    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-dtd5f"
Jul 05 13:27:13.171459 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:13.171391    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-dtd5f" podStartSLOduration=2.236158283 podStartE2EDuration="7.171369724s" totalImagesPullingTime="4.935211441s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:27:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:27:13.168953613 +0000 UTC m=+713.262839262" watchObservedRunningTime="2026-07-05 13:27:13.171369724 +0000 UTC m=+713.265255351"
Jul 05 13:27:19.185741 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:19.185710    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-dtd5f"
Jul 05 13:27:19.571011 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:19.570978    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:27:19.954958 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:19.954874    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:27:27.164145 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:27.164112    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:27:27.217647 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:27.217602    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-755988676-lzz8f"]
Jul 05 13:27:27.244384 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:27.244338    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-755988676-lzz8f"]
Jul 05 13:27:27.244563 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:27.244466    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-755988676-lzz8f"
Jul 05 13:27:27.247811 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:27.247783    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 05 13:27:27.247959 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:27.247785    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 05 13:27:27.248465 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:27.248443    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-mxg8l\""
Jul 05 13:27:27.308496 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:27.308464    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0a7083af-bc59-4ac9-94d9-d3e7abde8abb-webhook-cert\") pod \"maas-controller-755988676-lzz8f\" (UID: \"0a7083af-bc59-4ac9-94d9-d3e7abde8abb\") " pod="opendatahub/maas-controller-755988676-lzz8f"
Jul 05 13:27:27.308679 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:27.308525    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dsg2\" (UniqueName: \"kubernetes.io/projected/0a7083af-bc59-4ac9-94d9-d3e7abde8abb-kube-api-access-9dsg2\") pod \"maas-controller-755988676-lzz8f\" (UID: \"0a7083af-bc59-4ac9-94d9-d3e7abde8abb\") " pod="opendatahub/maas-controller-755988676-lzz8f"
Jul 05 13:27:27.327193 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:27.327165    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:27:27.409965 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:27.409932    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dsg2\" (UniqueName: \"kubernetes.io/projected/0a7083af-bc59-4ac9-94d9-d3e7abde8abb-kube-api-access-9dsg2\") pod \"maas-controller-755988676-lzz8f\" (UID: \"0a7083af-bc59-4ac9-94d9-d3e7abde8abb\") " pod="opendatahub/maas-controller-755988676-lzz8f"
Jul 05 13:27:27.410165 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:27.409998    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0a7083af-bc59-4ac9-94d9-d3e7abde8abb-webhook-cert\") pod \"maas-controller-755988676-lzz8f\" (UID: \"0a7083af-bc59-4ac9-94d9-d3e7abde8abb\") " pod="opendatahub/maas-controller-755988676-lzz8f"
Jul 05 13:27:27.412512 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:27.412488    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0a7083af-bc59-4ac9-94d9-d3e7abde8abb-webhook-cert\") pod \"maas-controller-755988676-lzz8f\" (UID: \"0a7083af-bc59-4ac9-94d9-d3e7abde8abb\") " pod="opendatahub/maas-controller-755988676-lzz8f"
Jul 05 13:27:27.431405 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:27.431311    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dsg2\" (UniqueName: \"kubernetes.io/projected/0a7083af-bc59-4ac9-94d9-d3e7abde8abb-kube-api-access-9dsg2\") pod \"maas-controller-755988676-lzz8f\" (UID: \"0a7083af-bc59-4ac9-94d9-d3e7abde8abb\") " pod="opendatahub/maas-controller-755988676-lzz8f"
Jul 05 13:27:27.433687 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:27.433656    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6845d5b85-v8qnd"]
Jul 05 13:27:27.438022 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:27.437990    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6845d5b85-v8qnd"
Jul 05 13:27:27.438950 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:27.438926    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:27:27.447945 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:27.447920    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6845d5b85-v8qnd"]
Jul 05 13:27:27.511489 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:27.511454    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/956efc86-6483-4188-aac3-450f0e8653d9-webhook-cert\") pod \"maas-controller-6845d5b85-v8qnd\" (UID: \"956efc86-6483-4188-aac3-450f0e8653d9\") " pod="opendatahub/maas-controller-6845d5b85-v8qnd"
Jul 05 13:27:27.511683 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:27.511537    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwd7h\" (UniqueName: \"kubernetes.io/projected/956efc86-6483-4188-aac3-450f0e8653d9-kube-api-access-gwd7h\") pod \"maas-controller-6845d5b85-v8qnd\" (UID: \"956efc86-6483-4188-aac3-450f0e8653d9\") " pod="opendatahub/maas-controller-6845d5b85-v8qnd"
Jul 05 13:27:27.536274 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:27.536246    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:27:27.555286 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:27.555249    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-755988676-lzz8f"
Jul 05 13:27:27.612567 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:27.612534    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/956efc86-6483-4188-aac3-450f0e8653d9-webhook-cert\") pod \"maas-controller-6845d5b85-v8qnd\" (UID: \"956efc86-6483-4188-aac3-450f0e8653d9\") " pod="opendatahub/maas-controller-6845d5b85-v8qnd"
Jul 05 13:27:27.612731 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:27.612639    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwd7h\" (UniqueName: \"kubernetes.io/projected/956efc86-6483-4188-aac3-450f0e8653d9-kube-api-access-gwd7h\") pod \"maas-controller-6845d5b85-v8qnd\" (UID: \"956efc86-6483-4188-aac3-450f0e8653d9\") " pod="opendatahub/maas-controller-6845d5b85-v8qnd"
Jul 05 13:27:27.614923 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:27.614889    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/956efc86-6483-4188-aac3-450f0e8653d9-webhook-cert\") pod \"maas-controller-6845d5b85-v8qnd\" (UID: \"956efc86-6483-4188-aac3-450f0e8653d9\") " pod="opendatahub/maas-controller-6845d5b85-v8qnd"
Jul 05 13:27:27.626487 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:27.626454    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwd7h\" (UniqueName: \"kubernetes.io/projected/956efc86-6483-4188-aac3-450f0e8653d9-kube-api-access-gwd7h\") pod \"maas-controller-6845d5b85-v8qnd\" (UID: \"956efc86-6483-4188-aac3-450f0e8653d9\") " pod="opendatahub/maas-controller-6845d5b85-v8qnd"
Jul 05 13:27:27.717126 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:27.717041    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-755988676-lzz8f"]
Jul 05 13:27:27.725562 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:27:27.725535    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a7083af_bc59_4ac9_94d9_d3e7abde8abb.slice/crio-f230610bafc86a26102e1aea5b6df8b8b64c0c03d4be1a313bf5f998a08d6587 WatchSource:0}: Error finding container f230610bafc86a26102e1aea5b6df8b8b64c0c03d4be1a313bf5f998a08d6587: Status 404 returned error can't find the container with id f230610bafc86a26102e1aea5b6df8b8b64c0c03d4be1a313bf5f998a08d6587
Jul 05 13:27:27.750129 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:27.750094    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6845d5b85-v8qnd"
Jul 05 13:27:27.895314 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:27.895287    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6845d5b85-v8qnd"]
Jul 05 13:27:27.897709 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:27:27.897683    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod956efc86_6483_4188_aac3_450f0e8653d9.slice/crio-3a4af1025098ea1e074defeb633bb3c461d4b5e1777ec13878ca5f0dd59f8d2a WatchSource:0}: Error finding container 3a4af1025098ea1e074defeb633bb3c461d4b5e1777ec13878ca5f0dd59f8d2a: Status 404 returned error can't find the container with id 3a4af1025098ea1e074defeb633bb3c461d4b5e1777ec13878ca5f0dd59f8d2a
Jul 05 13:27:28.225806 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:28.225763    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6845d5b85-v8qnd" event={"ID":"956efc86-6483-4188-aac3-450f0e8653d9","Type":"ContainerStarted","Data":"3a4af1025098ea1e074defeb633bb3c461d4b5e1777ec13878ca5f0dd59f8d2a"}
Jul 05 13:27:28.226910 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:28.226885    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-755988676-lzz8f" event={"ID":"0a7083af-bc59-4ac9-94d9-d3e7abde8abb","Type":"ContainerStarted","Data":"f230610bafc86a26102e1aea5b6df8b8b64c0c03d4be1a313bf5f998a08d6587"}
Jul 05 13:27:30.707620 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:30.707535    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:27:30.805775 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:30.805732    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:27:31.246789 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:31.246751    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6845d5b85-v8qnd" event={"ID":"956efc86-6483-4188-aac3-450f0e8653d9","Type":"ContainerStarted","Data":"a49af6d1709f21581d6ddb7a7adc89b446d931c59a59bafa6473ba0074182256"}
Jul 05 13:27:31.247003 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:31.246884    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6845d5b85-v8qnd"
Jul 05 13:27:31.248495 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:31.248470    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-755988676-lzz8f" event={"ID":"0a7083af-bc59-4ac9-94d9-d3e7abde8abb","Type":"ContainerStarted","Data":"9aaacdcf88b95ec9e0a66c2f9852b4894c4f835812e09130897407adb4819a4f"}
Jul 05 13:27:31.248623 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:31.248572    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-755988676-lzz8f"
Jul 05 13:27:31.273052 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:31.273002    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6845d5b85-v8qnd" podStartSLOduration=1.763895618 podStartE2EDuration="4.272986304s" totalImagesPullingTime="2.509090686s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:27:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:27:31.270955414 +0000 UTC m=+731.364841052" watchObservedRunningTime="2026-07-05 13:27:31.272986304 +0000 UTC m=+731.366871999"
Jul 05 13:27:31.347237 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:31.347172    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-755988676-lzz8f" podStartSLOduration=1.672666143 podStartE2EDuration="4.347154612s" totalImagesPullingTime="2.674488469s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:27:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:27:31.344836882 +0000 UTC m=+731.438722510" watchObservedRunningTime="2026-07-05 13:27:31.347154612 +0000 UTC m=+731.441040291"
Jul 05 13:27:40.191993 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:40.191957    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:27:40.288272 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:40.288215    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:27:42.258582 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:42.258553    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6845d5b85-v8qnd"
Jul 05 13:27:42.259058 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:42.258621    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-755988676-lzz8f"
Jul 05 13:27:42.332937 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:42.332905    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-755988676-lzz8f"]
Jul 05 13:27:42.333157 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:42.333108    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-755988676-lzz8f" podUID="0a7083af-bc59-4ac9-94d9-d3e7abde8abb" containerName="manager" containerID="cri-o://9aaacdcf88b95ec9e0a66c2f9852b4894c4f835812e09130897407adb4819a4f" gracePeriod=30
Jul 05 13:27:42.581086 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:42.581056    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-755988676-lzz8f"
Jul 05 13:27:42.653987 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:42.653958    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9dsg2\" (UniqueName: \"kubernetes.io/projected/0a7083af-bc59-4ac9-94d9-d3e7abde8abb-kube-api-access-9dsg2\") pod \"0a7083af-bc59-4ac9-94d9-d3e7abde8abb\" (UID: \"0a7083af-bc59-4ac9-94d9-d3e7abde8abb\") "
Jul 05 13:27:42.654158 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:42.654004    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0a7083af-bc59-4ac9-94d9-d3e7abde8abb-webhook-cert\") pod \"0a7083af-bc59-4ac9-94d9-d3e7abde8abb\" (UID: \"0a7083af-bc59-4ac9-94d9-d3e7abde8abb\") "
Jul 05 13:27:42.656313 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:42.656278    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a7083af-bc59-4ac9-94d9-d3e7abde8abb-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "0a7083af-bc59-4ac9-94d9-d3e7abde8abb" (UID: "0a7083af-bc59-4ac9-94d9-d3e7abde8abb"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 05 13:27:42.656438 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:42.656319    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a7083af-bc59-4ac9-94d9-d3e7abde8abb-kube-api-access-9dsg2" (OuterVolumeSpecName: "kube-api-access-9dsg2") pod "0a7083af-bc59-4ac9-94d9-d3e7abde8abb" (UID: "0a7083af-bc59-4ac9-94d9-d3e7abde8abb"). InnerVolumeSpecName "kube-api-access-9dsg2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 13:27:42.755588 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:42.755554    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9dsg2\" (UniqueName: \"kubernetes.io/projected/0a7083af-bc59-4ac9-94d9-d3e7abde8abb-kube-api-access-9dsg2\") on node \"ip-10-0-129-239.ec2.internal\" DevicePath \"\""
Jul 05 13:27:42.755588 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:42.755582    2563 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0a7083af-bc59-4ac9-94d9-d3e7abde8abb-webhook-cert\") on node \"ip-10-0-129-239.ec2.internal\" DevicePath \"\""
Jul 05 13:27:43.305378 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:43.305347    2563 generic.go:356] "Generic (PLEG): container finished" podID="0a7083af-bc59-4ac9-94d9-d3e7abde8abb" containerID="9aaacdcf88b95ec9e0a66c2f9852b4894c4f835812e09130897407adb4819a4f" exitCode=0
Jul 05 13:27:43.305818 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:43.305404    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-755988676-lzz8f"
Jul 05 13:27:43.305818 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:43.305436    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-755988676-lzz8f" event={"ID":"0a7083af-bc59-4ac9-94d9-d3e7abde8abb","Type":"ContainerDied","Data":"9aaacdcf88b95ec9e0a66c2f9852b4894c4f835812e09130897407adb4819a4f"}
Jul 05 13:27:43.305818 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:43.305490    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-755988676-lzz8f" event={"ID":"0a7083af-bc59-4ac9-94d9-d3e7abde8abb","Type":"ContainerDied","Data":"f230610bafc86a26102e1aea5b6df8b8b64c0c03d4be1a313bf5f998a08d6587"}
Jul 05 13:27:43.305818 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:43.305514    2563 scope.go:117] "RemoveContainer" containerID="9aaacdcf88b95ec9e0a66c2f9852b4894c4f835812e09130897407adb4819a4f"
Jul 05 13:27:43.314796 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:43.314778    2563 scope.go:117] "RemoveContainer" containerID="9aaacdcf88b95ec9e0a66c2f9852b4894c4f835812e09130897407adb4819a4f"
Jul 05 13:27:43.315034 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:27:43.315013    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9aaacdcf88b95ec9e0a66c2f9852b4894c4f835812e09130897407adb4819a4f\": container with ID starting with 9aaacdcf88b95ec9e0a66c2f9852b4894c4f835812e09130897407adb4819a4f not found: ID does not exist" containerID="9aaacdcf88b95ec9e0a66c2f9852b4894c4f835812e09130897407adb4819a4f"
Jul 05 13:27:43.315076 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:43.315044    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9aaacdcf88b95ec9e0a66c2f9852b4894c4f835812e09130897407adb4819a4f"} err="failed to get container status \"9aaacdcf88b95ec9e0a66c2f9852b4894c4f835812e09130897407adb4819a4f\": rpc error: code = NotFound desc = could not find container \"9aaacdcf88b95ec9e0a66c2f9852b4894c4f835812e09130897407adb4819a4f\": container with ID starting with 9aaacdcf88b95ec9e0a66c2f9852b4894c4f835812e09130897407adb4819a4f not found: ID does not exist"
Jul 05 13:27:43.329031 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:43.329004    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-755988676-lzz8f"]
Jul 05 13:27:43.331359 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:43.331330    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-755988676-lzz8f"]
Jul 05 13:27:44.349551 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:27:44.349516    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a7083af-bc59-4ac9-94d9-d3e7abde8abb" path="/var/lib/kubelet/pods/0a7083af-bc59-4ac9-94d9-d3e7abde8abb/volumes"
Jul 05 13:28:01.715400 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:01.715367    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:28:01.772576 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:01.772544    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:28:02.164430 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:02.164392    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:28:02.684417 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:02.684386    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:28:02.798056 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:02.798023    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:28:03.247272 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:03.247234    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:28:03.333876 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:03.333828    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:28:03.381066 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:03.381036    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-qmn7b"]
Jul 05 13:28:03.381419 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:03.381407    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a7083af-bc59-4ac9-94d9-d3e7abde8abb" containerName="manager"
Jul 05 13:28:03.381470 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:03.381421    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a7083af-bc59-4ac9-94d9-d3e7abde8abb" containerName="manager"
Jul 05 13:28:03.381505 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:03.381476    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a7083af-bc59-4ac9-94d9-d3e7abde8abb" containerName="manager"
Jul 05 13:28:03.386754 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:03.386733    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-qmn7b"
Jul 05 13:28:03.389469 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:03.389437    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 05 13:28:03.389604 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:03.389498    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-nf6m4\""
Jul 05 13:28:03.396045 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:03.396022    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-qmn7b"]
Jul 05 13:28:03.435080 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:03.435042    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8st9m\" (UniqueName: \"kubernetes.io/projected/24907e05-7aa3-4332-9864-b42cadef9d2c-kube-api-access-8st9m\") pod \"payload-processing-58f86c7798-qmn7b\" (UID: \"24907e05-7aa3-4332-9864-b42cadef9d2c\") " pod="openshift-ingress/payload-processing-58f86c7798-qmn7b"
Jul 05 13:28:03.435307 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:03.435091    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/24907e05-7aa3-4332-9864-b42cadef9d2c-plugins-config-volume\") pod \"payload-processing-58f86c7798-qmn7b\" (UID: \"24907e05-7aa3-4332-9864-b42cadef9d2c\") " pod="openshift-ingress/payload-processing-58f86c7798-qmn7b"
Jul 05 13:28:03.536379 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:03.536343    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8st9m\" (UniqueName: \"kubernetes.io/projected/24907e05-7aa3-4332-9864-b42cadef9d2c-kube-api-access-8st9m\") pod \"payload-processing-58f86c7798-qmn7b\" (UID: \"24907e05-7aa3-4332-9864-b42cadef9d2c\") " pod="openshift-ingress/payload-processing-58f86c7798-qmn7b"
Jul 05 13:28:03.536569 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:03.536392    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/24907e05-7aa3-4332-9864-b42cadef9d2c-plugins-config-volume\") pod \"payload-processing-58f86c7798-qmn7b\" (UID: \"24907e05-7aa3-4332-9864-b42cadef9d2c\") " pod="openshift-ingress/payload-processing-58f86c7798-qmn7b"
Jul 05 13:28:03.537249 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:03.537205    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/24907e05-7aa3-4332-9864-b42cadef9d2c-plugins-config-volume\") pod \"payload-processing-58f86c7798-qmn7b\" (UID: \"24907e05-7aa3-4332-9864-b42cadef9d2c\") " pod="openshift-ingress/payload-processing-58f86c7798-qmn7b"
Jul 05 13:28:03.547357 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:03.547327    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8st9m\" (UniqueName: \"kubernetes.io/projected/24907e05-7aa3-4332-9864-b42cadef9d2c-kube-api-access-8st9m\") pod \"payload-processing-58f86c7798-qmn7b\" (UID: \"24907e05-7aa3-4332-9864-b42cadef9d2c\") " pod="openshift-ingress/payload-processing-58f86c7798-qmn7b"
Jul 05 13:28:03.699234 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:03.699184    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-qmn7b"
Jul 05 13:28:03.842078 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:03.842055    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-qmn7b"]
Jul 05 13:28:03.844899 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:28:03.844863    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24907e05_7aa3_4332_9864_b42cadef9d2c.slice/crio-68cbd6837e35cb7dcf468430bf63cd68ec44c5f09684160ea4cd1f5b7d634855 WatchSource:0}: Error finding container 68cbd6837e35cb7dcf468430bf63cd68ec44c5f09684160ea4cd1f5b7d634855: Status 404 returned error can't find the container with id 68cbd6837e35cb7dcf468430bf63cd68ec44c5f09684160ea4cd1f5b7d634855
Jul 05 13:28:04.405830 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:04.405787    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-qmn7b" event={"ID":"24907e05-7aa3-4332-9864-b42cadef9d2c","Type":"ContainerStarted","Data":"68cbd6837e35cb7dcf468430bf63cd68ec44c5f09684160ea4cd1f5b7d634855"}
Jul 05 13:28:05.412299 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:05.412260    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-qmn7b" event={"ID":"24907e05-7aa3-4332-9864-b42cadef9d2c","Type":"ContainerStarted","Data":"c8ef0d36e8abdb37852b4d065409ae9c84ece95e2706d738561b1138c5a8f444"}
Jul 05 13:28:05.412754 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:05.412383    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-qmn7b"
Jul 05 13:28:05.430072 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:05.430016    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-qmn7b" podStartSLOduration=0.989073169 podStartE2EDuration="2.429997467s" totalImagesPullingTime="1.440924298s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:28:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:28:05.428122323 +0000 UTC m=+765.522007939" watchObservedRunningTime="2026-07-05 13:28:05.429997467 +0000 UTC m=+765.523883092"
Jul 05 13:28:12.569199 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:12.569151    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:28:12.692494 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:12.692460    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:28:16.419851 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:16.419820    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-qmn7b"
Jul 05 13:28:20.906418 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:20.906382    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vqzjg"]
Jul 05 13:28:20.910958 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:20.910939    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vqzjg"
Jul 05 13:28:20.914754 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:20.914723    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 05 13:28:20.914754 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:20.914753    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 05 13:28:20.914969 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:20.914724    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-sxwzc\""
Jul 05 13:28:20.914969 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:20.914724    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 05 13:28:20.938008 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:20.937967    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vqzjg"]
Jul 05 13:28:20.943852 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:20.943819    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:28:20.995567 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:20.995528    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mq6wz\" (UniqueName: \"kubernetes.io/projected/a76c4df1-f0fa-44b3-a948-3a1a8daaec35-kube-api-access-mq6wz\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vqzjg\" (UID: \"a76c4df1-f0fa-44b3-a948-3a1a8daaec35\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vqzjg"
Jul 05 13:28:20.995754 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:20.995577    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a76c4df1-f0fa-44b3-a948-3a1a8daaec35-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vqzjg\" (UID: \"a76c4df1-f0fa-44b3-a948-3a1a8daaec35\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vqzjg"
Jul 05 13:28:20.995754 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:20.995600    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a76c4df1-f0fa-44b3-a948-3a1a8daaec35-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vqzjg\" (UID: \"a76c4df1-f0fa-44b3-a948-3a1a8daaec35\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vqzjg"
Jul 05 13:28:20.995754 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:20.995651    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a76c4df1-f0fa-44b3-a948-3a1a8daaec35-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vqzjg\" (UID: \"a76c4df1-f0fa-44b3-a948-3a1a8daaec35\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vqzjg"
Jul 05 13:28:20.995754 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:20.995670    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a76c4df1-f0fa-44b3-a948-3a1a8daaec35-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vqzjg\" (UID: \"a76c4df1-f0fa-44b3-a948-3a1a8daaec35\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vqzjg"
Jul 05 13:28:20.995754 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:20.995689    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a76c4df1-f0fa-44b3-a948-3a1a8daaec35-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vqzjg\" (UID: \"a76c4df1-f0fa-44b3-a948-3a1a8daaec35\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vqzjg"
Jul 05 13:28:21.097043 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:21.097002    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mq6wz\" (UniqueName: \"kubernetes.io/projected/a76c4df1-f0fa-44b3-a948-3a1a8daaec35-kube-api-access-mq6wz\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vqzjg\" (UID: \"a76c4df1-f0fa-44b3-a948-3a1a8daaec35\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vqzjg"
Jul 05 13:28:21.097043 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:21.097044    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a76c4df1-f0fa-44b3-a948-3a1a8daaec35-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vqzjg\" (UID: \"a76c4df1-f0fa-44b3-a948-3a1a8daaec35\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vqzjg"
Jul 05 13:28:21.097329 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:21.097062    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a76c4df1-f0fa-44b3-a948-3a1a8daaec35-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vqzjg\" (UID: \"a76c4df1-f0fa-44b3-a948-3a1a8daaec35\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vqzjg"
Jul 05 13:28:21.097329 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:21.097102    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a76c4df1-f0fa-44b3-a948-3a1a8daaec35-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vqzjg\" (UID: \"a76c4df1-f0fa-44b3-a948-3a1a8daaec35\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vqzjg"
Jul 05 13:28:21.097329 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:21.097121    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a76c4df1-f0fa-44b3-a948-3a1a8daaec35-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vqzjg\" (UID: \"a76c4df1-f0fa-44b3-a948-3a1a8daaec35\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vqzjg"
Jul 05 13:28:21.097329 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:21.097147    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a76c4df1-f0fa-44b3-a948-3a1a8daaec35-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vqzjg\" (UID: \"a76c4df1-f0fa-44b3-a948-3a1a8daaec35\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vqzjg"
Jul 05 13:28:21.097579 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:21.097554    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a76c4df1-f0fa-44b3-a948-3a1a8daaec35-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vqzjg\" (UID: \"a76c4df1-f0fa-44b3-a948-3a1a8daaec35\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vqzjg"
Jul 05 13:28:21.097652 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:21.097608    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a76c4df1-f0fa-44b3-a948-3a1a8daaec35-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vqzjg\" (UID: \"a76c4df1-f0fa-44b3-a948-3a1a8daaec35\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vqzjg"
Jul 05 13:28:21.097652 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:21.097631    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a76c4df1-f0fa-44b3-a948-3a1a8daaec35-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vqzjg\" (UID: \"a76c4df1-f0fa-44b3-a948-3a1a8daaec35\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vqzjg"
Jul 05 13:28:21.099333 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:21.099305    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a76c4df1-f0fa-44b3-a948-3a1a8daaec35-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vqzjg\" (UID: \"a76c4df1-f0fa-44b3-a948-3a1a8daaec35\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vqzjg"
Jul 05 13:28:21.099649 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:21.099632    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a76c4df1-f0fa-44b3-a948-3a1a8daaec35-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vqzjg\" (UID: \"a76c4df1-f0fa-44b3-a948-3a1a8daaec35\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vqzjg"
Jul 05 13:28:21.107495 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:21.107466    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mq6wz\" (UniqueName: \"kubernetes.io/projected/a76c4df1-f0fa-44b3-a948-3a1a8daaec35-kube-api-access-mq6wz\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vqzjg\" (UID: \"a76c4df1-f0fa-44b3-a948-3a1a8daaec35\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vqzjg"
Jul 05 13:28:21.221393 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:21.221274    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vqzjg"
Jul 05 13:28:21.359503 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:21.359476    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vqzjg"]
Jul 05 13:28:21.361970 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:28:21.361942    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda76c4df1_f0fa_44b3_a948_3a1a8daaec35.slice/crio-10d28b035019460b4cba10be067bbdec5241ced3073fe197c966fef7713abb88 WatchSource:0}: Error finding container 10d28b035019460b4cba10be067bbdec5241ced3073fe197c966fef7713abb88: Status 404 returned error can't find the container with id 10d28b035019460b4cba10be067bbdec5241ced3073fe197c966fef7713abb88
Jul 05 13:28:21.490612 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:21.490527    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vqzjg" event={"ID":"a76c4df1-f0fa-44b3-a948-3a1a8daaec35","Type":"ContainerStarted","Data":"10d28b035019460b4cba10be067bbdec5241ced3073fe197c966fef7713abb88"}
Jul 05 13:28:23.501035 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:23.500996    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vqzjg" event={"ID":"a76c4df1-f0fa-44b3-a948-3a1a8daaec35","Type":"ContainerStarted","Data":"2bcf415af9b3f6ae7c0dbfa164f0dd35b188c40a2dec3e5f84f70c14fedf9de5"}
Jul 05 13:28:23.519457 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:23.519401    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vqzjg" podStartSLOduration=2.374986184 podStartE2EDuration="3.519381036s" totalImagesPullingTime="1.144394852s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:28:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:28:23.518019259 +0000 UTC m=+783.611904885" watchObservedRunningTime="2026-07-05 13:28:23.519381036 +0000 UTC m=+783.613266661"
Jul 05 13:28:26.282327 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:26.282190    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:28:31.221678 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:31.221631    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vqzjg"
Jul 05 13:28:31.222191 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:31.221700    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vqzjg"
Jul 05 13:28:31.234578 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:31.234552    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vqzjg"
Jul 05 13:28:31.550170 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:31.550139    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vqzjg"
Jul 05 13:28:34.543557 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:34.543512    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-b2ltb"]
Jul 05 13:28:34.548162 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:34.548128    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b2ltb"
Jul 05 13:28:34.550818 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:34.550797    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 05 13:28:34.558673 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:34.558646    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-b2ltb"]
Jul 05 13:28:34.584787 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:34.584751    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:28:34.622307 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:34.622270    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7bb0d007-5078-4c33-a1f2-6cec7248295f-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-b2ltb\" (UID: \"7bb0d007-5078-4c33-a1f2-6cec7248295f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b2ltb"
Jul 05 13:28:34.622307 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:34.622309    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7bb0d007-5078-4c33-a1f2-6cec7248295f-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-b2ltb\" (UID: \"7bb0d007-5078-4c33-a1f2-6cec7248295f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b2ltb"
Jul 05 13:28:34.622524 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:34.622338    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7bb0d007-5078-4c33-a1f2-6cec7248295f-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-b2ltb\" (UID: \"7bb0d007-5078-4c33-a1f2-6cec7248295f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b2ltb"
Jul 05 13:28:34.622524 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:34.622424    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7bb0d007-5078-4c33-a1f2-6cec7248295f-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-b2ltb\" (UID: \"7bb0d007-5078-4c33-a1f2-6cec7248295f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b2ltb"
Jul 05 13:28:34.622524 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:34.622454    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2d7xd\" (UniqueName: \"kubernetes.io/projected/7bb0d007-5078-4c33-a1f2-6cec7248295f-kube-api-access-2d7xd\") pod \"e2e-trlp-test-simulated-kserve-598466548d-b2ltb\" (UID: \"7bb0d007-5078-4c33-a1f2-6cec7248295f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b2ltb"
Jul 05 13:28:34.622622 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:34.622550    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7bb0d007-5078-4c33-a1f2-6cec7248295f-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-b2ltb\" (UID: \"7bb0d007-5078-4c33-a1f2-6cec7248295f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b2ltb"
Jul 05 13:28:34.723996 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:34.723956    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7bb0d007-5078-4c33-a1f2-6cec7248295f-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-b2ltb\" (UID: \"7bb0d007-5078-4c33-a1f2-6cec7248295f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b2ltb"
Jul 05 13:28:34.723996 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:34.724009    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7bb0d007-5078-4c33-a1f2-6cec7248295f-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-b2ltb\" (UID: \"7bb0d007-5078-4c33-a1f2-6cec7248295f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b2ltb"
Jul 05 13:28:34.724316 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:34.724027    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7bb0d007-5078-4c33-a1f2-6cec7248295f-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-b2ltb\" (UID: \"7bb0d007-5078-4c33-a1f2-6cec7248295f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b2ltb"
Jul 05 13:28:34.724316 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:34.724053    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7bb0d007-5078-4c33-a1f2-6cec7248295f-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-b2ltb\" (UID: \"7bb0d007-5078-4c33-a1f2-6cec7248295f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b2ltb"
Jul 05 13:28:34.724316 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:34.724100    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7bb0d007-5078-4c33-a1f2-6cec7248295f-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-b2ltb\" (UID: \"7bb0d007-5078-4c33-a1f2-6cec7248295f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b2ltb"
Jul 05 13:28:34.724316 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:34.724123    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2d7xd\" (UniqueName: \"kubernetes.io/projected/7bb0d007-5078-4c33-a1f2-6cec7248295f-kube-api-access-2d7xd\") pod \"e2e-trlp-test-simulated-kserve-598466548d-b2ltb\" (UID: \"7bb0d007-5078-4c33-a1f2-6cec7248295f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b2ltb"
Jul 05 13:28:34.724532 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:34.724410    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7bb0d007-5078-4c33-a1f2-6cec7248295f-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-b2ltb\" (UID: \"7bb0d007-5078-4c33-a1f2-6cec7248295f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b2ltb"
Jul 05 13:28:34.724532 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:34.724504    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7bb0d007-5078-4c33-a1f2-6cec7248295f-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-b2ltb\" (UID: \"7bb0d007-5078-4c33-a1f2-6cec7248295f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b2ltb"
Jul 05 13:28:34.724606 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:34.724558    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7bb0d007-5078-4c33-a1f2-6cec7248295f-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-b2ltb\" (UID: \"7bb0d007-5078-4c33-a1f2-6cec7248295f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b2ltb"
Jul 05 13:28:34.726471 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:34.726451    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7bb0d007-5078-4c33-a1f2-6cec7248295f-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-b2ltb\" (UID: \"7bb0d007-5078-4c33-a1f2-6cec7248295f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b2ltb"
Jul 05 13:28:34.726637 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:34.726621    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7bb0d007-5078-4c33-a1f2-6cec7248295f-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-b2ltb\" (UID: \"7bb0d007-5078-4c33-a1f2-6cec7248295f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b2ltb"
Jul 05 13:28:34.732548 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:34.732513    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2d7xd\" (UniqueName: \"kubernetes.io/projected/7bb0d007-5078-4c33-a1f2-6cec7248295f-kube-api-access-2d7xd\") pod \"e2e-trlp-test-simulated-kserve-598466548d-b2ltb\" (UID: \"7bb0d007-5078-4c33-a1f2-6cec7248295f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b2ltb"
Jul 05 13:28:34.860515 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:34.860413    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b2ltb"
Jul 05 13:28:34.999376 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:34.999306    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-b2ltb"]
Jul 05 13:28:35.001887 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:28:35.001847    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bb0d007_5078_4c33_a1f2_6cec7248295f.slice/crio-3e5b93cf52f90f6dc3994e4bed0c7c1bc26159ca9aacf537f07568843eb5d664 WatchSource:0}: Error finding container 3e5b93cf52f90f6dc3994e4bed0c7c1bc26159ca9aacf537f07568843eb5d664: Status 404 returned error can't find the container with id 3e5b93cf52f90f6dc3994e4bed0c7c1bc26159ca9aacf537f07568843eb5d664
Jul 05 13:28:35.560177 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:35.560140    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b2ltb" event={"ID":"7bb0d007-5078-4c33-a1f2-6cec7248295f","Type":"ContainerStarted","Data":"772bdcdecbf920882e12d829ef3d9fe5d7e2dc810cad2640145fb30cc2edb68c"}
Jul 05 13:28:35.560595 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:35.560206    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b2ltb" event={"ID":"7bb0d007-5078-4c33-a1f2-6cec7248295f","Type":"ContainerStarted","Data":"3e5b93cf52f90f6dc3994e4bed0c7c1bc26159ca9aacf537f07568843eb5d664"}
Jul 05 13:28:35.581039 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:35.580977    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b2ltb" podStartSLOduration=1.418932801 podStartE2EDuration="1.580958537s" totalImagesPullingTime="162.025736ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:28:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:28:35.578842818 +0000 UTC m=+795.672728444" watchObservedRunningTime="2026-07-05 13:28:35.580958537 +0000 UTC m=+795.674844162"
Jul 05 13:28:40.114520 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:40.114477    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:28:44.861278 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:44.861159    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b2ltb"
Jul 05 13:28:44.861278 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:44.861263    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b2ltb"
Jul 05 13:28:44.873909 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:44.873877    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b2ltb"
Jul 05 13:28:45.619561 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:45.619529    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b2ltb"
Jul 05 13:28:59.350452 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:59.350418    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-wmhs8"]
Jul 05 13:28:59.357335 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:59.357310    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wmhs8"
Jul 05 13:28:59.359996 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:59.359968    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 05 13:28:59.367006 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:59.366979    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-wmhs8"]
Jul 05 13:28:59.390804 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:59.390768    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:28:59.426389 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:59.426351    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bc404e16-7be6-428c-a9ff-b1b8ff3fa3a9-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wmhs8\" (UID: \"bc404e16-7be6-428c-a9ff-b1b8ff3fa3a9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wmhs8"
Jul 05 13:28:59.426389 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:59.426389    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc404e16-7be6-428c-a9ff-b1b8ff3fa3a9-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wmhs8\" (UID: \"bc404e16-7be6-428c-a9ff-b1b8ff3fa3a9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wmhs8"
Jul 05 13:28:59.426621 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:59.426419    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9jd6\" (UniqueName: \"kubernetes.io/projected/bc404e16-7be6-428c-a9ff-b1b8ff3fa3a9-kube-api-access-h9jd6\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wmhs8\" (UID: \"bc404e16-7be6-428c-a9ff-b1b8ff3fa3a9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wmhs8"
Jul 05 13:28:59.426621 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:59.426521    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bc404e16-7be6-428c-a9ff-b1b8ff3fa3a9-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wmhs8\" (UID: \"bc404e16-7be6-428c-a9ff-b1b8ff3fa3a9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wmhs8"
Jul 05 13:28:59.426621 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:59.426549    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc404e16-7be6-428c-a9ff-b1b8ff3fa3a9-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wmhs8\" (UID: \"bc404e16-7be6-428c-a9ff-b1b8ff3fa3a9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wmhs8"
Jul 05 13:28:59.426621 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:59.426583    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bc404e16-7be6-428c-a9ff-b1b8ff3fa3a9-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wmhs8\" (UID: \"bc404e16-7be6-428c-a9ff-b1b8ff3fa3a9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wmhs8"
Jul 05 13:28:59.527415 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:59.527382    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bc404e16-7be6-428c-a9ff-b1b8ff3fa3a9-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wmhs8\" (UID: \"bc404e16-7be6-428c-a9ff-b1b8ff3fa3a9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wmhs8"
Jul 05 13:28:59.527601 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:59.527421    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc404e16-7be6-428c-a9ff-b1b8ff3fa3a9-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wmhs8\" (UID: \"bc404e16-7be6-428c-a9ff-b1b8ff3fa3a9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wmhs8"
Jul 05 13:28:59.527601 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:59.527456    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9jd6\" (UniqueName: \"kubernetes.io/projected/bc404e16-7be6-428c-a9ff-b1b8ff3fa3a9-kube-api-access-h9jd6\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wmhs8\" (UID: \"bc404e16-7be6-428c-a9ff-b1b8ff3fa3a9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wmhs8"
Jul 05 13:28:59.527601 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:59.527500    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bc404e16-7be6-428c-a9ff-b1b8ff3fa3a9-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wmhs8\" (UID: \"bc404e16-7be6-428c-a9ff-b1b8ff3fa3a9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wmhs8"
Jul 05 13:28:59.527601 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:59.527521    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc404e16-7be6-428c-a9ff-b1b8ff3fa3a9-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wmhs8\" (UID: \"bc404e16-7be6-428c-a9ff-b1b8ff3fa3a9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wmhs8"
Jul 05 13:28:59.527601 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:59.527565    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bc404e16-7be6-428c-a9ff-b1b8ff3fa3a9-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wmhs8\" (UID: \"bc404e16-7be6-428c-a9ff-b1b8ff3fa3a9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wmhs8"
Jul 05 13:28:59.528002 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:59.527978    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bc404e16-7be6-428c-a9ff-b1b8ff3fa3a9-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wmhs8\" (UID: \"bc404e16-7be6-428c-a9ff-b1b8ff3fa3a9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wmhs8"
Jul 05 13:28:59.528182 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:59.528160    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc404e16-7be6-428c-a9ff-b1b8ff3fa3a9-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wmhs8\" (UID: \"bc404e16-7be6-428c-a9ff-b1b8ff3fa3a9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wmhs8"
Jul 05 13:28:59.528283 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:59.528165    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bc404e16-7be6-428c-a9ff-b1b8ff3fa3a9-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wmhs8\" (UID: \"bc404e16-7be6-428c-a9ff-b1b8ff3fa3a9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wmhs8"
Jul 05 13:28:59.529690 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:59.529668    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bc404e16-7be6-428c-a9ff-b1b8ff3fa3a9-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wmhs8\" (UID: \"bc404e16-7be6-428c-a9ff-b1b8ff3fa3a9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wmhs8"
Jul 05 13:28:59.530147 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:59.530114    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc404e16-7be6-428c-a9ff-b1b8ff3fa3a9-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wmhs8\" (UID: \"bc404e16-7be6-428c-a9ff-b1b8ff3fa3a9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wmhs8"
Jul 05 13:28:59.536808 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:59.536784    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9jd6\" (UniqueName: \"kubernetes.io/projected/bc404e16-7be6-428c-a9ff-b1b8ff3fa3a9-kube-api-access-h9jd6\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wmhs8\" (UID: \"bc404e16-7be6-428c-a9ff-b1b8ff3fa3a9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wmhs8"
Jul 05 13:28:59.672427 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:59.672332    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wmhs8"
Jul 05 13:28:59.816865 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:28:59.816829    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-wmhs8"]
Jul 05 13:28:59.821014 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:28:59.820981    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc404e16_7be6_428c_a9ff_b1b8ff3fa3a9.slice/crio-b0992b24059fbe2ffa3e0437b5e3d13cc1ac9904d8266ac30fd6b4908e3c7b14 WatchSource:0}: Error finding container b0992b24059fbe2ffa3e0437b5e3d13cc1ac9904d8266ac30fd6b4908e3c7b14: Status 404 returned error can't find the container with id b0992b24059fbe2ffa3e0437b5e3d13cc1ac9904d8266ac30fd6b4908e3c7b14
Jul 05 13:29:00.681556 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:29:00.681518    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wmhs8" event={"ID":"bc404e16-7be6-428c-a9ff-b1b8ff3fa3a9","Type":"ContainerStarted","Data":"1ff3b18f2f5e250d21a603250eec4542818503f2b9ab5c136eb095e73a49d5cf"}
Jul 05 13:29:00.681968 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:29:00.681583    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wmhs8" event={"ID":"bc404e16-7be6-428c-a9ff-b1b8ff3fa3a9","Type":"ContainerStarted","Data":"b0992b24059fbe2ffa3e0437b5e3d13cc1ac9904d8266ac30fd6b4908e3c7b14"}
Jul 05 13:29:00.698877 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:29:00.698815    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wmhs8" podStartSLOduration=1.5178402640000002 podStartE2EDuration="1.69879356s" totalImagesPullingTime="180.953296ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:28:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:29:00.698341876 +0000 UTC m=+820.792227501" watchObservedRunningTime="2026-07-05 13:29:00.69879356 +0000 UTC m=+820.792679185"
Jul 05 13:29:03.187794 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:29:03.187763    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:29:03.287419 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:29:03.287389    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:29:09.672599 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:29:09.672555    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wmhs8"
Jul 05 13:29:09.673104 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:29:09.672627    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wmhs8"
Jul 05 13:29:09.685179 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:29:09.685150    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wmhs8"
Jul 05 13:29:09.736676 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:29:09.736642    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wmhs8"
Jul 05 13:29:14.478156 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:29:14.478125    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:30:27.254333 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:30:27.254299    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:30:28.208846 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:30:28.208806    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:30:28.426214 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:30:28.426179    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:30:28.525773 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:30:28.525689    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:30:47.186169 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:30:47.186132    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:30:47.322019 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:30:47.321984    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:31:13.137474 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:31:13.137441    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:31:17.638367 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:31:17.638330    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:31:17.694786 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:31:17.694756    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:31:48.202798 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:31:48.202764    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:31:48.294429 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:31:48.294393    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6845d5b85-v8qnd"]
Jul 05 13:31:48.294698 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:31:48.294670    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-6845d5b85-v8qnd" podUID="956efc86-6483-4188-aac3-450f0e8653d9" containerName="manager" containerID="cri-o://a49af6d1709f21581d6ddb7a7adc89b446d931c59a59bafa6473ba0074182256" gracePeriod=30
Jul 05 13:31:48.502478 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:31:48.502445    2563 generic.go:356] "Generic (PLEG): container finished" podID="956efc86-6483-4188-aac3-450f0e8653d9" containerID="a49af6d1709f21581d6ddb7a7adc89b446d931c59a59bafa6473ba0074182256" exitCode=0
Jul 05 13:31:48.502710 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:31:48.502513    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6845d5b85-v8qnd" event={"ID":"956efc86-6483-4188-aac3-450f0e8653d9","Type":"ContainerDied","Data":"a49af6d1709f21581d6ddb7a7adc89b446d931c59a59bafa6473ba0074182256"}
Jul 05 13:31:48.550395 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:31:48.550365    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6845d5b85-v8qnd"
Jul 05 13:31:48.632813 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:31:48.632773    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/956efc86-6483-4188-aac3-450f0e8653d9-webhook-cert\") pod \"956efc86-6483-4188-aac3-450f0e8653d9\" (UID: \"956efc86-6483-4188-aac3-450f0e8653d9\") "
Jul 05 13:31:48.632981 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:31:48.632859    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gwd7h\" (UniqueName: \"kubernetes.io/projected/956efc86-6483-4188-aac3-450f0e8653d9-kube-api-access-gwd7h\") pod \"956efc86-6483-4188-aac3-450f0e8653d9\" (UID: \"956efc86-6483-4188-aac3-450f0e8653d9\") "
Jul 05 13:31:48.634969 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:31:48.634944    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/956efc86-6483-4188-aac3-450f0e8653d9-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "956efc86-6483-4188-aac3-450f0e8653d9" (UID: "956efc86-6483-4188-aac3-450f0e8653d9"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 05 13:31:48.635026 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:31:48.634999    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/956efc86-6483-4188-aac3-450f0e8653d9-kube-api-access-gwd7h" (OuterVolumeSpecName: "kube-api-access-gwd7h") pod "956efc86-6483-4188-aac3-450f0e8653d9" (UID: "956efc86-6483-4188-aac3-450f0e8653d9"). InnerVolumeSpecName "kube-api-access-gwd7h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 13:31:48.734034 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:31:48.733942    2563 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/956efc86-6483-4188-aac3-450f0e8653d9-webhook-cert\") on node \"ip-10-0-129-239.ec2.internal\" DevicePath \"\""
Jul 05 13:31:48.734034 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:31:48.733976    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gwd7h\" (UniqueName: \"kubernetes.io/projected/956efc86-6483-4188-aac3-450f0e8653d9-kube-api-access-gwd7h\") on node \"ip-10-0-129-239.ec2.internal\" DevicePath \"\""
Jul 05 13:31:49.508179 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:31:49.508146    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6845d5b85-v8qnd" event={"ID":"956efc86-6483-4188-aac3-450f0e8653d9","Type":"ContainerDied","Data":"3a4af1025098ea1e074defeb633bb3c461d4b5e1777ec13878ca5f0dd59f8d2a"}
Jul 05 13:31:49.508179 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:31:49.508176    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6845d5b85-v8qnd"
Jul 05 13:31:49.508670 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:31:49.508207    2563 scope.go:117] "RemoveContainer" containerID="a49af6d1709f21581d6ddb7a7adc89b446d931c59a59bafa6473ba0074182256"
Jul 05 13:31:49.530908 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:31:49.530880    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6845d5b85-v8qnd"]
Jul 05 13:31:49.534570 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:31:49.534546    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6845d5b85-v8qnd"]
Jul 05 13:31:50.204276 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:31:50.204239    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:31:50.321059 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:31:50.321005    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6845d5b85-28n7p"]
Jul 05 13:31:50.321503 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:31:50.321485    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="956efc86-6483-4188-aac3-450f0e8653d9" containerName="manager"
Jul 05 13:31:50.321601 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:31:50.321506    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="956efc86-6483-4188-aac3-450f0e8653d9" containerName="manager"
Jul 05 13:31:50.321601 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:31:50.321596    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="956efc86-6483-4188-aac3-450f0e8653d9" containerName="manager"
Jul 05 13:31:50.325826 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:31:50.325806    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6845d5b85-28n7p"
Jul 05 13:31:50.330184 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:31:50.330163    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 05 13:31:50.330184 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:31:50.330164    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-mxg8l\""
Jul 05 13:31:50.330363 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:31:50.330166    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 05 13:31:50.335738 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:31:50.335712    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6845d5b85-28n7p"]
Jul 05 13:31:50.350052 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:31:50.350021    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="956efc86-6483-4188-aac3-450f0e8653d9" path="/var/lib/kubelet/pods/956efc86-6483-4188-aac3-450f0e8653d9/volumes"
Jul 05 13:31:50.447050 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:31:50.447014    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eba9a444-a74b-4b7b-88c2-aefcd3d5661b-webhook-cert\") pod \"maas-controller-6845d5b85-28n7p\" (UID: \"eba9a444-a74b-4b7b-88c2-aefcd3d5661b\") " pod="opendatahub/maas-controller-6845d5b85-28n7p"
Jul 05 13:31:50.447253 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:31:50.447114    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfk9v\" (UniqueName: \"kubernetes.io/projected/eba9a444-a74b-4b7b-88c2-aefcd3d5661b-kube-api-access-mfk9v\") pod \"maas-controller-6845d5b85-28n7p\" (UID: \"eba9a444-a74b-4b7b-88c2-aefcd3d5661b\") " pod="opendatahub/maas-controller-6845d5b85-28n7p"
Jul 05 13:31:50.548349 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:31:50.548311    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eba9a444-a74b-4b7b-88c2-aefcd3d5661b-webhook-cert\") pod \"maas-controller-6845d5b85-28n7p\" (UID: \"eba9a444-a74b-4b7b-88c2-aefcd3d5661b\") " pod="opendatahub/maas-controller-6845d5b85-28n7p"
Jul 05 13:31:50.548800 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:31:50.548466    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfk9v\" (UniqueName: \"kubernetes.io/projected/eba9a444-a74b-4b7b-88c2-aefcd3d5661b-kube-api-access-mfk9v\") pod \"maas-controller-6845d5b85-28n7p\" (UID: \"eba9a444-a74b-4b7b-88c2-aefcd3d5661b\") " pod="opendatahub/maas-controller-6845d5b85-28n7p"
Jul 05 13:31:50.550815 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:31:50.550793    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eba9a444-a74b-4b7b-88c2-aefcd3d5661b-webhook-cert\") pod \"maas-controller-6845d5b85-28n7p\" (UID: \"eba9a444-a74b-4b7b-88c2-aefcd3d5661b\") " pod="opendatahub/maas-controller-6845d5b85-28n7p"
Jul 05 13:31:50.558085 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:31:50.558051    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfk9v\" (UniqueName: \"kubernetes.io/projected/eba9a444-a74b-4b7b-88c2-aefcd3d5661b-kube-api-access-mfk9v\") pod \"maas-controller-6845d5b85-28n7p\" (UID: \"eba9a444-a74b-4b7b-88c2-aefcd3d5661b\") " pod="opendatahub/maas-controller-6845d5b85-28n7p"
Jul 05 13:31:50.636899 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:31:50.636860    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6845d5b85-28n7p"
Jul 05 13:31:50.781377 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:31:50.781337    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6845d5b85-28n7p"]
Jul 05 13:31:50.784326 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:31:50.784289    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeba9a444_a74b_4b7b_88c2_aefcd3d5661b.slice/crio-92a8635f8e3854f5ab2efc3c32ca3b02c0392f2e5a3e1edeefc0f0d2a5913097 WatchSource:0}: Error finding container 92a8635f8e3854f5ab2efc3c32ca3b02c0392f2e5a3e1edeefc0f0d2a5913097: Status 404 returned error can't find the container with id 92a8635f8e3854f5ab2efc3c32ca3b02c0392f2e5a3e1edeefc0f0d2a5913097
Jul 05 13:31:50.785671 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:31:50.785650    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 05 13:31:51.519781 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:31:51.519680    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6845d5b85-28n7p" event={"ID":"eba9a444-a74b-4b7b-88c2-aefcd3d5661b","Type":"ContainerStarted","Data":"b1421a424a2f62d21e915c690c7db99e1715265e52e98c5cc3d86326f6c4bcfc"}
Jul 05 13:31:51.519781 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:31:51.519737    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6845d5b85-28n7p" event={"ID":"eba9a444-a74b-4b7b-88c2-aefcd3d5661b","Type":"ContainerStarted","Data":"92a8635f8e3854f5ab2efc3c32ca3b02c0392f2e5a3e1edeefc0f0d2a5913097"}
Jul 05 13:31:51.519962 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:31:51.519794    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6845d5b85-28n7p"
Jul 05 13:31:51.538486 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:31:51.538432    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6845d5b85-28n7p" podStartSLOduration=1.098859124 podStartE2EDuration="1.538413096s" totalImagesPullingTime="439.553972ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:31:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:31:51.537284589 +0000 UTC m=+991.631170211" watchObservedRunningTime="2026-07-05 13:31:51.538413096 +0000 UTC m=+991.632298720"
Jul 05 13:32:02.530461 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:32:02.530427    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6845d5b85-28n7p"
Jul 05 13:32:30.034387 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:32:30.034343    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:32:30.116517 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:32:30.116473    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:32:30.227195 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:32:30.227162    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:32:36.002466 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:32:36.002411    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:32:36.106881 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:32:36.106847    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:32:36.204035 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:32:36.204006    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:32:36.376332 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:32:36.376293    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:32:42.116636 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:32:42.116599    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:32:42.220030 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:32:42.219994    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:33:11.439141 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:33:11.439107    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:33:19.706299 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:33:19.706184    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:34:53.854927 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:34:53.854893    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:36:30.863474 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:36:30.863390    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n9dv4"]
Jul 05 13:36:30.865891 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:36:30.863613    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n9dv4" podUID="c673fb68-a1c4-4ab1-9e52-6ad425a68d78" containerName="manager" containerID="cri-o://5746c8a10eb9e169aad58ed6c39ed365d083922fd3aefbbbc8592ee39604b395" gracePeriod=10
Jul 05 13:36:32.903397 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:36:32.903359    2563 generic.go:356] "Generic (PLEG): container finished" podID="c673fb68-a1c4-4ab1-9e52-6ad425a68d78" containerID="5746c8a10eb9e169aad58ed6c39ed365d083922fd3aefbbbc8592ee39604b395" exitCode=0
Jul 05 13:36:32.903765 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:36:32.903425    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n9dv4" event={"ID":"c673fb68-a1c4-4ab1-9e52-6ad425a68d78","Type":"ContainerDied","Data":"5746c8a10eb9e169aad58ed6c39ed365d083922fd3aefbbbc8592ee39604b395"}
Jul 05 13:36:33.032271 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:36:33.032246    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n9dv4"
Jul 05 13:36:33.088270 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:36:33.088239    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7b4b2\" (UniqueName: \"kubernetes.io/projected/c673fb68-a1c4-4ab1-9e52-6ad425a68d78-kube-api-access-7b4b2\") pod \"c673fb68-a1c4-4ab1-9e52-6ad425a68d78\" (UID: \"c673fb68-a1c4-4ab1-9e52-6ad425a68d78\") "
Jul 05 13:36:33.088438 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:36:33.088315    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c673fb68-a1c4-4ab1-9e52-6ad425a68d78-extensions-socket-volume\") pod \"c673fb68-a1c4-4ab1-9e52-6ad425a68d78\" (UID: \"c673fb68-a1c4-4ab1-9e52-6ad425a68d78\") "
Jul 05 13:36:33.088778 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:36:33.088751    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c673fb68-a1c4-4ab1-9e52-6ad425a68d78-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c673fb68-a1c4-4ab1-9e52-6ad425a68d78" (UID: "c673fb68-a1c4-4ab1-9e52-6ad425a68d78"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:36:33.090256 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:36:33.090210    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c673fb68-a1c4-4ab1-9e52-6ad425a68d78-kube-api-access-7b4b2" (OuterVolumeSpecName: "kube-api-access-7b4b2") pod "c673fb68-a1c4-4ab1-9e52-6ad425a68d78" (UID: "c673fb68-a1c4-4ab1-9e52-6ad425a68d78"). InnerVolumeSpecName "kube-api-access-7b4b2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 13:36:33.189506 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:36:33.189469    2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c673fb68-a1c4-4ab1-9e52-6ad425a68d78-extensions-socket-volume\") on node \"ip-10-0-129-239.ec2.internal\" DevicePath \"\""
Jul 05 13:36:33.189506 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:36:33.189500    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7b4b2\" (UniqueName: \"kubernetes.io/projected/c673fb68-a1c4-4ab1-9e52-6ad425a68d78-kube-api-access-7b4b2\") on node \"ip-10-0-129-239.ec2.internal\" DevicePath \"\""
Jul 05 13:36:33.910017 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:36:33.909978    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n9dv4" event={"ID":"c673fb68-a1c4-4ab1-9e52-6ad425a68d78","Type":"ContainerDied","Data":"e34983eb438a9894b7fb4b89e21245e4bc3b922013e6cf2a88128325fbf96e5d"}
Jul 05 13:36:33.910467 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:36:33.910038    2563 scope.go:117] "RemoveContainer" containerID="5746c8a10eb9e169aad58ed6c39ed365d083922fd3aefbbbc8592ee39604b395"
Jul 05 13:36:33.910467 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:36:33.909992    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n9dv4"
Jul 05 13:36:33.932523 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:36:33.932491    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n9dv4"]
Jul 05 13:36:33.939356 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:36:33.939330    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n9dv4"]
Jul 05 13:36:34.353434 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:36:34.353390    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c673fb68-a1c4-4ab1-9e52-6ad425a68d78" path="/var/lib/kubelet/pods/c673fb68-a1c4-4ab1-9e52-6ad425a68d78/volumes"
Jul 05 13:37:31.982813 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:37:31.982776    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k8dbz"]
Jul 05 13:37:31.983249 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:37:31.983149    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c673fb68-a1c4-4ab1-9e52-6ad425a68d78" containerName="manager"
Jul 05 13:37:31.983249 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:37:31.983162    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c673fb68-a1c4-4ab1-9e52-6ad425a68d78" containerName="manager"
Jul 05 13:37:31.983249 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:37:31.983237    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c673fb68-a1c4-4ab1-9e52-6ad425a68d78" containerName="manager"
Jul 05 13:37:31.986551 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:37:31.986534    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k8dbz"
Jul 05 13:37:31.988940 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:37:31.988914    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-6dmlp\""
Jul 05 13:37:32.002826 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:37:32.002798    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k8dbz"]
Jul 05 13:37:32.124547 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:37:32.124488    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c6f6a48c-33b7-4d8d-b621-fd8ecf1b3bb3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-k8dbz\" (UID: \"c6f6a48c-33b7-4d8d-b621-fd8ecf1b3bb3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k8dbz"
Jul 05 13:37:32.124751 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:37:32.124646    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8l4b\" (UniqueName: \"kubernetes.io/projected/c6f6a48c-33b7-4d8d-b621-fd8ecf1b3bb3-kube-api-access-k8l4b\") pod \"kuadrant-operator-controller-manager-86878c769f-k8dbz\" (UID: \"c6f6a48c-33b7-4d8d-b621-fd8ecf1b3bb3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k8dbz"
Jul 05 13:37:32.226157 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:37:32.226105    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8l4b\" (UniqueName: \"kubernetes.io/projected/c6f6a48c-33b7-4d8d-b621-fd8ecf1b3bb3-kube-api-access-k8l4b\") pod \"kuadrant-operator-controller-manager-86878c769f-k8dbz\" (UID: \"c6f6a48c-33b7-4d8d-b621-fd8ecf1b3bb3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k8dbz"
Jul 05 13:37:32.226157 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:37:32.226173    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c6f6a48c-33b7-4d8d-b621-fd8ecf1b3bb3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-k8dbz\" (UID: \"c6f6a48c-33b7-4d8d-b621-fd8ecf1b3bb3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k8dbz"
Jul 05 13:37:32.226645 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:37:32.226624    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c6f6a48c-33b7-4d8d-b621-fd8ecf1b3bb3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-k8dbz\" (UID: \"c6f6a48c-33b7-4d8d-b621-fd8ecf1b3bb3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k8dbz"
Jul 05 13:37:32.248684 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:37:32.248618    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8l4b\" (UniqueName: \"kubernetes.io/projected/c6f6a48c-33b7-4d8d-b621-fd8ecf1b3bb3-kube-api-access-k8l4b\") pod \"kuadrant-operator-controller-manager-86878c769f-k8dbz\" (UID: \"c6f6a48c-33b7-4d8d-b621-fd8ecf1b3bb3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k8dbz"
Jul 05 13:37:32.296444 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:37:32.296402    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k8dbz"
Jul 05 13:37:32.439367 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:37:32.439342    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k8dbz"]
Jul 05 13:37:32.441774 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:37:32.441745    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6f6a48c_33b7_4d8d_b621_fd8ecf1b3bb3.slice/crio-9086cb3c63f3423e02fd734242bcfd319d88267462244fe92a58f5841dcb1842 WatchSource:0}: Error finding container 9086cb3c63f3423e02fd734242bcfd319d88267462244fe92a58f5841dcb1842: Status 404 returned error can't find the container with id 9086cb3c63f3423e02fd734242bcfd319d88267462244fe92a58f5841dcb1842
Jul 05 13:37:33.197834 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:37:33.197798    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k8dbz" event={"ID":"c6f6a48c-33b7-4d8d-b621-fd8ecf1b3bb3","Type":"ContainerStarted","Data":"3df54e1463c60279202dec5986088b5fd1592a15057fe1552d0138ec6861131b"}
Jul 05 13:37:33.198278 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:37:33.197850    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k8dbz" event={"ID":"c6f6a48c-33b7-4d8d-b621-fd8ecf1b3bb3","Type":"ContainerStarted","Data":"9086cb3c63f3423e02fd734242bcfd319d88267462244fe92a58f5841dcb1842"}
Jul 05 13:37:33.198278 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:37:33.197927    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k8dbz"
Jul 05 13:37:33.223473 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:37:33.223416    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k8dbz" podStartSLOduration=2.223395759 podStartE2EDuration="2.223395759s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:37:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:37:33.220961355 +0000 UTC m=+1333.314846999" watchObservedRunningTime="2026-07-05 13:37:33.223395759 +0000 UTC m=+1333.317281387"
Jul 05 13:37:44.204837 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:37:44.204805    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k8dbz"
Jul 05 13:38:50.020293 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:38:50.020261    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:38:51.120736 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:38:51.120702    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:40:46.877779 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:40:46.877726    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:43:15.626399 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:43:15.626360    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:43:23.587322 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:43:23.587287    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:43:31.842134 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:43:31.842100    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:43:36.933462 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:43:36.933425    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:43:39.775715 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:43:39.775684    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:43:39.867531 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:43:39.867495    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:43:40.234991 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:43:40.234960    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:43:46.100915 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:43:46.100819    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:43:46.172975 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:43:46.172936    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:43:46.329593 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:43:46.329556    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:43:46.421319 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:43:46.421236    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:43:47.560630 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:43:47.560591    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:43:47.651425 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:43:47.651393    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:43:47.789935 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:43:47.789904    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:43:48.329139 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:43:48.329103    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:43:48.569091 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:43:48.569049    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:43:48.668927 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:43:48.668836    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:43:50.070899 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:43:50.070863    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:43:52.678631 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:43:52.678579    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:43:53.683187 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:43:53.683138    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:43:54.503620 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:43:54.503590    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:43:59.010232 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:43:59.010181    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:43:59.111597 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:43:59.111560    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:43:59.235844 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:43:59.235791    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:43:59.333032 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:43:59.332977    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:44:00.429061 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:44:00.429008    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:44:00.517663 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:44:00.517627    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:44:00.613525 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:44:00.613480    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:44:00.775895 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:44:00.775796    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:44:01.111965 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:44:01.111930    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:44:01.210339 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:44:01.210280    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:44:02.230518 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:44:02.230483    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:44:05.634029 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:44:05.633987    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:44:06.060490 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:44:06.060458    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:44:11.906590 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:44:11.906541    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:44:12.012450 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:44:12.012417    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:44:13.814655 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:44:13.814622    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:44:18.045754 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:44:18.045720    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:44:18.117353 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:44:18.117316    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:44:18.291210 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:44:18.291177    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:44:18.393841 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:44:18.393736    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:44:19.563167 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:44:19.563137    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:44:19.656546 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:44:19.656518    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:44:19.740869 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:44:19.740838    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:44:19.926662 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:44:19.926576    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:44:20.470939 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:44:20.470903    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:44:20.571392 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:44:20.571357    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:44:21.769696 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:44:21.769659    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:44:24.006651 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:44:24.006615    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:44:24.221678 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:44:24.221645    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:44:24.315382 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:44:24.315342    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:44:24.617146 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:44:24.617064    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:44:25.170145 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:44:25.170113    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:44:27.086916 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:44:27.086887    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:44:30.620650 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:44:30.620612    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:44:30.717818 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:44:30.717775    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:44:31.055921 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:44:31.055884    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:44:31.197811 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:44:31.197780    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:44:31.306651 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:44:31.306533    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:44:32.677262 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:44:32.677212    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:44:38.639092 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:44:38.639047    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:44:38.814869 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:44:38.814840    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:44:38.933293 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:44:38.933187    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:44:39.423612 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:44:39.423580    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:45:00.149071 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:45:00.149031    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29720985-9bqwh"]
Jul 05 13:45:00.152653 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:45:00.152627    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29720985-9bqwh"
Jul 05 13:45:00.156633 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:45:00.156596    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-sdtdk\""
Jul 05 13:45:00.161014 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:45:00.160980    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29720985-9bqwh"]
Jul 05 13:45:00.248415 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:45:00.248368    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nl9qc\" (UniqueName: \"kubernetes.io/projected/7b1b9642-6fb5-4202-b663-80ae56193724-kube-api-access-nl9qc\") pod \"maas-api-key-cleanup-29720985-9bqwh\" (UID: \"7b1b9642-6fb5-4202-b663-80ae56193724\") " pod="opendatahub/maas-api-key-cleanup-29720985-9bqwh"
Jul 05 13:45:00.349346 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:45:00.349310    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nl9qc\" (UniqueName: \"kubernetes.io/projected/7b1b9642-6fb5-4202-b663-80ae56193724-kube-api-access-nl9qc\") pod \"maas-api-key-cleanup-29720985-9bqwh\" (UID: \"7b1b9642-6fb5-4202-b663-80ae56193724\") " pod="opendatahub/maas-api-key-cleanup-29720985-9bqwh"
Jul 05 13:45:00.367451 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:45:00.367416    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nl9qc\" (UniqueName: \"kubernetes.io/projected/7b1b9642-6fb5-4202-b663-80ae56193724-kube-api-access-nl9qc\") pod \"maas-api-key-cleanup-29720985-9bqwh\" (UID: \"7b1b9642-6fb5-4202-b663-80ae56193724\") " pod="opendatahub/maas-api-key-cleanup-29720985-9bqwh"
Jul 05 13:45:00.466171 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:45:00.466060    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29720985-9bqwh"
Jul 05 13:45:00.632723 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:45:00.632697    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29720985-9bqwh"]
Jul 05 13:45:00.634984 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:45:00.634954    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b1b9642_6fb5_4202_b663_80ae56193724.slice/crio-fd149766029c5bbe0599f70da39df01f367b5a0a08bcefab728f684bb5bf308a WatchSource:0}: Error finding container fd149766029c5bbe0599f70da39df01f367b5a0a08bcefab728f684bb5bf308a: Status 404 returned error can't find the container with id fd149766029c5bbe0599f70da39df01f367b5a0a08bcefab728f684bb5bf308a
Jul 05 13:45:00.636938 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:45:00.636921    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 05 13:45:01.417582 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:45:01.417534    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29720985-9bqwh" event={"ID":"7b1b9642-6fb5-4202-b663-80ae56193724","Type":"ContainerStarted","Data":"fd149766029c5bbe0599f70da39df01f367b5a0a08bcefab728f684bb5bf308a"}
Jul 05 13:45:03.430910 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:45:03.430873    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29720985-9bqwh" event={"ID":"7b1b9642-6fb5-4202-b663-80ae56193724","Type":"ContainerStarted","Data":"4e29a0f6725459c8c4cc263f9206d50a0619d5a158a87f8d28c9e8d2226c7a96"}
Jul 05 13:45:03.447441 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:45:03.447384    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29720985-9bqwh" podStartSLOduration=1.351832715 podStartE2EDuration="3.447363373s" totalImagesPullingTime="2.095530658s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:45:03.446474755 +0000 UTC m=+1783.540360403" watchObservedRunningTime="2026-07-05 13:45:03.447363373 +0000 UTC m=+1783.541248997"
Jul 05 13:45:04.438049 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:45:04.438009    2563 generic.go:356] "Generic (PLEG): container finished" podID="7b1b9642-6fb5-4202-b663-80ae56193724" containerID="4e29a0f6725459c8c4cc263f9206d50a0619d5a158a87f8d28c9e8d2226c7a96" exitCode=0
Jul 05 13:45:04.438049 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:45:04.438056    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29720985-9bqwh" event={"ID":"7b1b9642-6fb5-4202-b663-80ae56193724","Type":"ContainerDied","Data":"4e29a0f6725459c8c4cc263f9206d50a0619d5a158a87f8d28c9e8d2226c7a96"}
Jul 05 13:45:05.326780 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:45:05.326744    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:45:05.585614 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:45:05.585546    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29720985-9bqwh"
Jul 05 13:45:05.701955 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:45:05.701901    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nl9qc\" (UniqueName: \"kubernetes.io/projected/7b1b9642-6fb5-4202-b663-80ae56193724-kube-api-access-nl9qc\") pod \"7b1b9642-6fb5-4202-b663-80ae56193724\" (UID: \"7b1b9642-6fb5-4202-b663-80ae56193724\") "
Jul 05 13:45:05.704078 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:45:05.704047    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b1b9642-6fb5-4202-b663-80ae56193724-kube-api-access-nl9qc" (OuterVolumeSpecName: "kube-api-access-nl9qc") pod "7b1b9642-6fb5-4202-b663-80ae56193724" (UID: "7b1b9642-6fb5-4202-b663-80ae56193724"). InnerVolumeSpecName "kube-api-access-nl9qc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 13:45:05.803317 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:45:05.803279    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nl9qc\" (UniqueName: \"kubernetes.io/projected/7b1b9642-6fb5-4202-b663-80ae56193724-kube-api-access-nl9qc\") on node \"ip-10-0-129-239.ec2.internal\" DevicePath \"\""
Jul 05 13:45:06.449857 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:45:06.449824    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29720985-9bqwh"
Jul 05 13:45:06.450084 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:45:06.449860    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29720985-9bqwh" event={"ID":"7b1b9642-6fb5-4202-b663-80ae56193724","Type":"ContainerDied","Data":"fd149766029c5bbe0599f70da39df01f367b5a0a08bcefab728f684bb5bf308a"}
Jul 05 13:45:06.450084 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:45:06.449918    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fd149766029c5bbe0599f70da39df01f367b5a0a08bcefab728f684bb5bf308a"
Jul 05 13:45:06.659865 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:45:06.659784    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:45:11.569119 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:45:11.569082    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:45:11.661739 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:45:11.661706    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:45:11.816188 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:45:11.816149    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:45:27.733136 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:45:27.733100    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:45:33.603670 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:45:33.603623    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:45:33.710939 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:45:33.710903    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:45:33.812228 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:45:33.812196    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:45:44.308489 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:45:44.308452    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:45:45.121479 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:45:45.121442    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:45:51.400573 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:45:51.400534    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:45:51.511086 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:45:51.511055    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:45:51.613005 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:45:51.612962    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:45:51.736983 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:45:51.736886    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:45:52.542370 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:45:52.542336    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:45:52.634506 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:45:52.634470    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:45:54.398726 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:45:54.398687    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:46:00.084497 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:46:00.084448    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:46:00.180353 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:46:00.180314    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:46:00.767731 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:46:00.767691    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:46:06.855183 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:46:06.855145    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:46:06.928003 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:46:06.927964    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:46:07.096825 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:46:07.096791    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:46:07.427024 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:46:07.426989    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:46:07.527641 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:46:07.527611    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:46:10.286644 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:46:10.286593    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:46:10.412151 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:46:10.412121    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:46:10.529164 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:46:10.529132    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:46:10.684130 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:46:10.684035    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:46:11.304464 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:46:11.304428    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:46:11.437661 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:46:11.437631    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:46:14.750567 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:46:14.750536    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:46:15.463723 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:46:15.463640    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:46:15.544050 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:46:15.544013    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:46:15.887108 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:46:15.887038    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:46:22.007036 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:46:22.006999    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:46:22.080510 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:46:22.080471    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:46:22.422418 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:46:22.422385    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:46:22.807703 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:46:22.807671    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:46:22.907799 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:46:22.907765    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:46:25.270507 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:46:25.270479    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:46:25.338754 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:46:25.338719    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:46:28.619080 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:46:28.619043    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:46:28.722430 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:46:28.722399    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:46:29.006145 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:46:29.006055    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:46:29.352163 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:46:29.352098    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:46:29.588938 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:46:29.588900    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:46:29.709019 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:46:29.708928    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:46:35.709649 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:46:35.709611    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:46:35.792044 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:46:35.792008    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:46:35.912448 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:46:35.912410    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:46:36.091599 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:46:36.091562    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:46:42.494292 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:46:42.494191    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:46:42.592570 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:46:42.592537    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:46:49.031294 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:46:49.031257    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:46:49.542370 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:46:49.542338    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:46:49.744700 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:46:49.744656    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:46:52.477800 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:46:52.477763    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:46:52.591317 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:46:52.591271    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:46:52.714403 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:46:52.714372    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:46:52.999566 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:46:52.999533    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:46:53.283531 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:46:53.283499    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:46:53.417385 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:46:53.417356    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:46:56.862876 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:46:56.862844    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:47:04.231846 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:47:04.231801    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:47:14.691580 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:47:14.691547    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:47:14.792652 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:47:14.792615    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:47:15.419528 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:47:15.419495    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:47:15.520999 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:47:15.520962    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:47:24.473271 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:47:24.473151    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:47:24.948310 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:47:24.948278    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:47:30.499251 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:47:30.499203    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:47:35.746922 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:47:35.746892    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:48:12.915002 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:48:12.914910    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:48:13.394253 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:48:13.394192    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:48:19.577722 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:48:19.577687    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:48:19.718072 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:48:19.718045    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:48:19.942673 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:48:19.942598    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:48:20.169837 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:48:20.169806    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:48:21.254658 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:48:21.254628    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:48:21.362448 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:48:21.362418    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:48:22.385646 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:48:22.385617    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:48:22.558170 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:48:22.558140    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:48:24.130619 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:48:24.130587    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:48:30.202180 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:48:30.202149    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:48:30.303054 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:48:30.303026    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:48:30.904006 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:48:30.903967    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:48:37.372328 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:48:37.372295    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:48:37.486103 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:48:37.486068    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:48:37.603969 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:48:37.603939    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:48:48.155105 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:48:48.155072    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:48:48.521078 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:48:48.520999    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:49:09.509866 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:49:09.509825    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:49:16.071678 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:49:16.071628    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:49:16.235926 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:49:16.235897    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:49:16.410384 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:49:16.410323    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:49:16.891487 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:49:16.891458    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:49:17.421601 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:49:17.421569    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:49:20.113496 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:49:20.113462    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:49:20.300469 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:49:20.300439    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:49:20.458525 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:49:20.458452    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:49:20.806034 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:49:20.806004    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:49:21.001537 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:49:21.001504    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:49:21.114321 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:49:21.114250    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:49:24.577275 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:49:24.577243    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:49:24.916591 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:49:24.916510    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:49:25.267729 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:49:25.267647    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:49:25.649941 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:49:25.649909    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:49:28.228664 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:49:28.228634    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:49:28.354201 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:49:28.354175    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:49:28.451423 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:49:28.451394    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:49:28.765528 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:49:28.765488    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:49:29.176033 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:49:29.175996    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:49:29.279958 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:49:29.279928    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:49:32.575631 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:49:32.575595    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:49:37.196021 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:49:37.195987    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:49:42.208567 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:49:42.208445    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:49:42.495615 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:49:42.495530    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:49:50.277531 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:49:50.277501    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:49:50.375454 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:49:50.375415    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:49:55.470055 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:49:55.470025    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-9521b3/test-model-9521b3-kserve-7497665c9c-v8t72"]
Jul 05 13:49:55.470507 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:49:55.470492    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b1b9642-6fb5-4202-b663-80ae56193724" containerName="cleanup"
Jul 05 13:49:55.470551 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:49:55.470509    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b1b9642-6fb5-4202-b663-80ae56193724" containerName="cleanup"
Jul 05 13:49:55.470587 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:49:55.470576    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b1b9642-6fb5-4202-b663-80ae56193724" containerName="cleanup"
Jul 05 13:49:55.473433 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:49:55.473418    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-9521b3/test-model-9521b3-kserve-7497665c9c-v8t72"
Jul 05 13:49:55.478284 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:49:55.478261    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-9521b3\"/\"default-dockercfg-qlv65\""
Jul 05 13:49:55.479154 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:49:55.479129    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-9521b3\"/\"kube-root-ca.crt\""
Jul 05 13:49:55.479311 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:49:55.479173    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-9521b3\"/\"openshift-service-ca.crt\""
Jul 05 13:49:55.479311 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:49:55.479196    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-9521b3\"/\"test-model-9521b3-kserve-self-signed-certs\""
Jul 05 13:49:55.493638 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:49:55.493608    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-9521b3/test-model-9521b3-kserve-7497665c9c-v8t72"]
Jul 05 13:49:55.504182 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:49:55.504160    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:49:55.561397 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:49:55.561363    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60758e5c-2262-4cf4-bcdc-57e624490ae1-dshm\") pod \"test-model-9521b3-kserve-7497665c9c-v8t72\" (UID: \"60758e5c-2262-4cf4-bcdc-57e624490ae1\") " pod="ai-tenant-e2e-inf-b-9521b3/test-model-9521b3-kserve-7497665c9c-v8t72"
Jul 05 13:49:55.561562 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:49:55.561460    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60758e5c-2262-4cf4-bcdc-57e624490ae1-model-cache\") pod \"test-model-9521b3-kserve-7497665c9c-v8t72\" (UID: \"60758e5c-2262-4cf4-bcdc-57e624490ae1\") " pod="ai-tenant-e2e-inf-b-9521b3/test-model-9521b3-kserve-7497665c9c-v8t72"
Jul 05 13:49:55.561562 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:49:55.561511    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9vnw\" (UniqueName: \"kubernetes.io/projected/60758e5c-2262-4cf4-bcdc-57e624490ae1-kube-api-access-t9vnw\") pod \"test-model-9521b3-kserve-7497665c9c-v8t72\" (UID: \"60758e5c-2262-4cf4-bcdc-57e624490ae1\") " pod="ai-tenant-e2e-inf-b-9521b3/test-model-9521b3-kserve-7497665c9c-v8t72"
Jul 05 13:49:55.561562 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:49:55.561552    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60758e5c-2262-4cf4-bcdc-57e624490ae1-tmp-dir\") pod \"test-model-9521b3-kserve-7497665c9c-v8t72\" (UID: \"60758e5c-2262-4cf4-bcdc-57e624490ae1\") " pod="ai-tenant-e2e-inf-b-9521b3/test-model-9521b3-kserve-7497665c9c-v8t72"
Jul 05 13:49:55.561681 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:49:55.561631    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60758e5c-2262-4cf4-bcdc-57e624490ae1-home\") pod \"test-model-9521b3-kserve-7497665c9c-v8t72\" (UID: \"60758e5c-2262-4cf4-bcdc-57e624490ae1\") " pod="ai-tenant-e2e-inf-b-9521b3/test-model-9521b3-kserve-7497665c9c-v8t72"
Jul 05 13:49:55.561681 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:49:55.561659    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60758e5c-2262-4cf4-bcdc-57e624490ae1-tls-certs\") pod \"test-model-9521b3-kserve-7497665c9c-v8t72\" (UID: \"60758e5c-2262-4cf4-bcdc-57e624490ae1\") " pod="ai-tenant-e2e-inf-b-9521b3/test-model-9521b3-kserve-7497665c9c-v8t72"
Jul 05 13:49:55.662796 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:49:55.662766    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60758e5c-2262-4cf4-bcdc-57e624490ae1-tmp-dir\") pod \"test-model-9521b3-kserve-7497665c9c-v8t72\" (UID: \"60758e5c-2262-4cf4-bcdc-57e624490ae1\") " pod="ai-tenant-e2e-inf-b-9521b3/test-model-9521b3-kserve-7497665c9c-v8t72"
Jul 05 13:49:55.662796 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:49:55.662805    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60758e5c-2262-4cf4-bcdc-57e624490ae1-home\") pod \"test-model-9521b3-kserve-7497665c9c-v8t72\" (UID: \"60758e5c-2262-4cf4-bcdc-57e624490ae1\") " pod="ai-tenant-e2e-inf-b-9521b3/test-model-9521b3-kserve-7497665c9c-v8t72"
Jul 05 13:49:55.663007 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:49:55.662826    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60758e5c-2262-4cf4-bcdc-57e624490ae1-tls-certs\") pod \"test-model-9521b3-kserve-7497665c9c-v8t72\" (UID: \"60758e5c-2262-4cf4-bcdc-57e624490ae1\") " pod="ai-tenant-e2e-inf-b-9521b3/test-model-9521b3-kserve-7497665c9c-v8t72"
Jul 05 13:49:55.663007 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:49:55.662865    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60758e5c-2262-4cf4-bcdc-57e624490ae1-dshm\") pod \"test-model-9521b3-kserve-7497665c9c-v8t72\" (UID: \"60758e5c-2262-4cf4-bcdc-57e624490ae1\") " pod="ai-tenant-e2e-inf-b-9521b3/test-model-9521b3-kserve-7497665c9c-v8t72"
Jul 05 13:49:55.663007 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:49:55.662925    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60758e5c-2262-4cf4-bcdc-57e624490ae1-model-cache\") pod \"test-model-9521b3-kserve-7497665c9c-v8t72\" (UID: \"60758e5c-2262-4cf4-bcdc-57e624490ae1\") " pod="ai-tenant-e2e-inf-b-9521b3/test-model-9521b3-kserve-7497665c9c-v8t72"
Jul 05 13:49:55.663007 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:49:55.662964    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9vnw\" (UniqueName: \"kubernetes.io/projected/60758e5c-2262-4cf4-bcdc-57e624490ae1-kube-api-access-t9vnw\") pod \"test-model-9521b3-kserve-7497665c9c-v8t72\" (UID: \"60758e5c-2262-4cf4-bcdc-57e624490ae1\") " pod="ai-tenant-e2e-inf-b-9521b3/test-model-9521b3-kserve-7497665c9c-v8t72"
Jul 05 13:49:55.663266 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:49:55.663214    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60758e5c-2262-4cf4-bcdc-57e624490ae1-home\") pod \"test-model-9521b3-kserve-7497665c9c-v8t72\" (UID: \"60758e5c-2262-4cf4-bcdc-57e624490ae1\") " pod="ai-tenant-e2e-inf-b-9521b3/test-model-9521b3-kserve-7497665c9c-v8t72"
Jul 05 13:49:55.663336 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:49:55.663275    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60758e5c-2262-4cf4-bcdc-57e624490ae1-tmp-dir\") pod \"test-model-9521b3-kserve-7497665c9c-v8t72\" (UID: \"60758e5c-2262-4cf4-bcdc-57e624490ae1\") " pod="ai-tenant-e2e-inf-b-9521b3/test-model-9521b3-kserve-7497665c9c-v8t72"
Jul 05 13:49:55.663518 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:49:55.663493    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60758e5c-2262-4cf4-bcdc-57e624490ae1-model-cache\") pod \"test-model-9521b3-kserve-7497665c9c-v8t72\" (UID: \"60758e5c-2262-4cf4-bcdc-57e624490ae1\") " pod="ai-tenant-e2e-inf-b-9521b3/test-model-9521b3-kserve-7497665c9c-v8t72"
Jul 05 13:49:55.665231 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:49:55.665198    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60758e5c-2262-4cf4-bcdc-57e624490ae1-dshm\") pod \"test-model-9521b3-kserve-7497665c9c-v8t72\" (UID: \"60758e5c-2262-4cf4-bcdc-57e624490ae1\") " pod="ai-tenant-e2e-inf-b-9521b3/test-model-9521b3-kserve-7497665c9c-v8t72"
Jul 05 13:49:55.665646 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:49:55.665621    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60758e5c-2262-4cf4-bcdc-57e624490ae1-tls-certs\") pod \"test-model-9521b3-kserve-7497665c9c-v8t72\" (UID: \"60758e5c-2262-4cf4-bcdc-57e624490ae1\") " pod="ai-tenant-e2e-inf-b-9521b3/test-model-9521b3-kserve-7497665c9c-v8t72"
Jul 05 13:49:55.676569 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:49:55.676538    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9vnw\" (UniqueName: \"kubernetes.io/projected/60758e5c-2262-4cf4-bcdc-57e624490ae1-kube-api-access-t9vnw\") pod \"test-model-9521b3-kserve-7497665c9c-v8t72\" (UID: \"60758e5c-2262-4cf4-bcdc-57e624490ae1\") " pod="ai-tenant-e2e-inf-b-9521b3/test-model-9521b3-kserve-7497665c9c-v8t72"
Jul 05 13:49:55.783835 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:49:55.783811    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-9521b3/test-model-9521b3-kserve-7497665c9c-v8t72"
Jul 05 13:49:55.952055 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:49:55.952019    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-9521b3/test-model-9521b3-kserve-7497665c9c-v8t72"]
Jul 05 13:49:55.962285 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:49:55.962254    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod60758e5c_2262_4cf4_bcdc_57e624490ae1.slice/crio-6967d29835876e5063f07d0ee0b5e81f2057cb0a1114373eb0904bb9ab119b11 WatchSource:0}: Error finding container 6967d29835876e5063f07d0ee0b5e81f2057cb0a1114373eb0904bb9ab119b11: Status 404 returned error can't find the container with id 6967d29835876e5063f07d0ee0b5e81f2057cb0a1114373eb0904bb9ab119b11
Jul 05 13:49:56.844536 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:49:56.844500    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-9521b3/test-model-9521b3-kserve-7497665c9c-v8t72" event={"ID":"60758e5c-2262-4cf4-bcdc-57e624490ae1","Type":"ContainerStarted","Data":"20bf796fa413b185a01f2c83e018e04628cb5e9a4411979c90631c68cc5a83d5"}
Jul 05 13:49:56.844536 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:49:56.844540    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-9521b3/test-model-9521b3-kserve-7497665c9c-v8t72" event={"ID":"60758e5c-2262-4cf4-bcdc-57e624490ae1","Type":"ContainerStarted","Data":"6967d29835876e5063f07d0ee0b5e81f2057cb0a1114373eb0904bb9ab119b11"}
Jul 05 13:49:56.877950 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:49:56.877906    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-9521b3/test-model-9521b3-kserve-7497665c9c-v8t72" podStartSLOduration=1.877890105 podStartE2EDuration="1.877890105s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:49:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:49:56.876937463 +0000 UTC m=+2076.970823089" watchObservedRunningTime="2026-07-05 13:49:56.877890105 +0000 UTC m=+2076.971775730"
Jul 05 13:50:05.784420 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:50:05.784380    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-9521b3/test-model-9521b3-kserve-7497665c9c-v8t72"
Jul 05 13:50:05.784420 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:50:05.784429    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-9521b3/test-model-9521b3-kserve-7497665c9c-v8t72"
Jul 05 13:50:05.796669 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:50:05.796642    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-9521b3/test-model-9521b3-kserve-7497665c9c-v8t72"
Jul 05 13:50:05.897460 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:50:05.897433    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-9521b3/test-model-9521b3-kserve-7497665c9c-v8t72"
Jul 05 13:50:36.436503 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:50:36.436471    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:50:37.338749 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:50:37.338716    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-9521b3/test-model-9521b3-kserve-7497665c9c-v8t72"]
Jul 05 13:50:37.366785 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:50:37.366754    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:50:37.554925 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:50:37.554897    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:50:37.927037 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:50:37.927003    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:50:38.062857 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:50:38.062829    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:50:38.164055 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:50:38.164030    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:50:38.406469 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:50:38.406438    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:50:42.986596 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:50:42.986567    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:50:52.358130 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:50:52.358089    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-9521b3/test-model-9521b3-kserve-7497665c9c-v8t72" podUID="60758e5c-2262-4cf4-bcdc-57e624490ae1" containerName="main" containerID="cri-o://20bf796fa413b185a01f2c83e018e04628cb5e9a4411979c90631c68cc5a83d5" gracePeriod=45
Jul 05 13:50:52.609619 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:50:52.609563    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-9521b3/test-model-9521b3-kserve-7497665c9c-v8t72"
Jul 05 13:50:52.691074 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:50:52.691052    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60758e5c-2262-4cf4-bcdc-57e624490ae1-dshm\") pod \"60758e5c-2262-4cf4-bcdc-57e624490ae1\" (UID: \"60758e5c-2262-4cf4-bcdc-57e624490ae1\") "
Jul 05 13:50:52.691195 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:50:52.691096    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60758e5c-2262-4cf4-bcdc-57e624490ae1-model-cache\") pod \"60758e5c-2262-4cf4-bcdc-57e624490ae1\" (UID: \"60758e5c-2262-4cf4-bcdc-57e624490ae1\") "
Jul 05 13:50:52.691195 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:50:52.691130    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t9vnw\" (UniqueName: \"kubernetes.io/projected/60758e5c-2262-4cf4-bcdc-57e624490ae1-kube-api-access-t9vnw\") pod \"60758e5c-2262-4cf4-bcdc-57e624490ae1\" (UID: \"60758e5c-2262-4cf4-bcdc-57e624490ae1\") "
Jul 05 13:50:52.691195 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:50:52.691146    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60758e5c-2262-4cf4-bcdc-57e624490ae1-tls-certs\") pod \"60758e5c-2262-4cf4-bcdc-57e624490ae1\" (UID: \"60758e5c-2262-4cf4-bcdc-57e624490ae1\") "
Jul 05 13:50:52.691195 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:50:52.691169    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60758e5c-2262-4cf4-bcdc-57e624490ae1-tmp-dir\") pod \"60758e5c-2262-4cf4-bcdc-57e624490ae1\" (UID: \"60758e5c-2262-4cf4-bcdc-57e624490ae1\") "
Jul 05 13:50:52.691433 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:50:52.691210    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60758e5c-2262-4cf4-bcdc-57e624490ae1-home\") pod \"60758e5c-2262-4cf4-bcdc-57e624490ae1\" (UID: \"60758e5c-2262-4cf4-bcdc-57e624490ae1\") "
Jul 05 13:50:52.691433 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:50:52.691328    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60758e5c-2262-4cf4-bcdc-57e624490ae1-model-cache" (OuterVolumeSpecName: "model-cache") pod "60758e5c-2262-4cf4-bcdc-57e624490ae1" (UID: "60758e5c-2262-4cf4-bcdc-57e624490ae1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:50:52.691552 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:50:52.691449    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60758e5c-2262-4cf4-bcdc-57e624490ae1-model-cache\") on node \"ip-10-0-129-239.ec2.internal\" DevicePath \"\""
Jul 05 13:50:52.691552 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:50:52.691475    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60758e5c-2262-4cf4-bcdc-57e624490ae1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "60758e5c-2262-4cf4-bcdc-57e624490ae1" (UID: "60758e5c-2262-4cf4-bcdc-57e624490ae1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:50:52.691629 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:50:52.691551    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60758e5c-2262-4cf4-bcdc-57e624490ae1-home" (OuterVolumeSpecName: "home") pod "60758e5c-2262-4cf4-bcdc-57e624490ae1" (UID: "60758e5c-2262-4cf4-bcdc-57e624490ae1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:50:52.693258 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:50:52.693234    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60758e5c-2262-4cf4-bcdc-57e624490ae1-dshm" (OuterVolumeSpecName: "dshm") pod "60758e5c-2262-4cf4-bcdc-57e624490ae1" (UID: "60758e5c-2262-4cf4-bcdc-57e624490ae1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:50:52.693347 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:50:52.693312    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60758e5c-2262-4cf4-bcdc-57e624490ae1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "60758e5c-2262-4cf4-bcdc-57e624490ae1" (UID: "60758e5c-2262-4cf4-bcdc-57e624490ae1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 05 13:50:52.693388 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:50:52.693369    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60758e5c-2262-4cf4-bcdc-57e624490ae1-kube-api-access-t9vnw" (OuterVolumeSpecName: "kube-api-access-t9vnw") pod "60758e5c-2262-4cf4-bcdc-57e624490ae1" (UID: "60758e5c-2262-4cf4-bcdc-57e624490ae1"). InnerVolumeSpecName "kube-api-access-t9vnw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 13:50:52.791893 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:50:52.791873    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60758e5c-2262-4cf4-bcdc-57e624490ae1-home\") on node \"ip-10-0-129-239.ec2.internal\" DevicePath \"\""
Jul 05 13:50:52.791893 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:50:52.791891    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60758e5c-2262-4cf4-bcdc-57e624490ae1-dshm\") on node \"ip-10-0-129-239.ec2.internal\" DevicePath \"\""
Jul 05 13:50:52.792010 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:50:52.791899    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t9vnw\" (UniqueName: \"kubernetes.io/projected/60758e5c-2262-4cf4-bcdc-57e624490ae1-kube-api-access-t9vnw\") on node \"ip-10-0-129-239.ec2.internal\" DevicePath \"\""
Jul 05 13:50:52.792010 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:50:52.791909    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60758e5c-2262-4cf4-bcdc-57e624490ae1-tls-certs\") on node \"ip-10-0-129-239.ec2.internal\" DevicePath \"\""
Jul 05 13:50:52.792010 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:50:52.791917    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60758e5c-2262-4cf4-bcdc-57e624490ae1-tmp-dir\") on node \"ip-10-0-129-239.ec2.internal\" DevicePath \"\""
Jul 05 13:50:53.109755 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:50:53.109729    2563 generic.go:356] "Generic (PLEG): container finished" podID="60758e5c-2262-4cf4-bcdc-57e624490ae1" containerID="20bf796fa413b185a01f2c83e018e04628cb5e9a4411979c90631c68cc5a83d5" exitCode=0
Jul 05 13:50:53.109883 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:50:53.109773    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-9521b3/test-model-9521b3-kserve-7497665c9c-v8t72"
Jul 05 13:50:53.109883 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:50:53.109813    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-9521b3/test-model-9521b3-kserve-7497665c9c-v8t72" event={"ID":"60758e5c-2262-4cf4-bcdc-57e624490ae1","Type":"ContainerDied","Data":"20bf796fa413b185a01f2c83e018e04628cb5e9a4411979c90631c68cc5a83d5"}
Jul 05 13:50:53.109883 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:50:53.109858    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-9521b3/test-model-9521b3-kserve-7497665c9c-v8t72" event={"ID":"60758e5c-2262-4cf4-bcdc-57e624490ae1","Type":"ContainerDied","Data":"6967d29835876e5063f07d0ee0b5e81f2057cb0a1114373eb0904bb9ab119b11"}
Jul 05 13:50:53.109883 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:50:53.109876    2563 scope.go:117] "RemoveContainer" containerID="20bf796fa413b185a01f2c83e018e04628cb5e9a4411979c90631c68cc5a83d5"
Jul 05 13:50:53.118561 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:50:53.118543    2563 scope.go:117] "RemoveContainer" containerID="20bf796fa413b185a01f2c83e018e04628cb5e9a4411979c90631c68cc5a83d5"
Jul 05 13:50:53.118817 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:50:53.118799    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20bf796fa413b185a01f2c83e018e04628cb5e9a4411979c90631c68cc5a83d5\": container with ID starting with 20bf796fa413b185a01f2c83e018e04628cb5e9a4411979c90631c68cc5a83d5 not found: ID does not exist" containerID="20bf796fa413b185a01f2c83e018e04628cb5e9a4411979c90631c68cc5a83d5"
Jul 05 13:50:53.118881 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:50:53.118822    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20bf796fa413b185a01f2c83e018e04628cb5e9a4411979c90631c68cc5a83d5"} err="failed to get container status \"20bf796fa413b185a01f2c83e018e04628cb5e9a4411979c90631c68cc5a83d5\": rpc error: code = NotFound desc = could not find container \"20bf796fa413b185a01f2c83e018e04628cb5e9a4411979c90631c68cc5a83d5\": container with ID starting with 20bf796fa413b185a01f2c83e018e04628cb5e9a4411979c90631c68cc5a83d5 not found: ID does not exist"
Jul 05 13:50:53.132211 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:50:53.132192    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-9521b3/test-model-9521b3-kserve-7497665c9c-v8t72"]
Jul 05 13:50:53.135405 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:50:53.135387    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-9521b3/test-model-9521b3-kserve-7497665c9c-v8t72"]
Jul 05 13:50:54.349172 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:50:54.349136    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60758e5c-2262-4cf4-bcdc-57e624490ae1" path="/var/lib/kubelet/pods/60758e5c-2262-4cf4-bcdc-57e624490ae1/volumes"
Jul 05 13:51:20.086123 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:51:20.086042    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:51:20.358670 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:51:20.358601    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:51:20.576477 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:51:20.576442    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:51:20.954355 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:51:20.954324    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:51:21.377420 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:51:21.377388    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:51:21.558409 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:51:21.558383    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:51:21.663324 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:51:21.663257    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:51:31.855514 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:51:31.855479    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:51:31.948195 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:51:31.948137    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:51:32.616636 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:51:32.616604    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:51:32.718445 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:51:32.718405    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:51:32.824935 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:51:32.824909    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:51:32.985199 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:51:32.985129    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:51:33.432563 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:51:33.432538    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:51:33.532840 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:51:33.532789    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:51:37.076685 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:51:37.076652    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:51:37.556396 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:51:37.556364    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:51:37.935389 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:51:37.935320    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:51:38.454038 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:51:38.454004    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:51:40.718129 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:51:40.718083    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:51:40.826701 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:51:40.826652    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:51:40.918863 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:51:40.918832    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:51:41.160092 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:51:41.160049    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:51:41.544682 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:51:41.544637    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:51:41.645498 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:51:41.645456    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:51:45.200402 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:51:45.200372    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:51:53.347265 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:51:53.347211    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:51:53.807410 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:51:53.807382    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:51:53.920791 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:51:53.920761    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:51:54.016010 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:51:54.015955    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:51:54.202561 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:51:54.202490    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:51:59.584043 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:51:59.584007    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:51:59.685361 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:51:59.685311    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:51:59.881924 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:51:59.881814    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:52:00.105015 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:52:00.104984    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:52:00.268288 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:52:00.268170    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:52:00.631114 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:52:00.631062    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:52:00.804425 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:52:00.804392    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:52:00.906034 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:52:00.905937    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:52:01.078656 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:52:01.078625    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:52:03.494670 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:52:03.494640    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:52:06.414142 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:52:06.414112    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:52:06.486117 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:52:06.486088    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:52:06.660425 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:52:06.660399    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:52:06.876604 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:52:06.876546    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:52:07.203034 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:52:07.202968    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:52:07.519576 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:52:07.519505    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:52:08.073856 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:52:08.073823    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:52:10.731261 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:52:10.731214    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:52:10.833986 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:52:10.833929    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:52:10.905635 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:52:10.905588    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:52:11.004034 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:52:11.003965    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:52:11.292585 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:52:11.292558    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:52:11.399183 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:52:11.399150    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:52:11.608878 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:52:11.608808    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:52:11.709438 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:52:11.709411    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:52:15.224007 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:52:15.223971    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:52:15.436795 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:52:15.436766    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:52:15.542891 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:52:15.542862    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:52:15.636989 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:52:15.636963    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:52:15.838242 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:52:15.838150    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:52:16.304985 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:52:16.304952    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:52:18.788014 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:52:18.787982    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:52:18.901165 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:52:18.901135    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:52:19.003881 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:52:19.003851    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:52:19.455441 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:52:19.455402    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:52:19.628820 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:52:19.628788    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:52:19.745331 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:52:19.745242    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:52:23.269938 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:52:23.269906    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:52:32.112462 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:52:32.112405    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:52:32.214577 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:52:32.214532    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:52:33.588366 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:52:33.588331    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:52:38.779971 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:52:38.779931    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:52:38.881074 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:52:38.881041    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:52:40.684453 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:52:40.684399    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:52:40.789131 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:52:40.789092    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:53:06.158761 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:53:06.158725    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-aa2b8d/auth-test-model-aa2b8d-kserve-5d66d87b59-m9kkd"]
Jul 05 13:53:06.159261 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:53:06.159079    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60758e5c-2262-4cf4-bcdc-57e624490ae1" containerName="main"
Jul 05 13:53:06.159261 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:53:06.159089    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="60758e5c-2262-4cf4-bcdc-57e624490ae1" containerName="main"
Jul 05 13:53:06.159261 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:53:06.159159    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="60758e5c-2262-4cf4-bcdc-57e624490ae1" containerName="main"
Jul 05 13:53:06.162227 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:53:06.162202    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-aa2b8d/auth-test-model-aa2b8d-kserve-5d66d87b59-m9kkd"
Jul 05 13:53:06.165135 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:53:06.165116    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-aa2b8d\"/\"openshift-service-ca.crt\""
Jul 05 13:53:06.165395 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:53:06.165380    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-aa2b8d\"/\"kube-root-ca.crt\""
Jul 05 13:53:06.165796 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:53:06.165781    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-aa2b8d\"/\"default-dockercfg-9lbgp\""
Jul 05 13:53:06.165877 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:53:06.165850    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-aa2b8d\"/\"auth-test-model-aa2b8d-kserve-self-signed-certs\""
Jul 05 13:53:06.171620 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:53:06.171598    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-aa2b8d/auth-test-model-aa2b8d-kserve-5d66d87b59-m9kkd"]
Jul 05 13:53:06.247496 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:53:06.247467    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:53:06.262694 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:53:06.262672    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e6cdb062-b58f-4d56-a6ce-f08465d74b48-model-cache\") pod \"auth-test-model-aa2b8d-kserve-5d66d87b59-m9kkd\" (UID: \"e6cdb062-b58f-4d56-a6ce-f08465d74b48\") " pod="ai-tenant-e2e-shared-b-aa2b8d/auth-test-model-aa2b8d-kserve-5d66d87b59-m9kkd"
Jul 05 13:53:06.262830 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:53:06.262717    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e6cdb062-b58f-4d56-a6ce-f08465d74b48-home\") pod \"auth-test-model-aa2b8d-kserve-5d66d87b59-m9kkd\" (UID: \"e6cdb062-b58f-4d56-a6ce-f08465d74b48\") " pod="ai-tenant-e2e-shared-b-aa2b8d/auth-test-model-aa2b8d-kserve-5d66d87b59-m9kkd"
Jul 05 13:53:06.262830 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:53:06.262747    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzjjv\" (UniqueName: \"kubernetes.io/projected/e6cdb062-b58f-4d56-a6ce-f08465d74b48-kube-api-access-lzjjv\") pod \"auth-test-model-aa2b8d-kserve-5d66d87b59-m9kkd\" (UID: \"e6cdb062-b58f-4d56-a6ce-f08465d74b48\") " pod="ai-tenant-e2e-shared-b-aa2b8d/auth-test-model-aa2b8d-kserve-5d66d87b59-m9kkd"
Jul 05 13:53:06.262830 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:53:06.262769    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e6cdb062-b58f-4d56-a6ce-f08465d74b48-tmp-dir\") pod \"auth-test-model-aa2b8d-kserve-5d66d87b59-m9kkd\" (UID: \"e6cdb062-b58f-4d56-a6ce-f08465d74b48\") " pod="ai-tenant-e2e-shared-b-aa2b8d/auth-test-model-aa2b8d-kserve-5d66d87b59-m9kkd"
Jul 05 13:53:06.262830 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:53:06.262800    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e6cdb062-b58f-4d56-a6ce-f08465d74b48-tls-certs\") pod \"auth-test-model-aa2b8d-kserve-5d66d87b59-m9kkd\" (UID: \"e6cdb062-b58f-4d56-a6ce-f08465d74b48\") " pod="ai-tenant-e2e-shared-b-aa2b8d/auth-test-model-aa2b8d-kserve-5d66d87b59-m9kkd"
Jul 05 13:53:06.262830 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:53:06.262826    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e6cdb062-b58f-4d56-a6ce-f08465d74b48-dshm\") pod \"auth-test-model-aa2b8d-kserve-5d66d87b59-m9kkd\" (UID: \"e6cdb062-b58f-4d56-a6ce-f08465d74b48\") " pod="ai-tenant-e2e-shared-b-aa2b8d/auth-test-model-aa2b8d-kserve-5d66d87b59-m9kkd"
Jul 05 13:53:06.364078 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:53:06.364039    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e6cdb062-b58f-4d56-a6ce-f08465d74b48-model-cache\") pod \"auth-test-model-aa2b8d-kserve-5d66d87b59-m9kkd\" (UID: \"e6cdb062-b58f-4d56-a6ce-f08465d74b48\") " pod="ai-tenant-e2e-shared-b-aa2b8d/auth-test-model-aa2b8d-kserve-5d66d87b59-m9kkd"
Jul 05 13:53:06.364252 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:53:06.364089    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e6cdb062-b58f-4d56-a6ce-f08465d74b48-home\") pod \"auth-test-model-aa2b8d-kserve-5d66d87b59-m9kkd\" (UID: \"e6cdb062-b58f-4d56-a6ce-f08465d74b48\") " pod="ai-tenant-e2e-shared-b-aa2b8d/auth-test-model-aa2b8d-kserve-5d66d87b59-m9kkd"
Jul 05 13:53:06.364252 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:53:06.364114    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzjjv\" (UniqueName: \"kubernetes.io/projected/e6cdb062-b58f-4d56-a6ce-f08465d74b48-kube-api-access-lzjjv\") pod \"auth-test-model-aa2b8d-kserve-5d66d87b59-m9kkd\" (UID: \"e6cdb062-b58f-4d56-a6ce-f08465d74b48\") " pod="ai-tenant-e2e-shared-b-aa2b8d/auth-test-model-aa2b8d-kserve-5d66d87b59-m9kkd"
Jul 05 13:53:06.364252 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:53:06.364133    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e6cdb062-b58f-4d56-a6ce-f08465d74b48-tmp-dir\") pod \"auth-test-model-aa2b8d-kserve-5d66d87b59-m9kkd\" (UID: \"e6cdb062-b58f-4d56-a6ce-f08465d74b48\") " pod="ai-tenant-e2e-shared-b-aa2b8d/auth-test-model-aa2b8d-kserve-5d66d87b59-m9kkd"
Jul 05 13:53:06.364252 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:53:06.364154    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e6cdb062-b58f-4d56-a6ce-f08465d74b48-tls-certs\") pod \"auth-test-model-aa2b8d-kserve-5d66d87b59-m9kkd\" (UID: \"e6cdb062-b58f-4d56-a6ce-f08465d74b48\") " pod="ai-tenant-e2e-shared-b-aa2b8d/auth-test-model-aa2b8d-kserve-5d66d87b59-m9kkd"
Jul 05 13:53:06.364252 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:53:06.364180    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e6cdb062-b58f-4d56-a6ce-f08465d74b48-dshm\") pod \"auth-test-model-aa2b8d-kserve-5d66d87b59-m9kkd\" (UID: \"e6cdb062-b58f-4d56-a6ce-f08465d74b48\") " pod="ai-tenant-e2e-shared-b-aa2b8d/auth-test-model-aa2b8d-kserve-5d66d87b59-m9kkd"
Jul 05 13:53:06.364530 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:53:06.364500    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e6cdb062-b58f-4d56-a6ce-f08465d74b48-model-cache\") pod \"auth-test-model-aa2b8d-kserve-5d66d87b59-m9kkd\" (UID: \"e6cdb062-b58f-4d56-a6ce-f08465d74b48\") " pod="ai-tenant-e2e-shared-b-aa2b8d/auth-test-model-aa2b8d-kserve-5d66d87b59-m9kkd"
Jul 05 13:53:06.364590 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:53:06.364556    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e6cdb062-b58f-4d56-a6ce-f08465d74b48-tmp-dir\") pod \"auth-test-model-aa2b8d-kserve-5d66d87b59-m9kkd\" (UID: \"e6cdb062-b58f-4d56-a6ce-f08465d74b48\") " pod="ai-tenant-e2e-shared-b-aa2b8d/auth-test-model-aa2b8d-kserve-5d66d87b59-m9kkd"
Jul 05 13:53:06.364682 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:53:06.364654    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e6cdb062-b58f-4d56-a6ce-f08465d74b48-home\") pod \"auth-test-model-aa2b8d-kserve-5d66d87b59-m9kkd\" (UID: \"e6cdb062-b58f-4d56-a6ce-f08465d74b48\") " pod="ai-tenant-e2e-shared-b-aa2b8d/auth-test-model-aa2b8d-kserve-5d66d87b59-m9kkd"
Jul 05 13:53:06.366466 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:53:06.366445    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e6cdb062-b58f-4d56-a6ce-f08465d74b48-dshm\") pod \"auth-test-model-aa2b8d-kserve-5d66d87b59-m9kkd\" (UID: \"e6cdb062-b58f-4d56-a6ce-f08465d74b48\") " pod="ai-tenant-e2e-shared-b-aa2b8d/auth-test-model-aa2b8d-kserve-5d66d87b59-m9kkd"
Jul 05 13:53:06.366630 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:53:06.366612    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e6cdb062-b58f-4d56-a6ce-f08465d74b48-tls-certs\") pod \"auth-test-model-aa2b8d-kserve-5d66d87b59-m9kkd\" (UID: \"e6cdb062-b58f-4d56-a6ce-f08465d74b48\") " pod="ai-tenant-e2e-shared-b-aa2b8d/auth-test-model-aa2b8d-kserve-5d66d87b59-m9kkd"
Jul 05 13:53:06.372387 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:53:06.372361    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzjjv\" (UniqueName: \"kubernetes.io/projected/e6cdb062-b58f-4d56-a6ce-f08465d74b48-kube-api-access-lzjjv\") pod \"auth-test-model-aa2b8d-kserve-5d66d87b59-m9kkd\" (UID: \"e6cdb062-b58f-4d56-a6ce-f08465d74b48\") " pod="ai-tenant-e2e-shared-b-aa2b8d/auth-test-model-aa2b8d-kserve-5d66d87b59-m9kkd"
Jul 05 13:53:06.472571 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:53:06.472493    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-aa2b8d/auth-test-model-aa2b8d-kserve-5d66d87b59-m9kkd"
Jul 05 13:53:06.619039 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:53:06.619017    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-aa2b8d/auth-test-model-aa2b8d-kserve-5d66d87b59-m9kkd"]
Jul 05 13:53:06.621151 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:53:06.621123    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode6cdb062_b58f_4d56_a6ce_f08465d74b48.slice/crio-9b3c6984ea2ae3e2623f5b989f0c7d787eeeb1f71943b06fe75893a7bf512f88 WatchSource:0}: Error finding container 9b3c6984ea2ae3e2623f5b989f0c7d787eeeb1f71943b06fe75893a7bf512f88: Status 404 returned error can't find the container with id 9b3c6984ea2ae3e2623f5b989f0c7d787eeeb1f71943b06fe75893a7bf512f88
Jul 05 13:53:06.745747 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:53:06.745652    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-aa2b8d/auth-test-model-aa2b8d-kserve-5d66d87b59-m9kkd" event={"ID":"e6cdb062-b58f-4d56-a6ce-f08465d74b48","Type":"ContainerStarted","Data":"39e4b075b2b5239aa4eeaf3cf5444e475531dd036e684f88849dc04ba3d4ae75"}
Jul 05 13:53:06.745747 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:53:06.745701    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-aa2b8d/auth-test-model-aa2b8d-kserve-5d66d87b59-m9kkd" event={"ID":"e6cdb062-b58f-4d56-a6ce-f08465d74b48","Type":"ContainerStarted","Data":"9b3c6984ea2ae3e2623f5b989f0c7d787eeeb1f71943b06fe75893a7bf512f88"}
Jul 05 13:53:06.780355 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:53:06.780303    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-aa2b8d/auth-test-model-aa2b8d-kserve-5d66d87b59-m9kkd" podStartSLOduration=0.780287811 podStartE2EDuration="780.287811ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:53:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:53:06.778283448 +0000 UTC m=+2266.872169074" watchObservedRunningTime="2026-07-05 13:53:06.780287811 +0000 UTC m=+2266.874173436"
Jul 05 13:53:16.473329 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:53:16.473288    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-aa2b8d/auth-test-model-aa2b8d-kserve-5d66d87b59-m9kkd"
Jul 05 13:53:16.473749 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:53:16.473340    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-aa2b8d/auth-test-model-aa2b8d-kserve-5d66d87b59-m9kkd"
Jul 05 13:53:16.485742 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:53:16.485719    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-aa2b8d/auth-test-model-aa2b8d-kserve-5d66d87b59-m9kkd"
Jul 05 13:53:16.805649 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:53:16.805619    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-aa2b8d/auth-test-model-aa2b8d-kserve-5d66d87b59-m9kkd"
Jul 05 13:53:21.553890 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:53:21.553862    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:54:37.702422 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:54:37.702343    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:54:38.766425 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:54:38.766394    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:55:01.421449 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:55:01.421405    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:55:02.272110 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:55:02.272078    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-aa2b8d/auth-test-model-aa2b8d-kserve-5d66d87b59-m9kkd"]
Jul 05 13:55:02.295495 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:55:02.295469    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:55:09.694520 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:55:09.694484    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:55:17.292267 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:55:17.292231    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-aa2b8d/auth-test-model-aa2b8d-kserve-5d66d87b59-m9kkd" podUID="e6cdb062-b58f-4d56-a6ce-f08465d74b48" containerName="main" containerID="cri-o://39e4b075b2b5239aa4eeaf3cf5444e475531dd036e684f88849dc04ba3d4ae75" gracePeriod=45
Jul 05 13:55:17.547288 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:55:17.547206    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-aa2b8d/auth-test-model-aa2b8d-kserve-5d66d87b59-m9kkd"
Jul 05 13:55:17.622553 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:55:17.622527    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e6cdb062-b58f-4d56-a6ce-f08465d74b48-model-cache\") pod \"e6cdb062-b58f-4d56-a6ce-f08465d74b48\" (UID: \"e6cdb062-b58f-4d56-a6ce-f08465d74b48\") "
Jul 05 13:55:17.622680 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:55:17.622562    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e6cdb062-b58f-4d56-a6ce-f08465d74b48-dshm\") pod \"e6cdb062-b58f-4d56-a6ce-f08465d74b48\" (UID: \"e6cdb062-b58f-4d56-a6ce-f08465d74b48\") "
Jul 05 13:55:17.622680 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:55:17.622605    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e6cdb062-b58f-4d56-a6ce-f08465d74b48-tmp-dir\") pod \"e6cdb062-b58f-4d56-a6ce-f08465d74b48\" (UID: \"e6cdb062-b58f-4d56-a6ce-f08465d74b48\") "
Jul 05 13:55:17.622680 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:55:17.622629    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e6cdb062-b58f-4d56-a6ce-f08465d74b48-tls-certs\") pod \"e6cdb062-b58f-4d56-a6ce-f08465d74b48\" (UID: \"e6cdb062-b58f-4d56-a6ce-f08465d74b48\") "
Jul 05 13:55:17.622680 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:55:17.622661    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e6cdb062-b58f-4d56-a6ce-f08465d74b48-home\") pod \"e6cdb062-b58f-4d56-a6ce-f08465d74b48\" (UID: \"e6cdb062-b58f-4d56-a6ce-f08465d74b48\") "
Jul 05 13:55:17.622963 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:55:17.622731    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lzjjv\" (UniqueName: \"kubernetes.io/projected/e6cdb062-b58f-4d56-a6ce-f08465d74b48-kube-api-access-lzjjv\") pod \"e6cdb062-b58f-4d56-a6ce-f08465d74b48\" (UID: \"e6cdb062-b58f-4d56-a6ce-f08465d74b48\") "
Jul 05 13:55:17.623034 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:55:17.622795    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6cdb062-b58f-4d56-a6ce-f08465d74b48-model-cache" (OuterVolumeSpecName: "model-cache") pod "e6cdb062-b58f-4d56-a6ce-f08465d74b48" (UID: "e6cdb062-b58f-4d56-a6ce-f08465d74b48"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:55:17.623106 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:55:17.622894    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6cdb062-b58f-4d56-a6ce-f08465d74b48-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e6cdb062-b58f-4d56-a6ce-f08465d74b48" (UID: "e6cdb062-b58f-4d56-a6ce-f08465d74b48"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:55:17.623106 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:55:17.622987    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6cdb062-b58f-4d56-a6ce-f08465d74b48-home" (OuterVolumeSpecName: "home") pod "e6cdb062-b58f-4d56-a6ce-f08465d74b48" (UID: "e6cdb062-b58f-4d56-a6ce-f08465d74b48"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:55:17.623297 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:55:17.623273    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e6cdb062-b58f-4d56-a6ce-f08465d74b48-tmp-dir\") on node \"ip-10-0-129-239.ec2.internal\" DevicePath \"\""
Jul 05 13:55:17.623357 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:55:17.623297    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e6cdb062-b58f-4d56-a6ce-f08465d74b48-home\") on node \"ip-10-0-129-239.ec2.internal\" DevicePath \"\""
Jul 05 13:55:17.623357 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:55:17.623309    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e6cdb062-b58f-4d56-a6ce-f08465d74b48-model-cache\") on node \"ip-10-0-129-239.ec2.internal\" DevicePath \"\""
Jul 05 13:55:17.624726 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:55:17.624704    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6cdb062-b58f-4d56-a6ce-f08465d74b48-dshm" (OuterVolumeSpecName: "dshm") pod "e6cdb062-b58f-4d56-a6ce-f08465d74b48" (UID: "e6cdb062-b58f-4d56-a6ce-f08465d74b48"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:55:17.624841 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:55:17.624773    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6cdb062-b58f-4d56-a6ce-f08465d74b48-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e6cdb062-b58f-4d56-a6ce-f08465d74b48" (UID: "e6cdb062-b58f-4d56-a6ce-f08465d74b48"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 05 13:55:17.624841 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:55:17.624802    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6cdb062-b58f-4d56-a6ce-f08465d74b48-kube-api-access-lzjjv" (OuterVolumeSpecName: "kube-api-access-lzjjv") pod "e6cdb062-b58f-4d56-a6ce-f08465d74b48" (UID: "e6cdb062-b58f-4d56-a6ce-f08465d74b48"). InnerVolumeSpecName "kube-api-access-lzjjv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 13:55:17.723603 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:55:17.723579    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e6cdb062-b58f-4d56-a6ce-f08465d74b48-dshm\") on node \"ip-10-0-129-239.ec2.internal\" DevicePath \"\""
Jul 05 13:55:17.723603 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:55:17.723602    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e6cdb062-b58f-4d56-a6ce-f08465d74b48-tls-certs\") on node \"ip-10-0-129-239.ec2.internal\" DevicePath \"\""
Jul 05 13:55:17.723734 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:55:17.723617    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lzjjv\" (UniqueName: \"kubernetes.io/projected/e6cdb062-b58f-4d56-a6ce-f08465d74b48-kube-api-access-lzjjv\") on node \"ip-10-0-129-239.ec2.internal\" DevicePath \"\""
Jul 05 13:55:18.376791 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:55:18.376763    2563 generic.go:356] "Generic (PLEG): container finished" podID="e6cdb062-b58f-4d56-a6ce-f08465d74b48" containerID="39e4b075b2b5239aa4eeaf3cf5444e475531dd036e684f88849dc04ba3d4ae75" exitCode=0
Jul 05 13:55:18.377144 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:55:18.376801    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-aa2b8d/auth-test-model-aa2b8d-kserve-5d66d87b59-m9kkd"
Jul 05 13:55:18.377144 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:55:18.376840    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-aa2b8d/auth-test-model-aa2b8d-kserve-5d66d87b59-m9kkd" event={"ID":"e6cdb062-b58f-4d56-a6ce-f08465d74b48","Type":"ContainerDied","Data":"39e4b075b2b5239aa4eeaf3cf5444e475531dd036e684f88849dc04ba3d4ae75"}
Jul 05 13:55:18.377144 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:55:18.376876    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-aa2b8d/auth-test-model-aa2b8d-kserve-5d66d87b59-m9kkd" event={"ID":"e6cdb062-b58f-4d56-a6ce-f08465d74b48","Type":"ContainerDied","Data":"9b3c6984ea2ae3e2623f5b989f0c7d787eeeb1f71943b06fe75893a7bf512f88"}
Jul 05 13:55:18.377144 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:55:18.376893    2563 scope.go:117] "RemoveContainer" containerID="39e4b075b2b5239aa4eeaf3cf5444e475531dd036e684f88849dc04ba3d4ae75"
Jul 05 13:55:18.385596 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:55:18.385571    2563 scope.go:117] "RemoveContainer" containerID="39e4b075b2b5239aa4eeaf3cf5444e475531dd036e684f88849dc04ba3d4ae75"
Jul 05 13:55:18.385856 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:55:18.385836    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39e4b075b2b5239aa4eeaf3cf5444e475531dd036e684f88849dc04ba3d4ae75\": container with ID starting with 39e4b075b2b5239aa4eeaf3cf5444e475531dd036e684f88849dc04ba3d4ae75 not found: ID does not exist" containerID="39e4b075b2b5239aa4eeaf3cf5444e475531dd036e684f88849dc04ba3d4ae75"
Jul 05 13:55:18.385903 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:55:18.385865    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39e4b075b2b5239aa4eeaf3cf5444e475531dd036e684f88849dc04ba3d4ae75"} err="failed to get container status \"39e4b075b2b5239aa4eeaf3cf5444e475531dd036e684f88849dc04ba3d4ae75\": rpc error: code = NotFound desc = could not find container \"39e4b075b2b5239aa4eeaf3cf5444e475531dd036e684f88849dc04ba3d4ae75\": container with ID starting with 39e4b075b2b5239aa4eeaf3cf5444e475531dd036e684f88849dc04ba3d4ae75 not found: ID does not exist"
Jul 05 13:55:18.392252 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:55:18.392210    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-aa2b8d/auth-test-model-aa2b8d-kserve-5d66d87b59-m9kkd"]
Jul 05 13:55:18.396364 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:55:18.396344    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-aa2b8d/auth-test-model-aa2b8d-kserve-5d66d87b59-m9kkd"]
Jul 05 13:55:20.349049 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:55:20.349018    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6cdb062-b58f-4d56-a6ce-f08465d74b48" path="/var/lib/kubelet/pods/e6cdb062-b58f-4d56-a6ce-f08465d74b48/volumes"
Jul 05 13:55:33.146491 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:55:33.146462    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-aa2b8d/sub-test-model-aa2b8d-kserve-6d955f499-x42cb"]
Jul 05 13:55:33.147046 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:55:33.146995    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6cdb062-b58f-4d56-a6ce-f08465d74b48" containerName="main"
Jul 05 13:55:33.147046 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:55:33.147014    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6cdb062-b58f-4d56-a6ce-f08465d74b48" containerName="main"
Jul 05 13:55:33.147165 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:55:33.147127    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6cdb062-b58f-4d56-a6ce-f08465d74b48" containerName="main"
Jul 05 13:55:33.150136 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:55:33.150115    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-aa2b8d/sub-test-model-aa2b8d-kserve-6d955f499-x42cb"
Jul 05 13:55:33.152827 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:55:33.152809    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-aa2b8d\"/\"kube-root-ca.crt\""
Jul 05 13:55:33.153840 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:55:33.153817    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-aa2b8d\"/\"default-dockercfg-9lbgp\""
Jul 05 13:55:33.153946 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:55:33.153868    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-aa2b8d\"/\"sub-test-model-aa2b8d-kserve-self-signed-certs\""
Jul 05 13:55:33.153946 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:55:33.153892    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-aa2b8d\"/\"openshift-service-ca.crt\""
Jul 05 13:55:33.157824 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:55:33.157806    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-aa2b8d/sub-test-model-aa2b8d-kserve-6d955f499-x42cb"]
Jul 05 13:55:33.180517 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:55:33.180495    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:55:33.242920 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:55:33.242897    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fbefccc8-ae2a-4b9d-9875-a1f50a08c664-home\") pod \"sub-test-model-aa2b8d-kserve-6d955f499-x42cb\" (UID: \"fbefccc8-ae2a-4b9d-9875-a1f50a08c664\") " pod="ai-tenant-e2e-shared-b-aa2b8d/sub-test-model-aa2b8d-kserve-6d955f499-x42cb"
Jul 05 13:55:33.243029 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:55:33.242923    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fbefccc8-ae2a-4b9d-9875-a1f50a08c664-dshm\") pod \"sub-test-model-aa2b8d-kserve-6d955f499-x42cb\" (UID: \"fbefccc8-ae2a-4b9d-9875-a1f50a08c664\") " pod="ai-tenant-e2e-shared-b-aa2b8d/sub-test-model-aa2b8d-kserve-6d955f499-x42cb"
Jul 05 13:55:33.243029 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:55:33.242950    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fbefccc8-ae2a-4b9d-9875-a1f50a08c664-tmp-dir\") pod \"sub-test-model-aa2b8d-kserve-6d955f499-x42cb\" (UID: \"fbefccc8-ae2a-4b9d-9875-a1f50a08c664\") " pod="ai-tenant-e2e-shared-b-aa2b8d/sub-test-model-aa2b8d-kserve-6d955f499-x42cb"
Jul 05 13:55:33.243029 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:55:33.243017    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fbefccc8-ae2a-4b9d-9875-a1f50a08c664-tls-certs\") pod \"sub-test-model-aa2b8d-kserve-6d955f499-x42cb\" (UID: \"fbefccc8-ae2a-4b9d-9875-a1f50a08c664\") " pod="ai-tenant-e2e-shared-b-aa2b8d/sub-test-model-aa2b8d-kserve-6d955f499-x42cb"
Jul 05 13:55:33.243138 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:55:33.243042    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pn8v7\" (UniqueName: \"kubernetes.io/projected/fbefccc8-ae2a-4b9d-9875-a1f50a08c664-kube-api-access-pn8v7\") pod \"sub-test-model-aa2b8d-kserve-6d955f499-x42cb\" (UID: \"fbefccc8-ae2a-4b9d-9875-a1f50a08c664\") " pod="ai-tenant-e2e-shared-b-aa2b8d/sub-test-model-aa2b8d-kserve-6d955f499-x42cb"
Jul 05 13:55:33.243138 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:55:33.243072    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fbefccc8-ae2a-4b9d-9875-a1f50a08c664-model-cache\") pod \"sub-test-model-aa2b8d-kserve-6d955f499-x42cb\" (UID: \"fbefccc8-ae2a-4b9d-9875-a1f50a08c664\") " pod="ai-tenant-e2e-shared-b-aa2b8d/sub-test-model-aa2b8d-kserve-6d955f499-x42cb"
Jul 05 13:55:33.343454 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:55:33.343425    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fbefccc8-ae2a-4b9d-9875-a1f50a08c664-tls-certs\") pod \"sub-test-model-aa2b8d-kserve-6d955f499-x42cb\" (UID: \"fbefccc8-ae2a-4b9d-9875-a1f50a08c664\") " pod="ai-tenant-e2e-shared-b-aa2b8d/sub-test-model-aa2b8d-kserve-6d955f499-x42cb"
Jul 05 13:55:33.343572 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:55:33.343458    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pn8v7\" (UniqueName: \"kubernetes.io/projected/fbefccc8-ae2a-4b9d-9875-a1f50a08c664-kube-api-access-pn8v7\") pod \"sub-test-model-aa2b8d-kserve-6d955f499-x42cb\" (UID: \"fbefccc8-ae2a-4b9d-9875-a1f50a08c664\") " pod="ai-tenant-e2e-shared-b-aa2b8d/sub-test-model-aa2b8d-kserve-6d955f499-x42cb"
Jul 05 13:55:33.343572 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:55:33.343486    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fbefccc8-ae2a-4b9d-9875-a1f50a08c664-model-cache\") pod \"sub-test-model-aa2b8d-kserve-6d955f499-x42cb\" (UID: \"fbefccc8-ae2a-4b9d-9875-a1f50a08c664\") " pod="ai-tenant-e2e-shared-b-aa2b8d/sub-test-model-aa2b8d-kserve-6d955f499-x42cb"
Jul 05 13:55:33.343660 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:55:33.343573    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fbefccc8-ae2a-4b9d-9875-a1f50a08c664-home\") pod \"sub-test-model-aa2b8d-kserve-6d955f499-x42cb\" (UID: \"fbefccc8-ae2a-4b9d-9875-a1f50a08c664\") " pod="ai-tenant-e2e-shared-b-aa2b8d/sub-test-model-aa2b8d-kserve-6d955f499-x42cb"
Jul 05 13:55:33.343660 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:55:33.343602    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fbefccc8-ae2a-4b9d-9875-a1f50a08c664-dshm\") pod \"sub-test-model-aa2b8d-kserve-6d955f499-x42cb\" (UID: \"fbefccc8-ae2a-4b9d-9875-a1f50a08c664\") " pod="ai-tenant-e2e-shared-b-aa2b8d/sub-test-model-aa2b8d-kserve-6d955f499-x42cb"
Jul 05 13:55:33.343660 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:55:33.343641    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fbefccc8-ae2a-4b9d-9875-a1f50a08c664-tmp-dir\") pod \"sub-test-model-aa2b8d-kserve-6d955f499-x42cb\" (UID: \"fbefccc8-ae2a-4b9d-9875-a1f50a08c664\") " pod="ai-tenant-e2e-shared-b-aa2b8d/sub-test-model-aa2b8d-kserve-6d955f499-x42cb"
Jul 05 13:55:33.344021 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:55:33.343987    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fbefccc8-ae2a-4b9d-9875-a1f50a08c664-model-cache\") pod \"sub-test-model-aa2b8d-kserve-6d955f499-x42cb\" (UID: \"fbefccc8-ae2a-4b9d-9875-a1f50a08c664\") " pod="ai-tenant-e2e-shared-b-aa2b8d/sub-test-model-aa2b8d-kserve-6d955f499-x42cb"
Jul 05 13:55:33.344021 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:55:33.344011    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fbefccc8-ae2a-4b9d-9875-a1f50a08c664-home\") pod \"sub-test-model-aa2b8d-kserve-6d955f499-x42cb\" (UID: \"fbefccc8-ae2a-4b9d-9875-a1f50a08c664\") " pod="ai-tenant-e2e-shared-b-aa2b8d/sub-test-model-aa2b8d-kserve-6d955f499-x42cb"
Jul 05 13:55:33.344174 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:55:33.344033    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fbefccc8-ae2a-4b9d-9875-a1f50a08c664-tmp-dir\") pod \"sub-test-model-aa2b8d-kserve-6d955f499-x42cb\" (UID: \"fbefccc8-ae2a-4b9d-9875-a1f50a08c664\") " pod="ai-tenant-e2e-shared-b-aa2b8d/sub-test-model-aa2b8d-kserve-6d955f499-x42cb"
Jul 05 13:55:33.345809 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:55:33.345788    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fbefccc8-ae2a-4b9d-9875-a1f50a08c664-dshm\") pod \"sub-test-model-aa2b8d-kserve-6d955f499-x42cb\" (UID: \"fbefccc8-ae2a-4b9d-9875-a1f50a08c664\") " pod="ai-tenant-e2e-shared-b-aa2b8d/sub-test-model-aa2b8d-kserve-6d955f499-x42cb"
Jul 05 13:55:33.345907 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:55:33.345892    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fbefccc8-ae2a-4b9d-9875-a1f50a08c664-tls-certs\") pod \"sub-test-model-aa2b8d-kserve-6d955f499-x42cb\" (UID: \"fbefccc8-ae2a-4b9d-9875-a1f50a08c664\") " pod="ai-tenant-e2e-shared-b-aa2b8d/sub-test-model-aa2b8d-kserve-6d955f499-x42cb"
Jul 05 13:55:33.351266 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:55:33.351245    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pn8v7\" (UniqueName: \"kubernetes.io/projected/fbefccc8-ae2a-4b9d-9875-a1f50a08c664-kube-api-access-pn8v7\") pod \"sub-test-model-aa2b8d-kserve-6d955f499-x42cb\" (UID: \"fbefccc8-ae2a-4b9d-9875-a1f50a08c664\") " pod="ai-tenant-e2e-shared-b-aa2b8d/sub-test-model-aa2b8d-kserve-6d955f499-x42cb"
Jul 05 13:55:33.462013 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:55:33.461960    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-aa2b8d/sub-test-model-aa2b8d-kserve-6d955f499-x42cb"
Jul 05 13:55:33.591122 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:55:33.591098    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-aa2b8d/sub-test-model-aa2b8d-kserve-6d955f499-x42cb"]
Jul 05 13:55:33.593335 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:55:33.593308    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfbefccc8_ae2a_4b9d_9875_a1f50a08c664.slice/crio-987e8235bbcc0b17e223807bf11ae9c9f0c9dc93773719efa7711b808427ca7f WatchSource:0}: Error finding container 987e8235bbcc0b17e223807bf11ae9c9f0c9dc93773719efa7711b808427ca7f: Status 404 returned error can't find the container with id 987e8235bbcc0b17e223807bf11ae9c9f0c9dc93773719efa7711b808427ca7f
Jul 05 13:55:34.456152 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:55:34.456108    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-aa2b8d/sub-test-model-aa2b8d-kserve-6d955f499-x42cb" event={"ID":"fbefccc8-ae2a-4b9d-9875-a1f50a08c664","Type":"ContainerStarted","Data":"ce92fa8596ad685d52604801741b05cefdfd978d0044784c0eee1dae170ddad8"}
Jul 05 13:55:34.456616 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:55:34.456163    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-aa2b8d/sub-test-model-aa2b8d-kserve-6d955f499-x42cb" event={"ID":"fbefccc8-ae2a-4b9d-9875-a1f50a08c664","Type":"ContainerStarted","Data":"987e8235bbcc0b17e223807bf11ae9c9f0c9dc93773719efa7711b808427ca7f"}
Jul 05 13:55:34.484702 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:55:34.484661    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-aa2b8d/sub-test-model-aa2b8d-kserve-6d955f499-x42cb" podStartSLOduration=1.48464946 podStartE2EDuration="1.48464946s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:55:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:55:34.484495783 +0000 UTC m=+2414.578381410" watchObservedRunningTime="2026-07-05 13:55:34.48464946 +0000 UTC m=+2414.578535085"
Jul 05 13:55:43.462140 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:55:43.462054    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-aa2b8d/sub-test-model-aa2b8d-kserve-6d955f499-x42cb"
Jul 05 13:55:43.462140 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:55:43.462106    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-aa2b8d/sub-test-model-aa2b8d-kserve-6d955f499-x42cb"
Jul 05 13:55:43.477165 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:55:43.477137    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-aa2b8d/sub-test-model-aa2b8d-kserve-6d955f499-x42cb"
Jul 05 13:55:43.510278 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:55:43.510257    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-aa2b8d/sub-test-model-aa2b8d-kserve-6d955f499-x42cb"
Jul 05 13:56:08.292009 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:56:08.291960    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:56:09.080695 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:56:09.080659    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-aa2b8d/sub-test-model-aa2b8d-kserve-6d955f499-x42cb"]
Jul 05 13:56:09.090104 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:56:09.090077    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:56:21.195713 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:56:21.195659    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:56:24.101161 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:56:24.101129    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-aa2b8d/sub-test-model-aa2b8d-kserve-6d955f499-x42cb" podUID="fbefccc8-ae2a-4b9d-9875-a1f50a08c664" containerName="main" containerID="cri-o://ce92fa8596ad685d52604801741b05cefdfd978d0044784c0eee1dae170ddad8" gracePeriod=45
Jul 05 13:56:24.347067 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:56:24.347043    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-aa2b8d/sub-test-model-aa2b8d-kserve-6d955f499-x42cb"
Jul 05 13:56:24.439071 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:56:24.439006    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pn8v7\" (UniqueName: \"kubernetes.io/projected/fbefccc8-ae2a-4b9d-9875-a1f50a08c664-kube-api-access-pn8v7\") pod \"fbefccc8-ae2a-4b9d-9875-a1f50a08c664\" (UID: \"fbefccc8-ae2a-4b9d-9875-a1f50a08c664\") "
Jul 05 13:56:24.439071 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:56:24.439042    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fbefccc8-ae2a-4b9d-9875-a1f50a08c664-tmp-dir\") pod \"fbefccc8-ae2a-4b9d-9875-a1f50a08c664\" (UID: \"fbefccc8-ae2a-4b9d-9875-a1f50a08c664\") "
Jul 05 13:56:24.439297 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:56:24.439076    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fbefccc8-ae2a-4b9d-9875-a1f50a08c664-model-cache\") pod \"fbefccc8-ae2a-4b9d-9875-a1f50a08c664\" (UID: \"fbefccc8-ae2a-4b9d-9875-a1f50a08c664\") "
Jul 05 13:56:24.439297 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:56:24.439096    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fbefccc8-ae2a-4b9d-9875-a1f50a08c664-home\") pod \"fbefccc8-ae2a-4b9d-9875-a1f50a08c664\" (UID: \"fbefccc8-ae2a-4b9d-9875-a1f50a08c664\") "
Jul 05 13:56:24.439297 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:56:24.439161    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fbefccc8-ae2a-4b9d-9875-a1f50a08c664-tls-certs\") pod \"fbefccc8-ae2a-4b9d-9875-a1f50a08c664\" (UID: \"fbefccc8-ae2a-4b9d-9875-a1f50a08c664\") "
Jul 05 13:56:24.439297 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:56:24.439202    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fbefccc8-ae2a-4b9d-9875-a1f50a08c664-dshm\") pod \"fbefccc8-ae2a-4b9d-9875-a1f50a08c664\" (UID: \"fbefccc8-ae2a-4b9d-9875-a1f50a08c664\") "
Jul 05 13:56:24.439528 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:56:24.439352    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbefccc8-ae2a-4b9d-9875-a1f50a08c664-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "fbefccc8-ae2a-4b9d-9875-a1f50a08c664" (UID: "fbefccc8-ae2a-4b9d-9875-a1f50a08c664"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:56:24.439528 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:56:24.439352    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbefccc8-ae2a-4b9d-9875-a1f50a08c664-model-cache" (OuterVolumeSpecName: "model-cache") pod "fbefccc8-ae2a-4b9d-9875-a1f50a08c664" (UID: "fbefccc8-ae2a-4b9d-9875-a1f50a08c664"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:56:24.439528 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:56:24.439374    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbefccc8-ae2a-4b9d-9875-a1f50a08c664-home" (OuterVolumeSpecName: "home") pod "fbefccc8-ae2a-4b9d-9875-a1f50a08c664" (UID: "fbefccc8-ae2a-4b9d-9875-a1f50a08c664"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:56:24.439682 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:56:24.439586    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fbefccc8-ae2a-4b9d-9875-a1f50a08c664-tmp-dir\") on node \"ip-10-0-129-239.ec2.internal\" DevicePath \"\""
Jul 05 13:56:24.439682 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:56:24.439609    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fbefccc8-ae2a-4b9d-9875-a1f50a08c664-model-cache\") on node \"ip-10-0-129-239.ec2.internal\" DevicePath \"\""
Jul 05 13:56:24.439682 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:56:24.439621    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fbefccc8-ae2a-4b9d-9875-a1f50a08c664-home\") on node \"ip-10-0-129-239.ec2.internal\" DevicePath \"\""
Jul 05 13:56:24.441186 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:56:24.441164    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbefccc8-ae2a-4b9d-9875-a1f50a08c664-dshm" (OuterVolumeSpecName: "dshm") pod "fbefccc8-ae2a-4b9d-9875-a1f50a08c664" (UID: "fbefccc8-ae2a-4b9d-9875-a1f50a08c664"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:56:24.441291 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:56:24.441236    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbefccc8-ae2a-4b9d-9875-a1f50a08c664-kube-api-access-pn8v7" (OuterVolumeSpecName: "kube-api-access-pn8v7") pod "fbefccc8-ae2a-4b9d-9875-a1f50a08c664" (UID: "fbefccc8-ae2a-4b9d-9875-a1f50a08c664"). InnerVolumeSpecName "kube-api-access-pn8v7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 13:56:24.441334 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:56:24.441309    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fbefccc8-ae2a-4b9d-9875-a1f50a08c664-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "fbefccc8-ae2a-4b9d-9875-a1f50a08c664" (UID: "fbefccc8-ae2a-4b9d-9875-a1f50a08c664"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 05 13:56:24.539956 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:56:24.539935    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fbefccc8-ae2a-4b9d-9875-a1f50a08c664-tls-certs\") on node \"ip-10-0-129-239.ec2.internal\" DevicePath \"\""
Jul 05 13:56:24.539956 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:56:24.539955    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fbefccc8-ae2a-4b9d-9875-a1f50a08c664-dshm\") on node \"ip-10-0-129-239.ec2.internal\" DevicePath \"\""
Jul 05 13:56:24.540077 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:56:24.539964    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pn8v7\" (UniqueName: \"kubernetes.io/projected/fbefccc8-ae2a-4b9d-9875-a1f50a08c664-kube-api-access-pn8v7\") on node \"ip-10-0-129-239.ec2.internal\" DevicePath \"\""
Jul 05 13:56:24.698174 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:56:24.698111    2563 generic.go:356] "Generic (PLEG): container finished" podID="fbefccc8-ae2a-4b9d-9875-a1f50a08c664" containerID="ce92fa8596ad685d52604801741b05cefdfd978d0044784c0eee1dae170ddad8" exitCode=0
Jul 05 13:56:24.698299 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:56:24.698172    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-aa2b8d/sub-test-model-aa2b8d-kserve-6d955f499-x42cb"
Jul 05 13:56:24.698299 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:56:24.698198    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-aa2b8d/sub-test-model-aa2b8d-kserve-6d955f499-x42cb" event={"ID":"fbefccc8-ae2a-4b9d-9875-a1f50a08c664","Type":"ContainerDied","Data":"ce92fa8596ad685d52604801741b05cefdfd978d0044784c0eee1dae170ddad8"}
Jul 05 13:56:24.698299 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:56:24.698263    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-aa2b8d/sub-test-model-aa2b8d-kserve-6d955f499-x42cb" event={"ID":"fbefccc8-ae2a-4b9d-9875-a1f50a08c664","Type":"ContainerDied","Data":"987e8235bbcc0b17e223807bf11ae9c9f0c9dc93773719efa7711b808427ca7f"}
Jul 05 13:56:24.698299 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:56:24.698288    2563 scope.go:117] "RemoveContainer" containerID="ce92fa8596ad685d52604801741b05cefdfd978d0044784c0eee1dae170ddad8"
Jul 05 13:56:24.710094 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:56:24.710077    2563 scope.go:117] "RemoveContainer" containerID="ce92fa8596ad685d52604801741b05cefdfd978d0044784c0eee1dae170ddad8"
Jul 05 13:56:24.710378 ip-10-0-129-239 kubenswrapper[2563]: E0705 13:56:24.710360    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce92fa8596ad685d52604801741b05cefdfd978d0044784c0eee1dae170ddad8\": container with ID starting with ce92fa8596ad685d52604801741b05cefdfd978d0044784c0eee1dae170ddad8 not found: ID does not exist" containerID="ce92fa8596ad685d52604801741b05cefdfd978d0044784c0eee1dae170ddad8"
Jul 05 13:56:24.710445 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:56:24.710387    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce92fa8596ad685d52604801741b05cefdfd978d0044784c0eee1dae170ddad8"} err="failed to get container status \"ce92fa8596ad685d52604801741b05cefdfd978d0044784c0eee1dae170ddad8\": rpc error: code = NotFound desc = could not find container \"ce92fa8596ad685d52604801741b05cefdfd978d0044784c0eee1dae170ddad8\": container with ID starting with ce92fa8596ad685d52604801741b05cefdfd978d0044784c0eee1dae170ddad8 not found: ID does not exist"
Jul 05 13:56:24.719358 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:56:24.719338    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-aa2b8d/sub-test-model-aa2b8d-kserve-6d955f499-x42cb"]
Jul 05 13:56:24.723662 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:56:24.723642    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-aa2b8d/sub-test-model-aa2b8d-kserve-6d955f499-x42cb"]
Jul 05 13:56:26.349412 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:56:26.349380    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fbefccc8-ae2a-4b9d-9875-a1f50a08c664" path="/var/lib/kubelet/pods/fbefccc8-ae2a-4b9d-9875-a1f50a08c664/volumes"
Jul 05 13:56:37.905237 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:56:37.905183    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:57:16.260762 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:57:16.260685    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:57:16.365955 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:57:16.365922    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:57:20.668098 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:57:20.668059    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:57:21.692417 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:57:21.692387    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:57:22.736854 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:57:22.736823    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:57:23.101242 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:57:23.101188    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:57:23.201263 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:57:23.201210    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:57:23.301605 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:57:23.301564    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:57:23.409433 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:57:23.409354    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:57:28.278469 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:57:28.278433    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:57:41.525025 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:57:41.524980    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:57:41.626140 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:57:41.626102    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:57:59.709262 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:57:59.709212    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:57:59.766788 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:57:59.766766    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:58:05.051671 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:05.051641    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:58:05.309501 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:05.309426    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:58:05.569423 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:05.569349    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:58:05.728145 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:05.728106    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:58:06.091725 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:06.091698    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:58:06.155042 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:06.155015    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:58:12.076835 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:12.076802    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:58:12.177062 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:12.177034    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:58:12.415012 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:12.414925    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:58:12.581160 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:12.581134    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:58:14.978080 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:14.971641    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:58:17.915807 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:17.915782    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29720985-9bqwh_7b1b9642-6fb5-4202-b663-80ae56193724/cleanup/0.log"
Jul 05 13:58:18.027690 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:18.027666    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6845d5b85-28n7p_eba9a444-a74b-4b7b-88c2-aefcd3d5661b/manager/0.log"
Jul 05 13:58:18.143753 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:18.143727    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-qlqcv_f0d5a21c-1cf9-4102-b1f4-9b43e2e0842e/server/0.log"
Jul 05 13:58:18.259984 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:18.259919    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-mlntb_b91847d8-1eb2-49b6-bf0a-fe5da4089de9/manager/0.log"
Jul 05 13:58:18.615600 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:18.615575    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6674ff8b4f-vkw8n_8630b1ac-6708-46b1-b8b5-27fbcff48712/copy-manifests/0.log"
Jul 05 13:58:18.622616 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:18.622595    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6674ff8b4f-vkw8n_8630b1ac-6708-46b1-b8b5-27fbcff48712/manager/0.log"
Jul 05 13:58:18.730680 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:18.730661    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-dtd5f_e7cc7d59-c515-47c7-8eab-bb92468c73c8/postgres/0.log"
Jul 05 13:58:20.213959 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:20.213936    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-z847s_ae0fcba1-fac4-4c0a-8d03-376dd637f68b/manager/0.log"
Jul 05 13:58:20.452836 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:20.452805    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-wz7lb_e0ce42d3-f45a-4788-ae2b-832cac2f16d1/registry-server/0.log"
Jul 05 13:58:20.567714 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:20.567693    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-k8dbz_c6f6a48c-33b7-4d8d-b621-fd8ecf1b3bb3/manager/0.log"
Jul 05 13:58:20.792983 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:20.792961    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-jdgv9_813a0616-4142-4f0e-b2cd-6f569e1b43ca/manager/0.log"
Jul 05 13:58:21.238014 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:21.237985    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-9vcsg_897d1326-9bac-467f-bacd-6c9ac0f4a87c/discovery/0.log"
Jul 05 13:58:21.350779 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:21.350760    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7bcdf4856b-4fv6n_c180d7f0-78ef-4c2a-b62f-dcfc0af24c71/kube-auth-proxy/0.log"
Jul 05 13:58:21.809616 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:21.809594    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-qmn7b_24907e05-7aa3-4332-9864-b42cadef9d2c/payload-processing/0.log"
Jul 05 13:58:22.258797 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:22.258734    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-vqzjg_a76c4df1-f0fa-44b3-a948-3a1a8daaec35/main/0.log"
Jul 05 13:58:22.479236 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:22.479200    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-b2ltb_7bb0d007-5078-4c33-a1f2-6cec7248295f/main/0.log"
Jul 05 13:58:22.704147 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:22.704125    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-wmhs8_bc404e16-7be6-428c-a9ff-b1b8ff3fa3a9/main/0.log"
Jul 05 13:58:26.970542 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:26.970513    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:58:27.049208 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:27.049181    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log" limit=1024
Jul 05 13:58:29.903451 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:29.903422    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-nll82_93717f79-abca-4163-80a4-061dabcc4d51/global-pull-secret-syncer/0.log"
Jul 05 13:58:29.952690 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:29.952633    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-jrlbp_e17e56ea-7aa6-4a13-a11c-399e00d91800/konnectivity-agent/0.log"
Jul 05 13:58:30.035526 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:30.035507    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-239.ec2.internal_accb531ad4f6f6ba026b8fe327ce0ae5/haproxy/0.log"
Jul 05 13:58:35.394433 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:35.394403    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-z847s_ae0fcba1-fac4-4c0a-8d03-376dd637f68b/manager/0.log"
Jul 05 13:58:35.468991 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:35.468969    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-wz7lb_e0ce42d3-f45a-4788-ae2b-832cac2f16d1/registry-server/0.log"
Jul 05 13:58:35.603009 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:35.602977    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-k8dbz_c6f6a48c-33b7-4d8d-b621-fd8ecf1b3bb3/manager/0.log"
Jul 05 13:58:35.724853 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:35.724785    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-jdgv9_813a0616-4142-4f0e-b2cd-6f569e1b43ca/manager/0.log"
Jul 05 13:58:37.852365 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:37.852330    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-l2fhm_7aacf9b6-db42-4cad-a2e1-567348e1df0d/monitoring-plugin/0.log"
Jul 05 13:58:38.082665 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:38.082637    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x4b5q_6f2f0cf0-ebb3-457c-9639-11b729c957c4/node-exporter/0.log"
Jul 05 13:58:38.107811 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:38.107748    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x4b5q_6f2f0cf0-ebb3-457c-9639-11b729c957c4/kube-rbac-proxy/0.log"
Jul 05 13:58:38.133276 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:38.133255    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x4b5q_6f2f0cf0-ebb3-457c-9639-11b729c957c4/init-textfile/0.log"
Jul 05 13:58:38.484207 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:38.484141    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-9fqtl_26c93170-d1c0-4597-8dbe-1e3213d7381c/prometheus-operator-admission-webhook/0.log"
Jul 05 13:58:38.518035 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:38.518017    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5d9dcf858c-p95ld_5a0d059b-fa5f-4854-a91a-95ef161eb5bd/telemeter-client/0.log"
Jul 05 13:58:38.556486 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:38.556468    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5d9dcf858c-p95ld_5a0d059b-fa5f-4854-a91a-95ef161eb5bd/reload/0.log"
Jul 05 13:58:38.577823 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:38.577807    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5d9dcf858c-p95ld_5a0d059b-fa5f-4854-a91a-95ef161eb5bd/kube-rbac-proxy/0.log"
Jul 05 13:58:38.609557 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:38.609542    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b769b59b-xnhn5_92d3b75f-05b2-4f2a-8da5-052c79d99748/thanos-query/0.log"
Jul 05 13:58:38.632493 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:38.632476    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b769b59b-xnhn5_92d3b75f-05b2-4f2a-8da5-052c79d99748/kube-rbac-proxy-web/0.log"
Jul 05 13:58:38.655091 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:38.655073    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b769b59b-xnhn5_92d3b75f-05b2-4f2a-8da5-052c79d99748/kube-rbac-proxy/0.log"
Jul 05 13:58:38.688367 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:38.688348    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b769b59b-xnhn5_92d3b75f-05b2-4f2a-8da5-052c79d99748/prom-label-proxy/0.log"
Jul 05 13:58:38.711037 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:38.711017    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b769b59b-xnhn5_92d3b75f-05b2-4f2a-8da5-052c79d99748/kube-rbac-proxy-rules/0.log"
Jul 05 13:58:38.734299 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:38.734246    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b769b59b-xnhn5_92d3b75f-05b2-4f2a-8da5-052c79d99748/kube-rbac-proxy-metrics/0.log"
Jul 05 13:58:39.815407 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:39.815376    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ks4vm/perf-node-gather-daemonset-6mth6"]
Jul 05 13:58:39.815759 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:39.815746    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbefccc8-ae2a-4b9d-9875-a1f50a08c664" containerName="main"
Jul 05 13:58:39.815759 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:39.815758    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbefccc8-ae2a-4b9d-9875-a1f50a08c664" containerName="main"
Jul 05 13:58:39.815847 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:39.815836    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbefccc8-ae2a-4b9d-9875-a1f50a08c664" containerName="main"
Jul 05 13:58:39.819003 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:39.818983    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ks4vm/perf-node-gather-daemonset-6mth6"
Jul 05 13:58:39.821462 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:39.821438    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ks4vm\"/\"kube-root-ca.crt\""
Jul 05 13:58:39.821462 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:39.821438    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ks4vm\"/\"openshift-service-ca.crt\""
Jul 05 13:58:39.821607 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:39.821506    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-ks4vm\"/\"default-dockercfg-q7ls5\""
Jul 05 13:58:39.829575 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:39.829554    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ks4vm/perf-node-gather-daemonset-6mth6"]
Jul 05 13:58:39.847508 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:39.847484    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5f244fe6-0ccd-4444-a222-810919586ae4-proc\") pod \"perf-node-gather-daemonset-6mth6\" (UID: \"5f244fe6-0ccd-4444-a222-810919586ae4\") " pod="openshift-must-gather-ks4vm/perf-node-gather-daemonset-6mth6"
Jul 05 13:58:39.847611 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:39.847519    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5f244fe6-0ccd-4444-a222-810919586ae4-lib-modules\") pod \"perf-node-gather-daemonset-6mth6\" (UID: \"5f244fe6-0ccd-4444-a222-810919586ae4\") " pod="openshift-must-gather-ks4vm/perf-node-gather-daemonset-6mth6"
Jul 05 13:58:39.847611 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:39.847562    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5f244fe6-0ccd-4444-a222-810919586ae4-podres\") pod \"perf-node-gather-daemonset-6mth6\" (UID: \"5f244fe6-0ccd-4444-a222-810919586ae4\") " pod="openshift-must-gather-ks4vm/perf-node-gather-daemonset-6mth6"
Jul 05 13:58:39.847611 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:39.847587    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5f244fe6-0ccd-4444-a222-810919586ae4-sys\") pod \"perf-node-gather-daemonset-6mth6\" (UID: \"5f244fe6-0ccd-4444-a222-810919586ae4\") " pod="openshift-must-gather-ks4vm/perf-node-gather-daemonset-6mth6"
Jul 05 13:58:39.847715 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:39.847644    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2klp2\" (UniqueName: \"kubernetes.io/projected/5f244fe6-0ccd-4444-a222-810919586ae4-kube-api-access-2klp2\") pod \"perf-node-gather-daemonset-6mth6\" (UID: \"5f244fe6-0ccd-4444-a222-810919586ae4\") " pod="openshift-must-gather-ks4vm/perf-node-gather-daemonset-6mth6"
Jul 05 13:58:39.948325 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:39.948301    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2klp2\" (UniqueName: \"kubernetes.io/projected/5f244fe6-0ccd-4444-a222-810919586ae4-kube-api-access-2klp2\") pod \"perf-node-gather-daemonset-6mth6\" (UID: \"5f244fe6-0ccd-4444-a222-810919586ae4\") " pod="openshift-must-gather-ks4vm/perf-node-gather-daemonset-6mth6"
Jul 05 13:58:39.948454 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:39.948362    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5f244fe6-0ccd-4444-a222-810919586ae4-proc\") pod \"perf-node-gather-daemonset-6mth6\" (UID: \"5f244fe6-0ccd-4444-a222-810919586ae4\") " pod="openshift-must-gather-ks4vm/perf-node-gather-daemonset-6mth6"
Jul 05 13:58:39.948454 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:39.948395    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5f244fe6-0ccd-4444-a222-810919586ae4-lib-modules\") pod \"perf-node-gather-daemonset-6mth6\" (UID: \"5f244fe6-0ccd-4444-a222-810919586ae4\") " pod="openshift-must-gather-ks4vm/perf-node-gather-daemonset-6mth6"
Jul 05 13:58:39.948454 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:39.948426    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5f244fe6-0ccd-4444-a222-810919586ae4-podres\") pod \"perf-node-gather-daemonset-6mth6\" (UID: \"5f244fe6-0ccd-4444-a222-810919586ae4\") " pod="openshift-must-gather-ks4vm/perf-node-gather-daemonset-6mth6"
Jul 05 13:58:39.948603 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:39.948454    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5f244fe6-0ccd-4444-a222-810919586ae4-sys\") pod \"perf-node-gather-daemonset-6mth6\" (UID: \"5f244fe6-0ccd-4444-a222-810919586ae4\") " pod="openshift-must-gather-ks4vm/perf-node-gather-daemonset-6mth6"
Jul 05 13:58:39.948603 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:39.948493    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5f244fe6-0ccd-4444-a222-810919586ae4-proc\") pod \"perf-node-gather-daemonset-6mth6\" (UID: \"5f244fe6-0ccd-4444-a222-810919586ae4\") " pod="openshift-must-gather-ks4vm/perf-node-gather-daemonset-6mth6"
Jul 05 13:58:39.948603 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:39.948525    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5f244fe6-0ccd-4444-a222-810919586ae4-sys\") pod \"perf-node-gather-daemonset-6mth6\" (UID: \"5f244fe6-0ccd-4444-a222-810919586ae4\") " pod="openshift-must-gather-ks4vm/perf-node-gather-daemonset-6mth6"
Jul 05 13:58:39.948603 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:39.948570    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5f244fe6-0ccd-4444-a222-810919586ae4-podres\") pod \"perf-node-gather-daemonset-6mth6\" (UID: \"5f244fe6-0ccd-4444-a222-810919586ae4\") " pod="openshift-must-gather-ks4vm/perf-node-gather-daemonset-6mth6"
Jul 05 13:58:39.948603 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:39.948569    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5f244fe6-0ccd-4444-a222-810919586ae4-lib-modules\") pod \"perf-node-gather-daemonset-6mth6\" (UID: \"5f244fe6-0ccd-4444-a222-810919586ae4\") " pod="openshift-must-gather-ks4vm/perf-node-gather-daemonset-6mth6"
Jul 05 13:58:39.956929 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:39.956902    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2klp2\" (UniqueName: \"kubernetes.io/projected/5f244fe6-0ccd-4444-a222-810919586ae4-kube-api-access-2klp2\") pod \"perf-node-gather-daemonset-6mth6\" (UID: \"5f244fe6-0ccd-4444-a222-810919586ae4\") " pod="openshift-must-gather-ks4vm/perf-node-gather-daemonset-6mth6"
Jul 05 13:58:40.129202 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:40.129150    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ks4vm/perf-node-gather-daemonset-6mth6"
Jul 05 13:58:40.258294 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:40.258233    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ks4vm/perf-node-gather-daemonset-6mth6"]
Jul 05 13:58:40.260627 ip-10-0-129-239 kubenswrapper[2563]: W0705 13:58:40.260592    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5f244fe6_0ccd_4444_a222_810919586ae4.slice/crio-6cce5da56270ce082a66a1ba25e1acfd4d478289b9b9f0a4c35e25d2001b6048 WatchSource:0}: Error finding container 6cce5da56270ce082a66a1ba25e1acfd4d478289b9b9f0a4c35e25d2001b6048: Status 404 returned error can't find the container with id 6cce5da56270ce082a66a1ba25e1acfd4d478289b9b9f0a4c35e25d2001b6048
Jul 05 13:58:40.313015 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:40.312991    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ks4vm/perf-node-gather-daemonset-6mth6" event={"ID":"5f244fe6-0ccd-4444-a222-810919586ae4","Type":"ContainerStarted","Data":"6cce5da56270ce082a66a1ba25e1acfd4d478289b9b9f0a4c35e25d2001b6048"}
Jul 05 13:58:41.005098 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:41.005074    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-rn6hc_370ad4f7-5e60-49b7-a245-d61dcf41c590/download-server/0.log"
Jul 05 13:58:41.319153 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:41.319127    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ks4vm/perf-node-gather-daemonset-6mth6" event={"ID":"5f244fe6-0ccd-4444-a222-810919586ae4","Type":"ContainerStarted","Data":"a5754934007a64cdcafd9aa1b2486725d514970fc08bc873d5d144dbd968fff9"}
Jul 05 13:58:41.319318 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:41.319253    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-ks4vm/perf-node-gather-daemonset-6mth6"
Jul 05 13:58:41.335183 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:41.335143    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-ks4vm/perf-node-gather-daemonset-6mth6" podStartSLOduration=2.335126917 podStartE2EDuration="2.335126917s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 13:58:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:58:41.333562336 +0000 UTC m=+2601.427447964" watchObservedRunningTime="2026-07-05 13:58:41.335126917 +0000 UTC m=+2601.429012553"
Jul 05 13:58:42.658062 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:42.657989    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hdt6g_d3f908ac-37a8-4df4-a945-2795c28b7898/dns/0.log"
Jul 05 13:58:42.678940 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:42.678916    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hdt6g_d3f908ac-37a8-4df4-a945-2795c28b7898/kube-rbac-proxy/0.log"
Jul 05 13:58:42.795520 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:42.795494    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vsz6t_6b7e0654-df3e-4f31-9fee-402ee841d4ac/dns-node-resolver/0.log"
Jul 05 13:58:43.442010 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:43.441984    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-s9x2h_3d69842e-9902-40bc-a7f6-0a018acc73db/node-ca/0.log"
Jul 05 13:58:44.471232 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:44.471201    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-9vcsg_897d1326-9bac-467f-bacd-6c9ac0f4a87c/discovery/0.log"
Jul 05 13:58:44.513498 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:44.513476    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7bcdf4856b-4fv6n_c180d7f0-78ef-4c2a-b62f-dcfc0af24c71/kube-auth-proxy/0.log"
Jul 05 13:58:44.705204 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:44.705176    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-qmn7b_24907e05-7aa3-4332-9864-b42cadef9d2c/payload-processing/0.log"
Jul 05 13:58:45.421380 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:45.421353    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ds4dn_66bdf923-2681-4cef-b776-988f3c4d4a5c/serve-healthcheck-canary/0.log"
Jul 05 13:58:45.958982 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:45.958955    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9lcx7_23d8f7e1-77de-4373-aef3-cc81d8e823ea/kube-rbac-proxy/0.log"
Jul 05 13:58:45.982114 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:45.982092    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9lcx7_23d8f7e1-77de-4373-aef3-cc81d8e823ea/exporter/0.log"
Jul 05 13:58:46.005308 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:46.005286    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9lcx7_23d8f7e1-77de-4373-aef3-cc81d8e823ea/extractor/0.log"
Jul 05 13:58:47.334007 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:47.333982    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-ks4vm/perf-node-gather-daemonset-6mth6"
Jul 05 13:58:48.887796 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:48.887761    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29720985-9bqwh_7b1b9642-6fb5-4202-b663-80ae56193724/cleanup/0.log"
Jul 05 13:58:48.985918 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:48.985892    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6845d5b85-28n7p_eba9a444-a74b-4b7b-88c2-aefcd3d5661b/manager/0.log"
Jul 05 13:58:49.005555 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:49.005534    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-qlqcv_f0d5a21c-1cf9-4102-b1f4-9b43e2e0842e/server/0.log"
Jul 05 13:58:49.067180 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:49.067155    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-mlntb_b91847d8-1eb2-49b6-bf0a-fe5da4089de9/manager/0.log"
Jul 05 13:58:49.274234 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:49.274196    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6674ff8b4f-vkw8n_8630b1ac-6708-46b1-b8b5-27fbcff48712/manager/0.log"
Jul 05 13:58:49.298557 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:49.298533    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6674ff8b4f-vkw8n_8630b1ac-6708-46b1-b8b5-27fbcff48712/copy-manifests/0.log"
Jul 05 13:58:49.327149 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:49.327124    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-dtd5f_e7cc7d59-c515-47c7-8eab-bb92468c73c8/postgres/0.log"
Jul 05 13:58:50.458018 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:50.457983    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-9vcsg_897d1326-9bac-467f-bacd-6c9ac0f4a87c/discovery/0.log"
Jul 05 13:58:50.481310 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:50.481287    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7bcdf4856b-4fv6n_c180d7f0-78ef-4c2a-b62f-dcfc0af24c71/kube-auth-proxy/0.log"
Jul 05 13:58:50.640657 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:50.640632    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-qmn7b_24907e05-7aa3-4332-9864-b42cadef9d2c/payload-processing/0.log"
Jul 05 13:58:50.673436 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:50.673406    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-krp2d_a55a040f-959c-498d-afb2-ae054215d9da/openshift-lws-operator/0.log"
Jul 05 13:58:52.138430 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:52.138402    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-9vcsg_897d1326-9bac-467f-bacd-6c9ac0f4a87c/discovery/0.log"
Jul 05 13:58:52.150435 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:52.150408    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7bcdf4856b-4fv6n_c180d7f0-78ef-4c2a-b62f-dcfc0af24c71/kube-auth-proxy/0.log"
Jul 05 13:58:52.297886 ip-10-0-129-239 kubenswrapper[2563]: I0705 13:58:52.297859    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-qmn7b_24907e05-7aa3-4332-9864-b42cadef9d2c/payload-processing/0.log"