Jul 06 12:47:03.002117 ip-10-0-129-126 systemd[1]: Starting Kubernetes Kubelet...
Jul 06 12:47:03.744949 ip-10-0-129-126 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 12:47:03.744949 ip-10-0-129-126 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 06 12:47:03.744949 ip-10-0-129-126 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 12:47:03.744949 ip-10-0-129-126 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 06 12:47:03.744949 ip-10-0-129-126 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 12:47:03.744949 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.459931    2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 06 12:47:03.744949 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467297    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 12:47:03.744949 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467307    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 12:47:03.744949 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467311    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 12:47:03.744949 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467315    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 12:47:03.744949 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467318    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 12:47:03.744949 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467321    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 12:47:03.744949 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467323    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 12:47:03.744949 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467326    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 12:47:03.758370 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467329    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 12:47:03.758370 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467336    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 12:47:03.758370 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467339    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 12:47:03.758370 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467341    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 12:47:03.758370 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467343    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 12:47:03.758370 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467346    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 12:47:03.758370 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467349    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 12:47:03.758370 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467351    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 12:47:03.758370 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467354    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 12:47:03.758370 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467356    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 12:47:03.758370 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467359    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 12:47:03.758370 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467363    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 12:47:03.758370 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467366    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 12:47:03.758370 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467370    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 12:47:03.758370 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467372    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 12:47:03.758370 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467375    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 12:47:03.758370 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467378    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 12:47:03.758370 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467381    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 12:47:03.758370 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467384    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 12:47:03.758370 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467387    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 12:47:03.538342 ip-10-0-129-126 systemd[1]: Started Kubernetes Kubelet.
Jul 06 12:47:03.759635 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467390    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 12:47:03.759635 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467392    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 12:47:03.759635 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467395    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 12:47:03.759635 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467398    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 12:47:03.759635 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467402    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 12:47:03.759635 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467405    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 12:47:03.759635 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467408    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 12:47:03.759635 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467411    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 12:47:03.759635 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467413    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 12:47:03.759635 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467416    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 12:47:03.759635 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467419    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 12:47:03.759635 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467422    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 12:47:03.759635 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467425    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 12:47:03.759635 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467427    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 12:47:03.759635 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467429    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 12:47:03.759635 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467432    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 12:47:03.759635 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467434    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 12:47:03.759635 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467436    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 12:47:03.759635 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467439    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 12:47:03.761359 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467442    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 12:47:03.761359 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467444    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 12:47:03.761359 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467448    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 12:47:03.761359 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467451    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 12:47:03.761359 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467453    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 12:47:03.761359 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467455    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 12:47:03.761359 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467458    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 12:47:03.761359 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467460    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 12:47:03.761359 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467464    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 12:47:03.761359 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467467    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 12:47:03.761359 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467469    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 12:47:03.761359 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467472    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 12:47:03.761359 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467474    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 12:47:03.761359 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467477    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 12:47:03.761359 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467480    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 12:47:03.761359 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467483    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 12:47:03.761359 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467486    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 12:47:03.761359 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467488    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 12:47:03.761359 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467491    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 12:47:03.761359 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467493    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 12:47:03.763772 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467496    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 12:47:03.763772 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467499    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 12:47:03.763772 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467501    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 12:47:03.763772 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467504    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 12:47:03.763772 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467508    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 12:47:03.763772 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467510    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 12:47:03.763772 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467513    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 12:47:03.763772 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467515    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 12:47:03.763772 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467518    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 12:47:03.763772 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467520    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 12:47:03.763772 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467523    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 12:47:03.763772 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467525    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 12:47:03.763772 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467528    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 12:47:03.763772 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467531    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 12:47:03.763772 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467534    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 12:47:03.763772 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467536    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 12:47:03.763772 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467538    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 12:47:03.763772 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467541    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 12:47:03.763772 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467543    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 12:47:03.763772 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467547    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 12:47:03.765559 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467549    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 12:47:03.765559 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467552    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 12:47:03.765559 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467556    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 12:47:03.765559 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467559    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 12:47:03.765559 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467562    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 12:47:03.765559 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467564    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 12:47:03.765559 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467567    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 12:47:03.765559 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467570    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 12:47:03.765559 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467572    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 12:47:03.765559 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467574    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 12:47:03.765559 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467577    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 12:47:03.765559 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.467579    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 12:47:03.765559 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468273    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 12:47:03.765559 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468279    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 12:47:03.765559 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468282    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 12:47:03.765559 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468285    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 12:47:03.765559 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468287    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 12:47:03.765559 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468290    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 12:47:03.765559 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468293    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 12:47:03.765559 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468296    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 12:47:03.768110 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468299    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 12:47:03.768110 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468301    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 12:47:03.768110 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468304    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 12:47:03.768110 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468306    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 12:47:03.768110 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468309    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 12:47:03.768110 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468311    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 12:47:03.768110 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468314    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 12:47:03.768110 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468316    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 12:47:03.768110 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468319    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 12:47:03.768110 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468321    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 12:47:03.768110 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468324    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 12:47:03.768110 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468326    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 12:47:03.768110 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468329    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 12:47:03.768110 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468332    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 12:47:03.768110 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468334    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 12:47:03.768110 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468337    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 12:47:03.768110 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468339    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 12:47:03.768110 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468342    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 12:47:03.768110 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468344    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 12:47:03.769965 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468346    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 12:47:03.769965 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468349    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 12:47:03.769965 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468351    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 12:47:03.769965 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468354    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 12:47:03.769965 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468357    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 12:47:03.769965 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468359    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 12:47:03.769965 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468362    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 12:47:03.769965 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468365    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 12:47:03.769965 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468367    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 12:47:03.769965 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468370    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 12:47:03.769965 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468372    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 12:47:03.769965 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468375    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 12:47:03.769965 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468378    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 12:47:03.769965 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468380    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 12:47:03.769965 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468383    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 12:47:03.769965 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468386    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 12:47:03.769965 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468388    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 12:47:03.769965 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468390    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 12:47:03.769965 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468393    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 12:47:03.769965 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468395    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 12:47:03.771906 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468399    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 12:47:03.771906 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468402    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 12:47:03.771906 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468405    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 12:47:03.771906 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468407    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 12:47:03.771906 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468410    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 12:47:03.771906 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468412    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 12:47:03.771906 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468415    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 12:47:03.771906 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468417    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 12:47:03.771906 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468421    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 12:47:03.771906 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468425    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 12:47:03.771906 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468429    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 12:47:03.771906 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468432    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 12:47:03.771906 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468435    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 12:47:03.771906 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468438    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 12:47:03.771906 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468441    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 12:47:03.771906 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468445    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 12:47:03.771906 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468447    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 12:47:03.771906 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468450    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 12:47:03.771906 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468453    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 12:47:03.771906 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468456    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 12:47:03.772532 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468460    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 12:47:03.772532 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468464    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 12:47:03.772532 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468467    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 12:47:03.772532 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468470    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 12:47:03.772532 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468473    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 12:47:03.772532 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468476    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 12:47:03.772532 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468478    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 12:47:03.772532 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468480    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 12:47:03.772532 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468483    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 12:47:03.772532 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468486    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 12:47:03.772532 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468488    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 12:47:03.772532 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468491    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 12:47:03.772532 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468493    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 12:47:03.772532 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468495    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 12:47:03.772532 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468498    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 12:47:03.772532 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468501    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 12:47:03.772532 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468503    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 12:47:03.772532 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468506    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 12:47:03.772532 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468509    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 12:47:03.774209 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468511    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 12:47:03.774209 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468514    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 12:47:03.774209 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468517    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 12:47:03.774209 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468519    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 12:47:03.774209 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468522    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 12:47:03.774209 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468524    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 12:47:03.774209 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468527    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 12:47:03.774209 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468529    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 12:47:03.774209 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468532    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 12:47:03.774209 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468534    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 12:47:03.774209 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468537    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 12:47:03.774209 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468539    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 12:47:03.774209 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468541    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 12:47:03.774209 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468906    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 12:47:03.774209 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468912    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 12:47:03.774209 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468914    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 12:47:03.774209 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468917    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 12:47:03.774209 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468920    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 12:47:03.774209 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468923    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 12:47:03.774209 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468926    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 12:47:03.775430 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468929    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 12:47:03.775430 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468931    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 12:47:03.775430 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468934    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 12:47:03.775430 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468937    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 12:47:03.775430 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468940    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 12:47:03.775430 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468942    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 12:47:03.775430 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468945    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 12:47:03.775430 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468948    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 12:47:03.775430 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468950    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 12:47:03.775430 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468953    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 12:47:03.775430 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468955    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 12:47:03.775430 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468958    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 12:47:03.775430 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468960    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 12:47:03.775430 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468968    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 12:47:03.775430 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468970    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 12:47:03.775430 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468973    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 12:47:03.775430 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468976    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 12:47:03.775430 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468978    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 12:47:03.775430 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468981    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 12:47:03.775430 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468983    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 12:47:03.776126 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468986    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 12:47:03.776126 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468988    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 12:47:03.776126 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468990    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 12:47:03.776126 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468994    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 12:47:03.776126 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.468997    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 12:47:03.776126 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469000    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 12:47:03.776126 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469004    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 12:47:03.776126 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469006    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 12:47:03.776126 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469010    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 12:47:03.776126 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469014    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 12:47:03.776126 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469017    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 12:47:03.776126 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469019    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 12:47:03.776126 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469022    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 12:47:03.776126 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469024    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 12:47:03.776126 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469027    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 12:47:03.776126 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469029    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 12:47:03.776126 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469032    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 12:47:03.776126 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469034    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 12:47:03.776126 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469036    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 12:47:03.776126 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469039    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 12:47:03.776796 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469042    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 12:47:03.776796 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469044    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 12:47:03.776796 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469046    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 12:47:03.776796 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469049    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 12:47:03.776796 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469051    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 12:47:03.776796 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469055    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 12:47:03.776796 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469058    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 12:47:03.776796 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469061    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 12:47:03.776796 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469063    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 12:47:03.776796 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469065    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 12:47:03.776796 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469068    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 12:47:03.776796 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469070    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 12:47:03.776796 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469072    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 12:47:03.776796 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469077    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 12:47:03.776796 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469080    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 12:47:03.776796 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469083    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 12:47:03.776796 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469085    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 12:47:03.776796 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469088    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 12:47:03.776796 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469093    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 12:47:03.777630 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469095    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 12:47:03.777630 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469098    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 12:47:03.777630 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469101    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 12:47:03.777630 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469103    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 12:47:03.777630 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469106    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 12:47:03.777630 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469109    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 12:47:03.777630 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469111    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 12:47:03.777630 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469114    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 12:47:03.777630 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469116    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 12:47:03.777630 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469118    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 12:47:03.777630 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469121    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 12:47:03.777630 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469124    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 12:47:03.777630 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469126    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 12:47:03.777630 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469129    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 12:47:03.777630 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469131    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 12:47:03.777630 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469135    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 12:47:03.777630 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469137    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 12:47:03.777630 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469140    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 12:47:03.777630 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469143    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 12:47:03.777630 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469146    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 12:47:03.778617 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469148    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 12:47:03.778617 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469151    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 12:47:03.778617 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469153    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 12:47:03.778617 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469155    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 12:47:03.778617 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469158    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 12:47:03.778617 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469160    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 12:47:03.778617 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469163    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 12:47:03.778617 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469165    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 12:47:03.778617 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469168    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 12:47:03.778617 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469170    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 12:47:03.778617 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469172    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 12:47:03.778617 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469176    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 12:47:03.778617 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469178    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 12:47:03.778617 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469254    2579 flags.go:64] FLAG: --address="0.0.0.0"
Jul 06 12:47:03.778617 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469264    2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 06 12:47:03.778617 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469272    2579 flags.go:64] FLAG: --anonymous-auth="true"
Jul 06 12:47:03.778617 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469279    2579 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 06 12:47:03.778617 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469285    2579 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 06 12:47:03.778617 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469290    2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 06 12:47:03.778617 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469294    2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 06 12:47:03.778617 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469298    2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 06 12:47:03.779421 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469301    2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 06 12:47:03.779421 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469304    2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 06 12:47:03.779421 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469307    2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 06 12:47:03.779421 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469310    2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 06 12:47:03.779421 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469313    2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 06 12:47:03.779421 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469316    2579 flags.go:64] FLAG: --cgroup-root=""
Jul 06 12:47:03.779421 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469319    2579 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 06 12:47:03.779421 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469321    2579 flags.go:64] FLAG: --client-ca-file=""
Jul 06 12:47:03.779421 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469324    2579 flags.go:64] FLAG: --cloud-provider="external"
Jul 06 12:47:03.779421 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469329    2579 flags.go:64] FLAG: --cluster-dns="[]"
Jul 06 12:47:03.779421 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469333    2579 flags.go:64] FLAG: --cluster-domain=""
Jul 06 12:47:03.779421 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469336    2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 06 12:47:03.779421 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469339    2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 06 12:47:03.779421 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469342    2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 06 12:47:03.779421 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469345    2579 flags.go:64] FLAG: --container-log-max-files="5"
Jul 06 12:47:03.779421 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469349    2579 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 06 12:47:03.779421 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469351    2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 06 12:47:03.779421 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469354    2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 06 12:47:03.779421 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469357    2579 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 06 12:47:03.779421 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469360    2579 flags.go:64] FLAG: --contention-profiling="false"
Jul 06 12:47:03.779421 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469363    2579 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 06 12:47:03.779421 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469366    2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 06 12:47:03.779421 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469371    2579 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 06 12:47:03.779421 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469374    2579 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 06 12:47:03.780222 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469378    2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 06 12:47:03.780222 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469381    2579 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 06 12:47:03.780222 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469385    2579 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 06 12:47:03.780222 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469387    2579 flags.go:64] FLAG: --enable-load-reader="false"
Jul 06 12:47:03.780222 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469390    2579 flags.go:64] FLAG: --enable-server="true"
Jul 06 12:47:03.780222 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469393    2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 06 12:47:03.780222 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469397    2579 flags.go:64] FLAG: --event-burst="100"
Jul 06 12:47:03.780222 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469400    2579 flags.go:64] FLAG: --event-qps="50"
Jul 06 12:47:03.780222 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469403    2579 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 06 12:47:03.780222 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469406    2579 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 06 12:47:03.780222 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469408    2579 flags.go:64] FLAG: --eviction-hard=""
Jul 06 12:47:03.780222 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469412    2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 06 12:47:03.780222 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469414    2579 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 06 12:47:03.780222 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469417    2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 06 12:47:03.780222 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469420    2579 flags.go:64] FLAG: --eviction-soft=""
Jul 06 12:47:03.780222 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469423    2579 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 06 12:47:03.780222 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469425    2579 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 06 12:47:03.780222 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469429    2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 06 12:47:03.780222 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469432    2579 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 06 12:47:03.780222 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469435    2579 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 06 12:47:03.780222 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469437    2579 flags.go:64] FLAG: --fail-swap-on="true"
Jul 06 12:47:03.780222 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469440    2579 flags.go:64] FLAG: --feature-gates=""
Jul 06 12:47:03.780222 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469444    2579 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 06 12:47:03.780222 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469447    2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 06 12:47:03.780222 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469450    2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 06 12:47:03.781049 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469453    2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 06 12:47:03.781049 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469456    2579 flags.go:64] FLAG: --healthz-port="10248"
Jul 06 12:47:03.781049 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469459    2579 flags.go:64] FLAG: --help="false"
Jul 06 12:47:03.781049 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469462    2579 flags.go:64] FLAG: --hostname-override="ip-10-0-129-126.ec2.internal"
Jul 06 12:47:03.781049 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469465    2579 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 06 12:47:03.781049 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469469    2579 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 06 12:47:03.781049 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469472    2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 06 12:47:03.781049 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469475    2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 06 12:47:03.781049 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469478    2579 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 06 12:47:03.781049 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469481    2579 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 06 12:47:03.781049 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469484    2579 flags.go:64] FLAG: --image-service-endpoint=""
Jul 06 12:47:03.781049 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469487    2579 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 06 12:47:03.781049 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469489    2579 flags.go:64] FLAG: --kube-api-burst="100"
Jul 06 12:47:03.781049 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469493    2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 06 12:47:03.781049 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469496    2579 flags.go:64] FLAG: --kube-api-qps="50"
Jul 06 12:47:03.781049 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469499    2579 flags.go:64] FLAG: --kube-reserved=""
Jul 06 12:47:03.781049 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469502    2579 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 06 12:47:03.781049 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469505    2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 06 12:47:03.781049 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469507    2579 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 06 12:47:03.781049 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469510    2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 06 12:47:03.781049 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469513    2579 flags.go:64] FLAG: --lock-file=""
Jul 06 12:47:03.781049 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469515    2579 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 06 12:47:03.781049 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469518    2579 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 06 12:47:03.781049 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469521    2579 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 06 12:47:03.782077 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469527    2579 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 06 12:47:03.782077 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469530    2579 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 06 12:47:03.782077 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469533    2579 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 06 12:47:03.782077 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469536    2579 flags.go:64] FLAG: --logging-format="text"
Jul 06 12:47:03.782077 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469538    2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 06 12:47:03.782077 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469541    2579 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 06 12:47:03.782077 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469544    2579 flags.go:64] FLAG: --manifest-url=""
Jul 06 12:47:03.782077 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469547    2579 flags.go:64] FLAG: --manifest-url-header=""
Jul 06 12:47:03.782077 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469551    2579 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 06 12:47:03.782077 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469553    2579 flags.go:64] FLAG: --max-open-files="1000000"
Jul 06 12:47:03.782077 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469557    2579 flags.go:64] FLAG: --max-pods="110"
Jul 06 12:47:03.782077 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469560    2579 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 06 12:47:03.782077 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469563    2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 06 12:47:03.782077 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469567    2579 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 06 12:47:03.782077 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469570    2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 06 12:47:03.782077 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469572    2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 06 12:47:03.782077 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469575    2579 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 06 12:47:03.782077 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469578    2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 06 12:47:03.782077 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469585    2579 flags.go:64] FLAG: --node-status-max-images="50"
Jul 06 12:47:03.782077 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469588    2579 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 06 12:47:03.782077 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469591    2579 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 06 12:47:03.782077 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469594    2579 flags.go:64] FLAG: --pod-cidr=""
Jul 06 12:47:03.782077 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469597    2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 06 12:47:03.783004 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469602    2579 flags.go:64] FLAG: --pod-manifest-path=""
Jul 06 12:47:03.783004 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469605    2579 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 06 12:47:03.783004 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469608    2579 flags.go:64] FLAG: --pods-per-core="0"
Jul 06 12:47:03.783004 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469611    2579 flags.go:64] FLAG: --port="10250"
Jul 06 12:47:03.783004 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469614    2579 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 06 12:47:03.783004 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469617    2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0324664bae6dda581"
Jul 06 12:47:03.783004 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469620    2579 flags.go:64] FLAG: --qos-reserved=""
Jul 06 12:47:03.783004 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469623    2579 flags.go:64] FLAG: --read-only-port="10255"
Jul 06 12:47:03.783004 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469626    2579 flags.go:64] FLAG: --register-node="true"
Jul 06 12:47:03.783004 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469630    2579 flags.go:64] FLAG: --register-with-taints=""
Jul 06 12:47:03.783004 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469633    2579 flags.go:64] FLAG: --registry-burst="10"
Jul 06 12:47:03.783004 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469636    2579 flags.go:64] FLAG: --registry-qps="5"
Jul 06 12:47:03.783004 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469638    2579 flags.go:64] FLAG: --reserved-cpus=""
Jul 06 12:47:03.783004 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469641    2579 flags.go:64] FLAG: --reserved-memory=""
Jul 06 12:47:03.783004 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469645    2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 06 12:47:03.783004 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469648    2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 06 12:47:03.783004 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469650    2579 flags.go:64] FLAG: --rotate-certificates="false"
Jul 06 12:47:03.783004 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469653    2579 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 06 12:47:03.783004 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469656    2579 flags.go:64] FLAG: --runonce="false"
Jul 06 12:47:03.783004 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469659    2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 06 12:47:03.783004 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469661    2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 06 12:47:03.783004 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469664    2579 flags.go:64] FLAG: --seccomp-default="false"
Jul 06 12:47:03.783004 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469667    2579 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 06 12:47:03.783004 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469671    2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 06 12:47:03.783004 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469674    2579 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 06 12:47:03.783004 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469677    2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 06 12:47:03.783793 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469680    2579 flags.go:64] FLAG: --storage-driver-password="root"
Jul 06 12:47:03.783793 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469683    2579 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 06 12:47:03.783793 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469685    2579 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 06 12:47:03.783793 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469688    2579 flags.go:64] FLAG: --storage-driver-user="root"
Jul 06 12:47:03.783793 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469691    2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 06 12:47:03.783793 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469694    2579 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 06 12:47:03.783793 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469697    2579 flags.go:64] FLAG: --system-cgroups=""
Jul 06 12:47:03.783793 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469699    2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 06 12:47:03.783793 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469704    2579 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 06 12:47:03.783793 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469707    2579 flags.go:64] FLAG: --tls-cert-file=""
Jul 06 12:47:03.783793 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469710    2579 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 06 12:47:03.783793 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469713    2579 flags.go:64] FLAG: --tls-min-version=""
Jul 06 12:47:03.783793 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469716    2579 flags.go:64] FLAG: --tls-private-key-file=""
Jul 06 12:47:03.783793 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469719    2579 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 06 12:47:03.783793 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469722    2579 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 06 12:47:03.783793 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469726    2579 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 06 12:47:03.783793 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469729    2579 flags.go:64] FLAG: --v="2"
Jul 06 12:47:03.783793 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469733    2579 flags.go:64] FLAG: --version="false"
Jul 06 12:47:03.783793 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469737    2579 flags.go:64] FLAG: --vmodule=""
Jul 06 12:47:03.783793 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469740    2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 06 12:47:03.783793 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.469743    2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 06 12:47:03.783793 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469884    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 12:47:03.783793 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469888    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 12:47:03.783793 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469891    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 12:47:03.911583 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469895    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 12:47:03.911583 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469897    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 12:47:03.911583 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469900    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 12:47:03.911583 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469903    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 12:47:03.911583 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469907    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 12:47:03.911583 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469912    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 12:47:03.911583 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469915    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 12:47:03.911583 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469918    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 12:47:03.911583 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469920    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 12:47:03.911583 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469923    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 12:47:03.911583 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469927    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 12:47:03.911583 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469930    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 12:47:03.911583 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469932    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 12:47:03.911583 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469935    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 12:47:03.911583 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469937    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 12:47:03.911583 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469941    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 12:47:03.911583 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469943    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 12:47:03.911583 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469946    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 12:47:03.911583 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469949    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 12:47:03.912377 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469952    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 12:47:03.912377 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469955    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 12:47:03.912377 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469957    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 12:47:03.912377 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469960    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 12:47:03.912377 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469964    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 12:47:03.912377 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469967    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 12:47:03.912377 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469969    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 12:47:03.912377 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469972    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 12:47:03.912377 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469974    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 12:47:03.912377 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469977    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 12:47:03.912377 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469979    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 12:47:03.912377 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469981    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 12:47:03.912377 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469984    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 12:47:03.912377 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469986    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 12:47:03.912377 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469989    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 12:47:03.912377 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469991    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 12:47:03.912377 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469994    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 12:47:03.912377 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.469996    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 12:47:03.912377 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.470000    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 12:47:03.912987 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.470002    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 12:47:03.912987 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.470005    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 12:47:03.912987 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.470007    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 12:47:03.912987 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.470010    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 12:47:03.912987 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.470013    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 12:47:03.912987 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.470015    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 12:47:03.912987 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.470018    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 12:47:03.912987 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.470021    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 12:47:03.912987 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.470024    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 12:47:03.912987 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.470028    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 12:47:03.912987 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.470031    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 12:47:03.912987 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.470033    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 12:47:03.912987 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.470036    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 12:47:03.912987 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.470039    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 12:47:03.912987 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.470042    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 12:47:03.912987 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.470044    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 12:47:03.912987 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.470047    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 12:47:03.912987 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.470051    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 12:47:03.912987 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.470054    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 12:47:03.912987 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.470057    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 12:47:03.913541 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.470060    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 12:47:03.913541 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.470062    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 12:47:03.913541 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.470065    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 12:47:03.913541 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.470067    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 12:47:03.913541 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.470069    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 12:47:03.913541 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.470072    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 12:47:03.913541 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.470075    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 12:47:03.913541 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.470077    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 12:47:03.913541 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.470080    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 12:47:03.913541 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.470082    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 12:47:03.913541 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.470085    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 12:47:03.913541 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.470089    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 12:47:03.913541 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.470091    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 12:47:03.913541 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.470094    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 12:47:03.913541 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.470096    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 12:47:03.913541 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.470099    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 12:47:03.913541 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.470101    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 12:47:03.913541 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.470104    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 12:47:03.913541 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.470107    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 12:47:03.913541 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.470109    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 12:47:03.914080 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.470112    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 12:47:03.914080 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.470114    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 12:47:03.914080 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.470117    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 12:47:03.914080 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.470121    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 12:47:03.914080 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.470124    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 12:47:03.914080 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.470127    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 12:47:03.914080 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.470129    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 12:47:03.914080 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.470132    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 12:47:03.914080 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.470134    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 12:47:03.914080 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.470138    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 12:47:03.914080 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.470140    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 12:47:03.914080 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.470143    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 12:47:03.914080 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.470145    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 12:47:03.914080 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.470147    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 12:47:03.914080 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.470150    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 12:47:03.914080 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.470152    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 12:47:03.914080 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.470154    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 12:47:03.914080 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.470157    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 12:47:03.914584 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.471019    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 12:47:03.914584 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.478545    2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 06 12:47:03.914584 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.478559    2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 06 12:47:03.914584 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.478576    2579 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 06 12:47:03.914584 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.478582    2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 06 12:47:03.914584 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478659    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 12:47:03.914584 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478664    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 12:47:03.914584 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478667    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 12:47:03.914584 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478671    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 12:47:03.914584 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478673    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 12:47:03.914584 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478677    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 12:47:03.914584 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478679    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 12:47:03.914584 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478682    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 12:47:03.914584 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478685    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 12:47:03.914584 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478687    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 12:47:03.915012 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478690    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 12:47:03.915012 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478693    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 12:47:03.915012 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478695    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 12:47:03.915012 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478698    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 12:47:03.915012 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478700    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 12:47:03.915012 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478703    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 12:47:03.915012 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478705    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 12:47:03.915012 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478708    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 12:47:03.915012 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478710    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 12:47:03.915012 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478712    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 12:47:03.915012 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478715    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 12:47:03.915012 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478717    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 12:47:03.915012 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478720    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 12:47:03.915012 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478723    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 12:47:03.915012 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478725    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 12:47:03.915012 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478728    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 12:47:03.915012 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478730    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 12:47:03.915012 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478733    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 12:47:03.915012 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478737    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 12:47:03.915012 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478745    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 12:47:03.915598 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478748    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 12:47:03.915598 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478751    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 12:47:03.915598 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478753    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 12:47:03.915598 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478758    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 12:47:03.915598 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478761    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 12:47:03.915598 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478764    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 12:47:03.915598 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478768    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 12:47:03.915598 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478771    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 12:47:03.915598 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478773    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 12:47:03.915598 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478776    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 12:47:03.915598 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478779    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 12:47:03.915598 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478781    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 12:47:03.915598 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478784    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 12:47:03.915598 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478787    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 12:47:03.915598 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478789    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 12:47:03.915598 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478792    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 12:47:03.915598 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478794    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 12:47:03.915598 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478797    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 12:47:03.915598 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478800    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 12:47:03.915598 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478803    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 12:47:03.916133 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478807    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 12:47:03.916133 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478810    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 12:47:03.916133 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478813    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 12:47:03.916133 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478817    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 12:47:03.916133 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478820    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 12:47:03.916133 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478822    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 12:47:03.916133 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478825    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 12:47:03.916133 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478827    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 12:47:03.916133 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478830    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 12:47:03.916133 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478832    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 12:47:03.916133 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478835    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 12:47:03.916133 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478838    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 12:47:03.916133 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478867    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 12:47:03.916133 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478870    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 12:47:03.916133 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478873    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 12:47:03.916133 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478876    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 12:47:03.916133 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478880    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 12:47:03.916133 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478889    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 12:47:03.916133 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478892    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 12:47:03.916657 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478894    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 12:47:03.916657 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478897    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 12:47:03.916657 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478899    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 12:47:03.916657 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478902    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 12:47:03.916657 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478905    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 12:47:03.916657 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478907    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 12:47:03.916657 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478910    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 12:47:03.916657 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478912    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 12:47:03.916657 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478915    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 12:47:03.916657 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478917    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 12:47:03.916657 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478920    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 12:47:03.916657 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478922    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 12:47:03.916657 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478925    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 12:47:03.916657 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478928    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 12:47:03.916657 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478931    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 12:47:03.916657 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478935    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 12:47:03.916657 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478939    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 12:47:03.916657 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478942    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 12:47:03.916657 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478945    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 12:47:03.917168 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478948    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 12:47:03.917168 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478951    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 12:47:03.917168 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478954    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 12:47:03.917168 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478956    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 12:47:03.917168 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478959    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 12:47:03.917168 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478962    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 12:47:03.917168 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478964    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 12:47:03.917168 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478972    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 12:47:03.917168 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478975    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 12:47:03.917168 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478978    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 12:47:03.917168 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.478980    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 12:47:03.917168 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.478985    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 12:47:03.917168 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479130    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 12:47:03.917168 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479134    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 12:47:03.917168 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479137    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 12:47:03.917596 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479140    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 12:47:03.917596 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479143    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 12:47:03.917596 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479146    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 12:47:03.917596 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479150    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 12:47:03.917596 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479154    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 12:47:03.917596 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479158    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 12:47:03.917596 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479162    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 12:47:03.917596 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479165    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 12:47:03.917596 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479168    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 12:47:03.917596 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479171    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 12:47:03.917596 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479173    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 12:47:03.917596 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479176    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 12:47:03.917596 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479180    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 12:47:03.917596 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479183    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 12:47:03.917596 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479188    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 12:47:03.917596 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479191    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 12:47:03.917596 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479193    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 12:47:03.917596 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479196    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 12:47:03.917596 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479198    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 12:47:03.917596 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479202    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 12:47:03.918174 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479206    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 12:47:03.918174 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479209    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 12:47:03.918174 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479212    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 12:47:03.918174 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479215    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 12:47:03.918174 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479217    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 12:47:03.918174 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479226    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 12:47:03.918174 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479229    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 12:47:03.918174 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479231    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 12:47:03.918174 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479234    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 12:47:03.918174 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479236    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 12:47:03.918174 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479239    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 12:47:03.918174 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479242    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 12:47:03.918174 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479245    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 12:47:03.918174 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479248    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 12:47:03.918174 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479251    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 12:47:03.918174 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479253    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 12:47:03.918174 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479256    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 12:47:03.918174 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479259    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 12:47:03.918174 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479261    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 12:47:03.918695 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479263    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 12:47:03.918695 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479266    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 12:47:03.918695 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479269    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 12:47:03.918695 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479271    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 12:47:03.918695 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479273    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 12:47:03.918695 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479277    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 12:47:03.918695 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479280    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 12:47:03.918695 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479284    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 12:47:03.918695 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479287    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 12:47:03.918695 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479289    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 12:47:03.918695 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479291    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 12:47:03.918695 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479294    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 12:47:03.918695 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479297    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 12:47:03.918695 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479300    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 12:47:03.918695 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479302    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 12:47:03.918695 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479304    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 12:47:03.918695 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479307    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 12:47:03.918695 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479310    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 12:47:03.918695 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479312    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 12:47:03.918695 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479321    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 12:47:03.919265 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479323    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 12:47:03.919265 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479326    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 12:47:03.919265 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479328    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 12:47:03.919265 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479331    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 12:47:03.919265 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479333    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 12:47:03.919265 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479336    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 12:47:03.919265 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479338    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 12:47:03.919265 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479341    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 12:47:03.919265 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479343    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 12:47:03.919265 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479346    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 12:47:03.919265 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479348    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 12:47:03.919265 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479350    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 12:47:03.919265 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479353    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 12:47:03.919265 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479355    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 12:47:03.919265 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479358    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 12:47:03.919265 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479360    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 12:47:03.919265 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479362    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 12:47:03.919265 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479366    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 12:47:03.919265 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479368    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 12:47:03.919265 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479372    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 12:47:03.919814 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479375    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 12:47:03.919814 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479377    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 12:47:03.919814 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479380    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 12:47:03.919814 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479382    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 12:47:03.919814 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479385    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 12:47:03.919814 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479387    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 12:47:03.919814 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479390    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 12:47:03.919814 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479392    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 12:47:03.919814 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479395    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 12:47:03.919814 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479397    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 12:47:03.919814 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479400    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 12:47:03.919814 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479402    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 12:47:03.919814 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479412    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 12:47:03.919814 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479415    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 12:47:03.919814 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479417    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 12:47:03.919814 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479420    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 12:47:03.919814 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:03.479422    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 12:47:03.920274 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.479427    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 12:47:03.920274 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.479535    2579 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 06 12:47:03.920274 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.482933    2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 06 12:47:03.920274 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.484615    2579 server.go:1019] "Starting client certificate rotation"
Jul 06 12:47:03.920274 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.484718    2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 12:47:03.920274 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.484745    2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 12:47:03.920274 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.487606    2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 12:47:03.920274 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.490295    2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 12:47:03.920274 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.500709    2579 log.go:25] "Validated CRI v1 runtime API"
Jul 06 12:47:03.920274 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.504500    2579 log.go:25] "Validated CRI v1 image API"
Jul 06 12:47:03.920274 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.506341    2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 06 12:47:03.920274 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.510406    2579 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 a183ff57-05d0-4900-8bd4-66a7eea578ce:/dev/nvme0n1p3 f7761be1-7660-4bc8-867a-7881307d4312:/dev/nvme0n1p4]
Jul 06 12:47:03.920670 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.510420    2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 06 12:47:03.920745 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.515352    2579 manager.go:216] Machine: {Timestamp:2026-07-06 12:47:03.513987429 +0000 UTC m=+0.382875078 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098709 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2dfeef10ece4d0a784bec03e4b9fac SystemUUID:ec2dfeef-10ec-e4d0-a784-bec03e4b9fac BootID:4a2f04b5-84b2-44a9-9177-9654c7e3a2f7 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b5:45:9b:9d:cd Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b5:45:9b:9d:cd Speed:0 Mtu:9001} {Name:ovs-system MacAddress:7e:79:0a:8d:2d:4f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 06 12:47:03.920745 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.515453    2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 06 12:47:03.920745 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.515520    2579 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 06 12:47:03.920745 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.518973    2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 06 12:47:03.920745 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.519006    2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-126.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 06 12:47:03.920745 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.519898    2579 topology_manager.go:138] "Creating topology manager with none policy"
Jul 06 12:47:03.920745 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.519909    2579 container_manager_linux.go:309] "Creating device plugin manager"
Jul 06 12:47:03.920745 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.519920    2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 12:47:03.921073 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.519933    2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 12:47:03.921073 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.521931    2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 06 12:47:03.921073 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.524152    2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 12:47:03.921073 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.526628    2579 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 12:47:03.921073 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.526760    2579 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 06 12:47:03.921073 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.526791    2579 kubelet.go:486] "Attempting to sync node with API server"
Jul 06 12:47:03.921073 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.526805    2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 06 12:47:03.921073 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.526827    2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 06 12:47:03.921073 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.526856    2579 kubelet.go:398] "Adding apiserver pod source"
Jul 06 12:47:03.921073 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.526877    2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 06 12:47:03.921073 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.527251    2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 12:47:03.921073 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.527269    2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 12:47:03.921073 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.529609    2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 06 12:47:03.921073 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.531932    2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 06 12:47:03.921073 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.531960    2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 06 12:47:03.921073 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.533357    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 06 12:47:03.921073 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.533370    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 06 12:47:03.921073 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.533376    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 06 12:47:03.921073 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.533393    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 06 12:47:03.921073 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.533405    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 06 12:47:03.921073 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.533410    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 06 12:47:03.921073 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.533419    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 06 12:47:03.921073 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.533423    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 06 12:47:03.921073 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.533429    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 06 12:47:03.921073 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.533434    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 06 12:47:03.921073 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.533450    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 06 12:47:03.921073 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.533455    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 06 12:47:03.921073 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.534326    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 06 12:47:03.921073 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.534338    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 06 12:47:03.921073 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.537505    2579 server.go:1268] "Started kubelet"
Jul 06 12:47:03.921073 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.537888    2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 06 12:47:03.921073 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.541177    2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-126.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 06 12:47:03.921073 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.537938    2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 06 12:47:03.921073 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.543679    2579 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 06 12:47:03.921073 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:03.544960    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 06 12:47:03.921073 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:03.545323    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-126.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 06 12:47:03.921073 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.546175    2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 06 12:47:03.921073 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:03.546773    2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 06 12:47:03.921073 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.547660    2579 server.go:310] "Adding debug handlers to kubelet server"
Jul 06 12:47:03.922497 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:03.549822    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-126.ec2.internal.18bfb41f31fa58f3  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-126.ec2.internal,UID:ip-10-0-129-126.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-126.ec2.internal,},FirstTimestamp:2026-07-06 12:47:03.537481971 +0000 UTC m=+0.406369622,LastTimestamp:2026-07-06 12:47:03.537481971 +0000 UTC m=+0.406369622,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-126.ec2.internal,}"
Jul 06 12:47:03.922497 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.555740    2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 06 12:47:03.922497 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.555755    2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 06 12:47:03.922497 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:03.555871    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-126.ec2.internal\" not found"
Jul 06 12:47:03.922497 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.556516    2579 factory.go:55] Registering systemd factory
Jul 06 12:47:03.922497 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.556528    2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 06 12:47:03.922497 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.556527    2579 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 06 12:47:03.922497 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.556570    2579 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 06 12:47:03.922497 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.556532    2579 factory.go:223] Registration of the systemd container factory successfully
Jul 06 12:47:03.922497 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.556677    2579 reconstruct.go:97] "Volume reconstruction finished"
Jul 06 12:47:03.922497 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.556686    2579 reconciler.go:29] "Reconciler: start to sync state"
Jul 06 12:47:03.922497 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.556804    2579 factory.go:153] Registering CRI-O factory
Jul 06 12:47:03.922497 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.556819    2579 factory.go:223] Registration of the crio container factory successfully
Jul 06 12:47:03.922497 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.556941    2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 06 12:47:03.922497 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.556964    2579 factory.go:103] Registering Raw factory
Jul 06 12:47:03.922497 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.556975    2579 manager.go:1196] Started watching for new ooms in manager
Jul 06 12:47:03.922497 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.559972    2579 manager.go:349] Starting recovery of all containers
Jul 06 12:47:03.922497 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.563431    2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-klv59"
Jul 06 12:47:03.922497 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:03.568283    2579 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-126.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 06 12:47:03.922497 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:03.568367    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 06 12:47:03.922497 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.569941    2579 manager.go:354] Recovery completed
Jul 06 12:47:03.922497 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.574017    2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-klv59"
Jul 06 12:47:03.922497 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.576207    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 12:47:03.922497 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.577981    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-126.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 12:47:03.922497 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.578006    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-126.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 12:47:03.922497 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.578016    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-126.ec2.internal" event="NodeHasSufficientPID"
Jul 06 12:47:03.922497 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.579058    2579 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 06 12:47:03.922497 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.579065    2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 06 12:47:03.922497 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.579080    2579 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 12:47:03.922497 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.579102    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 12:47:03.922497 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.579861    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-126.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 12:47:03.922497 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.579883    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-126.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 12:47:04.091323 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.579892    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-126.ec2.internal" event="NodeHasSufficientPID"
Jul 06 12:47:04.091323 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.581098    2579 policy_none.go:49] "None policy: Start"
Jul 06 12:47:04.091323 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.581117    2579 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 06 12:47:04.091323 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.581127    2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 06 12:47:04.091323 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.583248    2579 policy_none.go:47] "Start"
Jul 06 12:47:04.091323 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.624369    2579 manager.go:337] "Starting Device Plugin manager"
Jul 06 12:47:04.091323 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:03.624398    2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 06 12:47:04.091323 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.624408    2579 server.go:87] "Starting device plugin registration server"
Jul 06 12:47:04.091323 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.624661    2579 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 06 12:47:04.091323 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.624672    2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 06 12:47:04.091323 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.624770    2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 06 12:47:04.091323 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.624916    2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 06 12:47:04.091323 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.624925    2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 06 12:47:04.091323 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:03.625378    2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 06 12:47:04.091323 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:03.625419    2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-126.ec2.internal\" not found"
Jul 06 12:47:04.091323 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.646930    2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 06 12:47:04.091323 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.648023    2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 06 12:47:04.091323 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.648069    2579 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 06 12:47:04.091323 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.648095    2579 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 06 12:47:04.091323 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:03.648135    2579 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 06 12:47:04.091323 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.650148    2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 12:47:04.091323 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.725113    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 12:47:04.091323 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.727939    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-126.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 12:47:04.091323 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.727968    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-126.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 12:47:04.091323 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.727980    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-126.ec2.internal" event="NodeHasSufficientPID"
Jul 06 12:47:04.091323 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.728002    2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-126.ec2.internal"
Jul 06 12:47:04.091323 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.743577    2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-126.ec2.internal"
Jul 06 12:47:04.091323 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:03.743598    2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-126.ec2.internal\": node \"ip-10-0-129-126.ec2.internal\" not found"
Jul 06 12:47:04.091323 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.748612    2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-126.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-126.ec2.internal"]
Jul 06 12:47:04.091323 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.748667    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 12:47:04.091323 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.750049    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-126.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 12:47:04.091323 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.750070    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-126.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 12:47:04.091323 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.750080    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-126.ec2.internal" event="NodeHasSufficientPID"
Jul 06 12:47:04.091323 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.752595    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 12:47:04.091323 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.752714    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-126.ec2.internal"
Jul 06 12:47:04.091323 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.752744    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 12:47:04.091323 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.753295    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-126.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 12:47:04.091323 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.753300    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-126.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 12:47:04.098066 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.753318    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-126.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 12:47:04.098066 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.753321    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-126.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 12:47:04.098066 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.753328    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-126.ec2.internal" event="NodeHasSufficientPID"
Jul 06 12:47:04.098066 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.753335    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-126.ec2.internal" event="NodeHasSufficientPID"
Jul 06 12:47:04.098066 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.755382    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-126.ec2.internal"
Jul 06 12:47:04.098066 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.755404    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 12:47:04.098066 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.756083    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-126.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 12:47:04.098066 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.756109    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-126.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 12:47:04.098066 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.756121    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-126.ec2.internal" event="NodeHasSufficientPID"
Jul 06 12:47:04.098066 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.758106    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9f88e660f9398535f6ba4e54f660d4b7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-126.ec2.internal\" (UID: \"9f88e660f9398535f6ba4e54f660d4b7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-126.ec2.internal"
Jul 06 12:47:04.098066 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.758166    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9f88e660f9398535f6ba4e54f660d4b7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-126.ec2.internal\" (UID: \"9f88e660f9398535f6ba4e54f660d4b7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-126.ec2.internal"
Jul 06 12:47:04.098066 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.758219    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b09a290c651e1aea4d449f3ffc2514d4-config\") pod \"kube-apiserver-proxy-ip-10-0-129-126.ec2.internal\" (UID: \"b09a290c651e1aea4d449f3ffc2514d4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-126.ec2.internal"
Jul 06 12:47:04.098066 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:03.783356    2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-126.ec2.internal\" not found" node="ip-10-0-129-126.ec2.internal"
Jul 06 12:47:04.098066 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:03.786598    2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-126.ec2.internal\" not found" node="ip-10-0-129-126.ec2.internal"
Jul 06 12:47:04.098066 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:03.790513    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-126.ec2.internal\" not found"
Jul 06 12:47:04.098066 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.858550    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9f88e660f9398535f6ba4e54f660d4b7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-126.ec2.internal\" (UID: \"9f88e660f9398535f6ba4e54f660d4b7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-126.ec2.internal"
Jul 06 12:47:04.098066 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.858575    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9f88e660f9398535f6ba4e54f660d4b7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-126.ec2.internal\" (UID: \"9f88e660f9398535f6ba4e54f660d4b7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-126.ec2.internal"
Jul 06 12:47:04.098066 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.858591    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b09a290c651e1aea4d449f3ffc2514d4-config\") pod \"kube-apiserver-proxy-ip-10-0-129-126.ec2.internal\" (UID: \"b09a290c651e1aea4d449f3ffc2514d4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-126.ec2.internal"
Jul 06 12:47:04.098066 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.858626    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b09a290c651e1aea4d449f3ffc2514d4-config\") pod \"kube-apiserver-proxy-ip-10-0-129-126.ec2.internal\" (UID: \"b09a290c651e1aea4d449f3ffc2514d4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-126.ec2.internal"
Jul 06 12:47:04.098696 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.858643    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9f88e660f9398535f6ba4e54f660d4b7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-126.ec2.internal\" (UID: \"9f88e660f9398535f6ba4e54f660d4b7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-126.ec2.internal"
Jul 06 12:47:04.098696 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:03.858665    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9f88e660f9398535f6ba4e54f660d4b7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-126.ec2.internal\" (UID: \"9f88e660f9398535f6ba4e54f660d4b7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-126.ec2.internal"
Jul 06 12:47:04.098696 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:03.891185    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-126.ec2.internal\" not found"
Jul 06 12:47:04.098696 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:03.991354    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-126.ec2.internal\" not found"
Jul 06 12:47:04.098696 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:04.086164    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-126.ec2.internal"
Jul 06 12:47:04.098696 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:04.089305    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-126.ec2.internal"
Jul 06 12:47:04.098696 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:04.092279    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-126.ec2.internal\" not found"
Jul 06 12:47:04.202824 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:04.193157    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-126.ec2.internal\" not found"
Jul 06 12:47:04.322430 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:04.293642    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-126.ec2.internal\" not found"
Jul 06 12:47:04.461270 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:04.394260    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-126.ec2.internal\" not found"
Jul 06 12:47:04.461270 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:04.427168    2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 12:47:04.593604 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:04.484020    2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 06 12:47:04.593604 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:04.484121    2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 06 12:47:04.593604 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:04.484173    2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 06 12:47:04.593604 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:04.494830    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-126.ec2.internal\" not found"
Jul 06 12:47:04.593604 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:04.576800    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 12:42:04 +0000 UTC" deadline="2028-04-13 15:42:37.501299226 +0000 UTC"
Jul 06 12:47:04.593604 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:04.576822    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15530h55m32.924480478s"
Jul 06 12:47:04.600710 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:04.594944    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-126.ec2.internal\" not found"
Jul 06 12:47:04.732233 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:04.695016    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-126.ec2.internal\" not found"
Jul 06 12:47:04.859360 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:04.767831    2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 12:47:04.859360 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:04.795488    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-126.ec2.internal\" not found"
Jul 06 12:47:04.859360 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:04.798460    2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 12:47:04.859360 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:04.856281    2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-126.ec2.internal"
Jul 06 12:47:04.870650 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:04.869007    2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 12:47:04.870650 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:04.869906    2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-126.ec2.internal"
Jul 06 12:47:04.879355 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:04.878045    2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 12:47:05.548681 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.526974    2579 apiserver.go:52] "Watching apiserver"
Jul 06 12:47:05.548681 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.538353    2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 06 12:47:05.548681 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.538698    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-mp2mx","kube-system/global-pull-secret-syncer-vdbtk","kube-system/kube-apiserver-proxy-ip-10-0-129-126.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drgfv","openshift-image-registry/node-ca-tr8t2","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-126.ec2.internal","openshift-multus/multus-7j4hl","openshift-multus/network-metrics-daemon-nhdrh","openshift-network-diagnostics/network-check-target-xj4sm","kube-system/konnectivity-agent-6l9nm","openshift-cluster-node-tuning-operator/tuned-swjxd","openshift-dns/node-resolver-9jrvv","openshift-multus/multus-additional-cni-plugins-frfnj","openshift-network-operator/iptables-alerter-hldtt"]
Jul 06 12:47:05.548681 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.541448    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7j4hl"
Jul 06 12:47:05.548681 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.544246    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-frfnj"
Jul 06 12:47:05.548681 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.544763    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 06 12:47:05.548681 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.544878    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 06 12:47:05.548681 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.545022    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-zngrq\""
Jul 06 12:47:05.548681 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.545172    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 06 12:47:05.548681 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.545300    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 06 12:47:05.548681 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.548135    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 06 12:47:05.548681 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.548159    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hldtt"
Jul 06 12:47:05.548681 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.548176    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 06 12:47:05.548681 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.548135    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-sphd2\""
Jul 06 12:47:05.549277 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.548699    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drgfv"
Jul 06 12:47:05.666739 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.550996    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tr8t2"
Jul 06 12:47:05.666739 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.551347    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 06 12:47:05.666739 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.551371    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 06 12:47:05.666739 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.551460    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-d9h5k\""
Jul 06 12:47:05.666739 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.551778    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 06 12:47:05.666739 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.552009    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 06 12:47:05.666739 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.553193    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 06 12:47:05.666739 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.553313    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 06 12:47:05.666739 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.553374    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4z46g\""
Jul 06 12:47:05.666739 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.553434    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nhdrh"
Jul 06 12:47:05.666739 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:05.553499    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nhdrh" podUID="efc0433a-6604-414a-b029-97f8b1075928"
Jul 06 12:47:05.666739 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.553716    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 06 12:47:05.666739 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.553898    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 06 12:47:05.666739 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.553996    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-l86zk\""
Jul 06 12:47:05.666739 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.554012    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 06 12:47:05.666739 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.555687    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xj4sm"
Jul 06 12:47:05.666739 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:05.555757    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xj4sm" podUID="2e3e9cee-032c-466e-8808-9d91f3fe2fc5"
Jul 06 12:47:05.666739 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.556359    2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 06 12:47:05.666739 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.558021    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mp2mx"
Jul 06 12:47:05.666739 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.560593    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vdbtk"
Jul 06 12:47:05.666739 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:05.560652    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vdbtk" podUID="063b9802-bd30-43d5-8969-819da64e14b0"
Jul 06 12:47:05.666739 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.560831    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 06 12:47:05.666739 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.561112    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 06 12:47:05.666739 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.562443    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-xnllj\""
Jul 06 12:47:05.666739 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.562823    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 06 12:47:05.666739 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.563000    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 06 12:47:05.666739 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.563451    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6l9nm"
Jul 06 12:47:05.786215 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.563580    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 06 12:47:05.786215 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.563770    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 06 12:47:05.786215 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.565318    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-swjxd"
Jul 06 12:47:05.786215 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.568388    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 06 12:47:05.786215 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.568542    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-t8rcr\""
Jul 06 12:47:05.786215 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.568750    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9jrvv"
Jul 06 12:47:05.786215 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.568897    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 06 12:47:05.786215 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.569425    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-8cszw\""
Jul 06 12:47:05.786215 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.569559    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 06 12:47:05.786215 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.569596    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 06 12:47:05.786215 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.570180    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pz5fq\" (UniqueName: \"kubernetes.io/projected/2dc4171e-8076-4168-ac15-27daa9c4fdf2-kube-api-access-pz5fq\") pod \"aws-ebs-csi-driver-node-drgfv\" (UID: \"2dc4171e-8076-4168-ac15-27daa9c4fdf2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drgfv"
Jul 06 12:47:05.786215 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.570208    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e09437b4-0f91-4b6f-a017-784f7515276b-serviceca\") pod \"node-ca-tr8t2\" (UID: \"e09437b4-0f91-4b6f-a017-784f7515276b\") " pod="openshift-image-registry/node-ca-tr8t2"
Jul 06 12:47:05.786215 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.570228    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbjgr\" (UniqueName: \"kubernetes.io/projected/efc0433a-6604-414a-b029-97f8b1075928-kube-api-access-xbjgr\") pod \"network-metrics-daemon-nhdrh\" (UID: \"efc0433a-6604-414a-b029-97f8b1075928\") " pod="openshift-multus/network-metrics-daemon-nhdrh"
Jul 06 12:47:05.786215 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.570244    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4189b076-eba5-4f1c-9c60-c08cd561c37e-cni-binary-copy\") pod \"multus-7j4hl\" (UID: \"4189b076-eba5-4f1c-9c60-c08cd561c37e\") " pod="openshift-multus/multus-7j4hl"
Jul 06 12:47:05.786215 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.570266    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2f70de53-34f6-4a59-9a48-015ddec89a47-os-release\") pod \"multus-additional-cni-plugins-frfnj\" (UID: \"2f70de53-34f6-4a59-9a48-015ddec89a47\") " pod="openshift-multus/multus-additional-cni-plugins-frfnj"
Jul 06 12:47:05.786215 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.570300    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6dc153e6-3403-42ca-ae21-cd7056b3cb47-host-slash\") pod \"iptables-alerter-hldtt\" (UID: \"6dc153e6-3403-42ca-ae21-cd7056b3cb47\") " pod="openshift-network-operator/iptables-alerter-hldtt"
Jul 06 12:47:05.786215 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.570315    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/824c3385-d7b5-42ff-8db7-8189f6015cca-systemd-units\") pod \"ovnkube-node-mp2mx\" (UID: \"824c3385-d7b5-42ff-8db7-8189f6015cca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp2mx"
Jul 06 12:47:05.786215 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.570331    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/824c3385-d7b5-42ff-8db7-8189f6015cca-run-ovn\") pod \"ovnkube-node-mp2mx\" (UID: \"824c3385-d7b5-42ff-8db7-8189f6015cca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp2mx"
Jul 06 12:47:05.786215 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.570352    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/824c3385-d7b5-42ff-8db7-8189f6015cca-host-run-ovn-kubernetes\") pod \"ovnkube-node-mp2mx\" (UID: \"824c3385-d7b5-42ff-8db7-8189f6015cca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp2mx"
Jul 06 12:47:05.787608 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.570375    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/824c3385-d7b5-42ff-8db7-8189f6015cca-ovnkube-config\") pod \"ovnkube-node-mp2mx\" (UID: \"824c3385-d7b5-42ff-8db7-8189f6015cca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp2mx"
Jul 06 12:47:05.787608 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.570397    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2dc4171e-8076-4168-ac15-27daa9c4fdf2-sys-fs\") pod \"aws-ebs-csi-driver-node-drgfv\" (UID: \"2dc4171e-8076-4168-ac15-27daa9c4fdf2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drgfv"
Jul 06 12:47:05.787608 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.570415    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/824c3385-d7b5-42ff-8db7-8189f6015cca-host-kubelet\") pod \"ovnkube-node-mp2mx\" (UID: \"824c3385-d7b5-42ff-8db7-8189f6015cca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp2mx"
Jul 06 12:47:05.787608 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.570438    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/824c3385-d7b5-42ff-8db7-8189f6015cca-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mp2mx\" (UID: \"824c3385-d7b5-42ff-8db7-8189f6015cca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp2mx"
Jul 06 12:47:05.787608 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.570472    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/824c3385-d7b5-42ff-8db7-8189f6015cca-ovn-node-metrics-cert\") pod \"ovnkube-node-mp2mx\" (UID: \"824c3385-d7b5-42ff-8db7-8189f6015cca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp2mx"
Jul 06 12:47:05.787608 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.570503    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4189b076-eba5-4f1c-9c60-c08cd561c37e-multus-daemon-config\") pod \"multus-7j4hl\" (UID: \"4189b076-eba5-4f1c-9c60-c08cd561c37e\") " pod="openshift-multus/multus-7j4hl"
Jul 06 12:47:05.787608 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.570526    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2f70de53-34f6-4a59-9a48-015ddec89a47-system-cni-dir\") pod \"multus-additional-cni-plugins-frfnj\" (UID: \"2f70de53-34f6-4a59-9a48-015ddec89a47\") " pod="openshift-multus/multus-additional-cni-plugins-frfnj"
Jul 06 12:47:05.787608 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.570571    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2f70de53-34f6-4a59-9a48-015ddec89a47-cnibin\") pod \"multus-additional-cni-plugins-frfnj\" (UID: \"2f70de53-34f6-4a59-9a48-015ddec89a47\") " pod="openshift-multus/multus-additional-cni-plugins-frfnj"
Jul 06 12:47:05.787608 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.570611    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2f70de53-34f6-4a59-9a48-015ddec89a47-tuning-conf-dir\") pod \"multus-additional-cni-plugins-frfnj\" (UID: \"2f70de53-34f6-4a59-9a48-015ddec89a47\") " pod="openshift-multus/multus-additional-cni-plugins-frfnj"
Jul 06 12:47:05.787608 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.570643    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2dc4171e-8076-4168-ac15-27daa9c4fdf2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-drgfv\" (UID: \"2dc4171e-8076-4168-ac15-27daa9c4fdf2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drgfv"
Jul 06 12:47:05.787608 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.570670    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4189b076-eba5-4f1c-9c60-c08cd561c37e-host-var-lib-cni-bin\") pod \"multus-7j4hl\" (UID: \"4189b076-eba5-4f1c-9c60-c08cd561c37e\") " pod="openshift-multus/multus-7j4hl"
Jul 06 12:47:05.787608 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.570697    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/824c3385-d7b5-42ff-8db7-8189f6015cca-var-lib-openvswitch\") pod \"ovnkube-node-mp2mx\" (UID: \"824c3385-d7b5-42ff-8db7-8189f6015cca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp2mx"
Jul 06 12:47:05.787608 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.570723    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4189b076-eba5-4f1c-9c60-c08cd561c37e-cnibin\") pod \"multus-7j4hl\" (UID: \"4189b076-eba5-4f1c-9c60-c08cd561c37e\") " pod="openshift-multus/multus-7j4hl"
Jul 06 12:47:05.788503 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.570755    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4189b076-eba5-4f1c-9c60-c08cd561c37e-multus-socket-dir-parent\") pod \"multus-7j4hl\" (UID: \"4189b076-eba5-4f1c-9c60-c08cd561c37e\") " pod="openshift-multus/multus-7j4hl"
Jul 06 12:47:05.788503 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.570787    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2f70de53-34f6-4a59-9a48-015ddec89a47-cni-binary-copy\") pod \"multus-additional-cni-plugins-frfnj\" (UID: \"2f70de53-34f6-4a59-9a48-015ddec89a47\") " pod="openshift-multus/multus-additional-cni-plugins-frfnj"
Jul 06 12:47:05.788503 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.570812    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2f70de53-34f6-4a59-9a48-015ddec89a47-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-frfnj\" (UID: \"2f70de53-34f6-4a59-9a48-015ddec89a47\") " pod="openshift-multus/multus-additional-cni-plugins-frfnj"
Jul 06 12:47:05.788503 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.570834    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4189b076-eba5-4f1c-9c60-c08cd561c37e-etc-kubernetes\") pod \"multus-7j4hl\" (UID: \"4189b076-eba5-4f1c-9c60-c08cd561c37e\") " pod="openshift-multus/multus-7j4hl"
Jul 06 12:47:05.788503 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.570857    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tr7v\" (UniqueName: \"kubernetes.io/projected/4189b076-eba5-4f1c-9c60-c08cd561c37e-kube-api-access-6tr7v\") pod \"multus-7j4hl\" (UID: \"4189b076-eba5-4f1c-9c60-c08cd561c37e\") " pod="openshift-multus/multus-7j4hl"
Jul 06 12:47:05.788503 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.570916    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/824c3385-d7b5-42ff-8db7-8189f6015cca-run-systemd\") pod \"ovnkube-node-mp2mx\" (UID: \"824c3385-d7b5-42ff-8db7-8189f6015cca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp2mx"
Jul 06 12:47:05.788503 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.570983    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sp45q\" (UniqueName: \"kubernetes.io/projected/824c3385-d7b5-42ff-8db7-8189f6015cca-kube-api-access-sp45q\") pod \"ovnkube-node-mp2mx\" (UID: \"824c3385-d7b5-42ff-8db7-8189f6015cca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp2mx"
Jul 06 12:47:05.788503 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.571026    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4189b076-eba5-4f1c-9c60-c08cd561c37e-host-run-k8s-cni-cncf-io\") pod \"multus-7j4hl\" (UID: \"4189b076-eba5-4f1c-9c60-c08cd561c37e\") " pod="openshift-multus/multus-7j4hl"
Jul 06 12:47:05.788503 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.571052    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/824c3385-d7b5-42ff-8db7-8189f6015cca-log-socket\") pod \"ovnkube-node-mp2mx\" (UID: \"824c3385-d7b5-42ff-8db7-8189f6015cca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp2mx"
Jul 06 12:47:05.788503 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.571086    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w94k6\" (UniqueName: \"kubernetes.io/projected/e09437b4-0f91-4b6f-a017-784f7515276b-kube-api-access-w94k6\") pod \"node-ca-tr8t2\" (UID: \"e09437b4-0f91-4b6f-a017-784f7515276b\") " pod="openshift-image-registry/node-ca-tr8t2"
Jul 06 12:47:05.788503 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.571130    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4189b076-eba5-4f1c-9c60-c08cd561c37e-multus-cni-dir\") pod \"multus-7j4hl\" (UID: \"4189b076-eba5-4f1c-9c60-c08cd561c37e\") " pod="openshift-multus/multus-7j4hl"
Jul 06 12:47:05.788503 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.571158    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4189b076-eba5-4f1c-9c60-c08cd561c37e-os-release\") pod \"multus-7j4hl\" (UID: \"4189b076-eba5-4f1c-9c60-c08cd561c37e\") " pod="openshift-multus/multus-7j4hl"
Jul 06 12:47:05.788503 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.571202    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbfqs\" (UniqueName: \"kubernetes.io/projected/2f70de53-34f6-4a59-9a48-015ddec89a47-kube-api-access-fbfqs\") pod \"multus-additional-cni-plugins-frfnj\" (UID: \"2f70de53-34f6-4a59-9a48-015ddec89a47\") " pod="openshift-multus/multus-additional-cni-plugins-frfnj"
Jul 06 12:47:05.790721 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.571247    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pc7x\" (UniqueName: \"kubernetes.io/projected/2e3e9cee-032c-466e-8808-9d91f3fe2fc5-kube-api-access-7pc7x\") pod \"network-check-target-xj4sm\" (UID: \"2e3e9cee-032c-466e-8808-9d91f3fe2fc5\") " pod="openshift-network-diagnostics/network-check-target-xj4sm"
Jul 06 12:47:05.790721 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.571267    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2dc4171e-8076-4168-ac15-27daa9c4fdf2-etc-selinux\") pod \"aws-ebs-csi-driver-node-drgfv\" (UID: \"2dc4171e-8076-4168-ac15-27daa9c4fdf2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drgfv"
Jul 06 12:47:05.790721 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.571289    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2f70de53-34f6-4a59-9a48-015ddec89a47-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-frfnj\" (UID: \"2f70de53-34f6-4a59-9a48-015ddec89a47\") " pod="openshift-multus/multus-additional-cni-plugins-frfnj"
Jul 06 12:47:05.790721 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.571306    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/824c3385-d7b5-42ff-8db7-8189f6015cca-node-log\") pod \"ovnkube-node-mp2mx\" (UID: \"824c3385-d7b5-42ff-8db7-8189f6015cca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp2mx"
Jul 06 12:47:05.790721 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.571323    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/824c3385-d7b5-42ff-8db7-8189f6015cca-host-cni-bin\") pod \"ovnkube-node-mp2mx\" (UID: \"824c3385-d7b5-42ff-8db7-8189f6015cca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp2mx"
Jul 06 12:47:05.790721 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.571337    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e09437b4-0f91-4b6f-a017-784f7515276b-host\") pod \"node-ca-tr8t2\" (UID: \"e09437b4-0f91-4b6f-a017-784f7515276b\") " pod="openshift-image-registry/node-ca-tr8t2"
Jul 06 12:47:05.790721 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.571353    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4189b076-eba5-4f1c-9c60-c08cd561c37e-host-var-lib-kubelet\") pod \"multus-7j4hl\" (UID: \"4189b076-eba5-4f1c-9c60-c08cd561c37e\") " pod="openshift-multus/multus-7j4hl"
Jul 06 12:47:05.790721 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.571372    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4189b076-eba5-4f1c-9c60-c08cd561c37e-hostroot\") pod \"multus-7j4hl\" (UID: \"4189b076-eba5-4f1c-9c60-c08cd561c37e\") " pod="openshift-multus/multus-7j4hl"
Jul 06 12:47:05.790721 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.571387    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4189b076-eba5-4f1c-9c60-c08cd561c37e-multus-conf-dir\") pod \"multus-7j4hl\" (UID: \"4189b076-eba5-4f1c-9c60-c08cd561c37e\") " pod="openshift-multus/multus-7j4hl"
Jul 06 12:47:05.790721 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.571413    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6dc153e6-3403-42ca-ae21-cd7056b3cb47-iptables-alerter-script\") pod \"iptables-alerter-hldtt\" (UID: \"6dc153e6-3403-42ca-ae21-cd7056b3cb47\") " pod="openshift-network-operator/iptables-alerter-hldtt"
Jul 06 12:47:05.790721 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.571438    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2dc4171e-8076-4168-ac15-27daa9c4fdf2-registration-dir\") pod \"aws-ebs-csi-driver-node-drgfv\" (UID: \"2dc4171e-8076-4168-ac15-27daa9c4fdf2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drgfv"
Jul 06 12:47:05.790721 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.571462    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4189b076-eba5-4f1c-9c60-c08cd561c37e-host-run-netns\") pod \"multus-7j4hl\" (UID: \"4189b076-eba5-4f1c-9c60-c08cd561c37e\") " pod="openshift-multus/multus-7j4hl"
Jul 06 12:47:05.790721 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.571486    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4189b076-eba5-4f1c-9c60-c08cd561c37e-host-var-lib-cni-multus\") pod \"multus-7j4hl\" (UID: \"4189b076-eba5-4f1c-9c60-c08cd561c37e\") " pod="openshift-multus/multus-7j4hl"
Jul 06 12:47:05.791641 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.571509    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ph96h\" (UniqueName: \"kubernetes.io/projected/6dc153e6-3403-42ca-ae21-cd7056b3cb47-kube-api-access-ph96h\") pod \"iptables-alerter-hldtt\" (UID: \"6dc153e6-3403-42ca-ae21-cd7056b3cb47\") " pod="openshift-network-operator/iptables-alerter-hldtt"
Jul 06 12:47:05.791641 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.571531    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/824c3385-d7b5-42ff-8db7-8189f6015cca-ovnkube-script-lib\") pod \"ovnkube-node-mp2mx\" (UID: \"824c3385-d7b5-42ff-8db7-8189f6015cca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp2mx"
Jul 06 12:47:05.791641 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.571571    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2dc4171e-8076-4168-ac15-27daa9c4fdf2-socket-dir\") pod \"aws-ebs-csi-driver-node-drgfv\" (UID: \"2dc4171e-8076-4168-ac15-27daa9c4fdf2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drgfv"
Jul 06 12:47:05.791641 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.571595    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4189b076-eba5-4f1c-9c60-c08cd561c37e-system-cni-dir\") pod \"multus-7j4hl\" (UID: \"4189b076-eba5-4f1c-9c60-c08cd561c37e\") " pod="openshift-multus/multus-7j4hl"
Jul 06 12:47:05.791641 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.571609    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4189b076-eba5-4f1c-9c60-c08cd561c37e-host-run-multus-certs\") pod \"multus-7j4hl\" (UID: \"4189b076-eba5-4f1c-9c60-c08cd561c37e\") " pod="openshift-multus/multus-7j4hl"
Jul 06 12:47:05.791641 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.571629    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/824c3385-d7b5-42ff-8db7-8189f6015cca-run-openvswitch\") pod \"ovnkube-node-mp2mx\" (UID: \"824c3385-d7b5-42ff-8db7-8189f6015cca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp2mx"
Jul 06 12:47:05.791641 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.571652    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/824c3385-d7b5-42ff-8db7-8189f6015cca-host-cni-netd\") pod \"ovnkube-node-mp2mx\" (UID: \"824c3385-d7b5-42ff-8db7-8189f6015cca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp2mx"
Jul 06 12:47:05.791641 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.571668    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/824c3385-d7b5-42ff-8db7-8189f6015cca-host-slash\") pod \"ovnkube-node-mp2mx\" (UID: \"824c3385-d7b5-42ff-8db7-8189f6015cca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp2mx"
Jul 06 12:47:05.791641 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.571682    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/824c3385-d7b5-42ff-8db7-8189f6015cca-host-run-netns\") pod \"ovnkube-node-mp2mx\" (UID: \"824c3385-d7b5-42ff-8db7-8189f6015cca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp2mx"
Jul 06 12:47:05.791641 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.571696    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/824c3385-d7b5-42ff-8db7-8189f6015cca-env-overrides\") pod \"ovnkube-node-mp2mx\" (UID: \"824c3385-d7b5-42ff-8db7-8189f6015cca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp2mx"
Jul 06 12:47:05.791641 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.571724    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2dc4171e-8076-4168-ac15-27daa9c4fdf2-device-dir\") pod \"aws-ebs-csi-driver-node-drgfv\" (UID: \"2dc4171e-8076-4168-ac15-27daa9c4fdf2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drgfv"
Jul 06 12:47:05.791641 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.571763    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/efc0433a-6604-414a-b029-97f8b1075928-metrics-certs\") pod \"network-metrics-daemon-nhdrh\" (UID: \"efc0433a-6604-414a-b029-97f8b1075928\") " pod="openshift-multus/network-metrics-daemon-nhdrh"
Jul 06 12:47:05.791641 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.571792    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/824c3385-d7b5-42ff-8db7-8189f6015cca-etc-openvswitch\") pod \"ovnkube-node-mp2mx\" (UID: \"824c3385-d7b5-42ff-8db7-8189f6015cca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp2mx"
Jul 06 12:47:05.791641 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.576641    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 06 12:47:05.791641 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.576686    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-qztz5\""
Jul 06 12:47:05.793429 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.576686    2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 12:47:05.793429 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.576690    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 06 12:47:05.793429 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.607285    2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5mwmr"
Jul 06 12:47:05.793429 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.615956    2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5mwmr"
Jul 06 12:47:05.793429 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.657549    2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 06 12:47:05.793429 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.672181    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/824c3385-d7b5-42ff-8db7-8189f6015cca-host-slash\") pod \"ovnkube-node-mp2mx\" (UID: \"824c3385-d7b5-42ff-8db7-8189f6015cca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp2mx"
Jul 06 12:47:05.793429 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.672209    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/824c3385-d7b5-42ff-8db7-8189f6015cca-host-run-netns\") pod \"ovnkube-node-mp2mx\" (UID: \"824c3385-d7b5-42ff-8db7-8189f6015cca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp2mx"
Jul 06 12:47:05.793429 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.672233    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/824c3385-d7b5-42ff-8db7-8189f6015cca-env-overrides\") pod \"ovnkube-node-mp2mx\" (UID: \"824c3385-d7b5-42ff-8db7-8189f6015cca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp2mx"
Jul 06 12:47:05.793429 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.672255    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2dc4171e-8076-4168-ac15-27daa9c4fdf2-device-dir\") pod \"aws-ebs-csi-driver-node-drgfv\" (UID: \"2dc4171e-8076-4168-ac15-27daa9c4fdf2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drgfv"
Jul 06 12:47:05.793429 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.672277    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/efc0433a-6604-414a-b029-97f8b1075928-metrics-certs\") pod \"network-metrics-daemon-nhdrh\" (UID: \"efc0433a-6604-414a-b029-97f8b1075928\") " pod="openshift-multus/network-metrics-daemon-nhdrh"
Jul 06 12:47:05.793429 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.672292    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/824c3385-d7b5-42ff-8db7-8189f6015cca-host-slash\") pod \"ovnkube-node-mp2mx\" (UID: \"824c3385-d7b5-42ff-8db7-8189f6015cca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp2mx"
Jul 06 12:47:05.793429 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.672299    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/824c3385-d7b5-42ff-8db7-8189f6015cca-host-run-netns\") pod \"ovnkube-node-mp2mx\" (UID: \"824c3385-d7b5-42ff-8db7-8189f6015cca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp2mx"
Jul 06 12:47:05.793429 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.672301    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/063b9802-bd30-43d5-8969-819da64e14b0-kubelet-config\") pod \"global-pull-secret-syncer-vdbtk\" (UID: \"063b9802-bd30-43d5-8969-819da64e14b0\") " pod="kube-system/global-pull-secret-syncer-vdbtk"
Jul 06 12:47:05.793429 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.672356    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2dc4171e-8076-4168-ac15-27daa9c4fdf2-device-dir\") pod \"aws-ebs-csi-driver-node-drgfv\" (UID: \"2dc4171e-8076-4168-ac15-27daa9c4fdf2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drgfv"
Jul 06 12:47:05.793429 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.672357    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3018c6ec-22c6-44ff-951a-5a9867fb4efd-etc-modprobe-d\") pod \"tuned-swjxd\" (UID: \"3018c6ec-22c6-44ff-951a-5a9867fb4efd\") " pod="openshift-cluster-node-tuning-operator/tuned-swjxd"
Jul 06 12:47:05.793429 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.672390    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3018c6ec-22c6-44ff-951a-5a9867fb4efd-etc-sysconfig\") pod \"tuned-swjxd\" (UID: \"3018c6ec-22c6-44ff-951a-5a9867fb4efd\") " pod="openshift-cluster-node-tuning-operator/tuned-swjxd"
Jul 06 12:47:05.793429 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:05.672408    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 12:47:05.793429 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.672428    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/824c3385-d7b5-42ff-8db7-8189f6015cca-etc-openvswitch\") pod \"ovnkube-node-mp2mx\" (UID: \"824c3385-d7b5-42ff-8db7-8189f6015cca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp2mx"
Jul 06 12:47:05.794315 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:05.672486    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/efc0433a-6604-414a-b029-97f8b1075928-metrics-certs podName:efc0433a-6604-414a-b029-97f8b1075928 nodeName:}" failed. No retries permitted until 2026-07-06 12:47:06.172464129 +0000 UTC m=+3.041351769 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/efc0433a-6604-414a-b029-97f8b1075928-metrics-certs") pod "network-metrics-daemon-nhdrh" (UID: "efc0433a-6604-414a-b029-97f8b1075928") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 12:47:05.794315 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.672532    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pz5fq\" (UniqueName: \"kubernetes.io/projected/2dc4171e-8076-4168-ac15-27daa9c4fdf2-kube-api-access-pz5fq\") pod \"aws-ebs-csi-driver-node-drgfv\" (UID: \"2dc4171e-8076-4168-ac15-27daa9c4fdf2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drgfv"
Jul 06 12:47:05.794315 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.672539    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/824c3385-d7b5-42ff-8db7-8189f6015cca-etc-openvswitch\") pod \"ovnkube-node-mp2mx\" (UID: \"824c3385-d7b5-42ff-8db7-8189f6015cca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp2mx"
Jul 06 12:47:05.794315 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.672569    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e09437b4-0f91-4b6f-a017-784f7515276b-serviceca\") pod \"node-ca-tr8t2\" (UID: \"e09437b4-0f91-4b6f-a017-784f7515276b\") " pod="openshift-image-registry/node-ca-tr8t2"
Jul 06 12:47:05.794315 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.672601    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbjgr\" (UniqueName: \"kubernetes.io/projected/efc0433a-6604-414a-b029-97f8b1075928-kube-api-access-xbjgr\") pod \"network-metrics-daemon-nhdrh\" (UID: \"efc0433a-6604-414a-b029-97f8b1075928\") " pod="openshift-multus/network-metrics-daemon-nhdrh"
Jul 06 12:47:05.794315 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.672666    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4189b076-eba5-4f1c-9c60-c08cd561c37e-cni-binary-copy\") pod \"multus-7j4hl\" (UID: \"4189b076-eba5-4f1c-9c60-c08cd561c37e\") " pod="openshift-multus/multus-7j4hl"
Jul 06 12:47:05.794315 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.672855    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2f70de53-34f6-4a59-9a48-015ddec89a47-os-release\") pod \"multus-additional-cni-plugins-frfnj\" (UID: \"2f70de53-34f6-4a59-9a48-015ddec89a47\") " pod="openshift-multus/multus-additional-cni-plugins-frfnj"
Jul 06 12:47:05.794315 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.672882    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6dc153e6-3403-42ca-ae21-cd7056b3cb47-host-slash\") pod \"iptables-alerter-hldtt\" (UID: \"6dc153e6-3403-42ca-ae21-cd7056b3cb47\") " pod="openshift-network-operator/iptables-alerter-hldtt"
Jul 06 12:47:05.794315 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.672927    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ff4w2\" (UniqueName: \"kubernetes.io/projected/3018c6ec-22c6-44ff-951a-5a9867fb4efd-kube-api-access-ff4w2\") pod \"tuned-swjxd\" (UID: \"3018c6ec-22c6-44ff-951a-5a9867fb4efd\") " pod="openshift-cluster-node-tuning-operator/tuned-swjxd"
Jul 06 12:47:05.794315 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.672864    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/824c3385-d7b5-42ff-8db7-8189f6015cca-env-overrides\") pod \"ovnkube-node-mp2mx\" (UID: \"824c3385-d7b5-42ff-8db7-8189f6015cca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp2mx"
Jul 06 12:47:05.794315 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.672958    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2f70de53-34f6-4a59-9a48-015ddec89a47-os-release\") pod \"multus-additional-cni-plugins-frfnj\" (UID: \"2f70de53-34f6-4a59-9a48-015ddec89a47\") " pod="openshift-multus/multus-additional-cni-plugins-frfnj"
Jul 06 12:47:05.794315 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.672959    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/824c3385-d7b5-42ff-8db7-8189f6015cca-systemd-units\") pod \"ovnkube-node-mp2mx\" (UID: \"824c3385-d7b5-42ff-8db7-8189f6015cca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp2mx"
Jul 06 12:47:05.794315 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.672996    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/824c3385-d7b5-42ff-8db7-8189f6015cca-run-ovn\") pod \"ovnkube-node-mp2mx\" (UID: \"824c3385-d7b5-42ff-8db7-8189f6015cca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp2mx"
Jul 06 12:47:05.795627 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.673047    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/824c3385-d7b5-42ff-8db7-8189f6015cca-systemd-units\") pod \"ovnkube-node-mp2mx\" (UID: \"824c3385-d7b5-42ff-8db7-8189f6015cca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp2mx"
Jul 06 12:47:05.795627 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.673098    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/824c3385-d7b5-42ff-8db7-8189f6015cca-run-ovn\") pod \"ovnkube-node-mp2mx\" (UID: \"824c3385-d7b5-42ff-8db7-8189f6015cca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp2mx"
Jul 06 12:47:05.795627 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.673102    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6dc153e6-3403-42ca-ae21-cd7056b3cb47-host-slash\") pod \"iptables-alerter-hldtt\" (UID: \"6dc153e6-3403-42ca-ae21-cd7056b3cb47\") " pod="openshift-network-operator/iptables-alerter-hldtt"
Jul 06 12:47:05.795627 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.673123    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/824c3385-d7b5-42ff-8db7-8189f6015cca-host-run-ovn-kubernetes\") pod \"ovnkube-node-mp2mx\" (UID: \"824c3385-d7b5-42ff-8db7-8189f6015cca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp2mx"
Jul 06 12:47:05.795627 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.673146    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/824c3385-d7b5-42ff-8db7-8189f6015cca-ovnkube-config\") pod \"ovnkube-node-mp2mx\" (UID: \"824c3385-d7b5-42ff-8db7-8189f6015cca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp2mx"
Jul 06 12:47:05.795627 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.673171    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2dc4171e-8076-4168-ac15-27daa9c4fdf2-sys-fs\") pod \"aws-ebs-csi-driver-node-drgfv\" (UID: \"2dc4171e-8076-4168-ac15-27daa9c4fdf2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drgfv"
Jul 06 12:47:05.795627 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.673192    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/824c3385-d7b5-42ff-8db7-8189f6015cca-host-run-ovn-kubernetes\") pod \"ovnkube-node-mp2mx\" (UID: \"824c3385-d7b5-42ff-8db7-8189f6015cca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp2mx"
Jul 06 12:47:05.795627 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.673199    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/da8ef940-6a0f-4692-9c14-6f58ae35e1e0-agent-certs\") pod \"konnectivity-agent-6l9nm\" (UID: \"da8ef940-6a0f-4692-9c14-6f58ae35e1e0\") " pod="kube-system/konnectivity-agent-6l9nm"
Jul 06 12:47:05.795627 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.673249    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2dc4171e-8076-4168-ac15-27daa9c4fdf2-sys-fs\") pod \"aws-ebs-csi-driver-node-drgfv\" (UID: \"2dc4171e-8076-4168-ac15-27daa9c4fdf2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drgfv"
Jul 06 12:47:05.795627 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.673277    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e61427e6-62cd-44b6-9f9a-5f3bd906d29a-tmp-dir\") pod \"node-resolver-9jrvv\" (UID: \"e61427e6-62cd-44b6-9f9a-5f3bd906d29a\") " pod="openshift-dns/node-resolver-9jrvv"
Jul 06 12:47:05.795627 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.673311    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/824c3385-d7b5-42ff-8db7-8189f6015cca-host-kubelet\") pod \"ovnkube-node-mp2mx\" (UID: \"824c3385-d7b5-42ff-8db7-8189f6015cca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp2mx"
Jul 06 12:47:05.795627 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.673316    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4189b076-eba5-4f1c-9c60-c08cd561c37e-cni-binary-copy\") pod \"multus-7j4hl\" (UID: \"4189b076-eba5-4f1c-9c60-c08cd561c37e\") " pod="openshift-multus/multus-7j4hl"
Jul 06 12:47:05.795627 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.673349    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/824c3385-d7b5-42ff-8db7-8189f6015cca-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mp2mx\" (UID: \"824c3385-d7b5-42ff-8db7-8189f6015cca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp2mx"
Jul 06 12:47:05.795627 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.673363    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/824c3385-d7b5-42ff-8db7-8189f6015cca-host-kubelet\") pod \"ovnkube-node-mp2mx\" (UID: \"824c3385-d7b5-42ff-8db7-8189f6015cca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp2mx"
Jul 06 12:47:05.797835 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.673399    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/824c3385-d7b5-42ff-8db7-8189f6015cca-ovn-node-metrics-cert\") pod \"ovnkube-node-mp2mx\" (UID: \"824c3385-d7b5-42ff-8db7-8189f6015cca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp2mx"
Jul 06 12:47:05.797835 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.673421    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4189b076-eba5-4f1c-9c60-c08cd561c37e-multus-daemon-config\") pod \"multus-7j4hl\" (UID: \"4189b076-eba5-4f1c-9c60-c08cd561c37e\") " pod="openshift-multus/multus-7j4hl"
Jul 06 12:47:05.797835 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.673442    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2f70de53-34f6-4a59-9a48-015ddec89a47-system-cni-dir\") pod \"multus-additional-cni-plugins-frfnj\" (UID: \"2f70de53-34f6-4a59-9a48-015ddec89a47\") " pod="openshift-multus/multus-additional-cni-plugins-frfnj"
Jul 06 12:47:05.797835 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.673464    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2f70de53-34f6-4a59-9a48-015ddec89a47-cnibin\") pod \"multus-additional-cni-plugins-frfnj\" (UID: \"2f70de53-34f6-4a59-9a48-015ddec89a47\") " pod="openshift-multus/multus-additional-cni-plugins-frfnj"
Jul 06 12:47:05.797835 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.673516    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/063b9802-bd30-43d5-8969-819da64e14b0-original-pull-secret\") pod \"global-pull-secret-syncer-vdbtk\" (UID: \"063b9802-bd30-43d5-8969-819da64e14b0\") " pod="kube-system/global-pull-secret-syncer-vdbtk"
Jul 06 12:47:05.797835 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.673539    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2f70de53-34f6-4a59-9a48-015ddec89a47-tuning-conf-dir\") pod \"multus-additional-cni-plugins-frfnj\" (UID: \"2f70de53-34f6-4a59-9a48-015ddec89a47\") " pod="openshift-multus/multus-additional-cni-plugins-frfnj"
Jul 06 12:47:05.797835 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.673566    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3018c6ec-22c6-44ff-951a-5a9867fb4efd-etc-tuned\") pod \"tuned-swjxd\" (UID: \"3018c6ec-22c6-44ff-951a-5a9867fb4efd\") " pod="openshift-cluster-node-tuning-operator/tuned-swjxd"
Jul 06 12:47:05.797835 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.673604    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kq7c\" (UniqueName: \"kubernetes.io/projected/e61427e6-62cd-44b6-9f9a-5f3bd906d29a-kube-api-access-6kq7c\") pod \"node-resolver-9jrvv\" (UID: \"e61427e6-62cd-44b6-9f9a-5f3bd906d29a\") " pod="openshift-dns/node-resolver-9jrvv"
Jul 06 12:47:05.797835 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.673659    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2dc4171e-8076-4168-ac15-27daa9c4fdf2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-drgfv\" (UID: \"2dc4171e-8076-4168-ac15-27daa9c4fdf2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drgfv"
Jul 06 12:47:05.797835 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.673682    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3018c6ec-22c6-44ff-951a-5a9867fb4efd-etc-systemd\") pod \"tuned-swjxd\" (UID: \"3018c6ec-22c6-44ff-951a-5a9867fb4efd\") " pod="openshift-cluster-node-tuning-operator/tuned-swjxd"
Jul 06 12:47:05.797835 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.673701    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3018c6ec-22c6-44ff-951a-5a9867fb4efd-sys\") pod \"tuned-swjxd\" (UID: \"3018c6ec-22c6-44ff-951a-5a9867fb4efd\") " pod="openshift-cluster-node-tuning-operator/tuned-swjxd"
Jul 06 12:47:05.797835 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.673714    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/824c3385-d7b5-42ff-8db7-8189f6015cca-ovnkube-config\") pod \"ovnkube-node-mp2mx\" (UID: \"824c3385-d7b5-42ff-8db7-8189f6015cca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp2mx"
Jul 06 12:47:05.797835 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.673723    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4189b076-eba5-4f1c-9c60-c08cd561c37e-host-var-lib-cni-bin\") pod \"multus-7j4hl\" (UID: \"4189b076-eba5-4f1c-9c60-c08cd561c37e\") " pod="openshift-multus/multus-7j4hl"
Jul 06 12:47:05.797835 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.673715    2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 06 12:47:05.798430 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.673755    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/824c3385-d7b5-42ff-8db7-8189f6015cca-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mp2mx\" (UID: \"824c3385-d7b5-42ff-8db7-8189f6015cca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp2mx"
Jul 06 12:47:05.798430 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.673801    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/824c3385-d7b5-42ff-8db7-8189f6015cca-var-lib-openvswitch\") pod \"ovnkube-node-mp2mx\" (UID: \"824c3385-d7b5-42ff-8db7-8189f6015cca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp2mx"
Jul 06 12:47:05.798430 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.673829    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4189b076-eba5-4f1c-9c60-c08cd561c37e-cnibin\") pod \"multus-7j4hl\" (UID: \"4189b076-eba5-4f1c-9c60-c08cd561c37e\") " pod="openshift-multus/multus-7j4hl"
Jul 06 12:47:05.798430 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.673856    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4189b076-eba5-4f1c-9c60-c08cd561c37e-multus-socket-dir-parent\") pod \"multus-7j4hl\" (UID: \"4189b076-eba5-4f1c-9c60-c08cd561c37e\") " pod="openshift-multus/multus-7j4hl"
Jul 06 12:47:05.798430 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.673900    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2f70de53-34f6-4a59-9a48-015ddec89a47-cni-binary-copy\") pod \"multus-additional-cni-plugins-frfnj\" (UID: \"2f70de53-34f6-4a59-9a48-015ddec89a47\") " pod="openshift-multus/multus-additional-cni-plugins-frfnj"
Jul 06 12:47:05.798430 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.673925    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2f70de53-34f6-4a59-9a48-015ddec89a47-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-frfnj\" (UID: \"2f70de53-34f6-4a59-9a48-015ddec89a47\") " pod="openshift-multus/multus-additional-cni-plugins-frfnj"
Jul 06 12:47:05.798430 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.673968    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4189b076-eba5-4f1c-9c60-c08cd561c37e-host-var-lib-cni-bin\") pod \"multus-7j4hl\" (UID: \"4189b076-eba5-4f1c-9c60-c08cd561c37e\") " pod="openshift-multus/multus-7j4hl"
Jul 06 12:47:05.798430 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.673971    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3018c6ec-22c6-44ff-951a-5a9867fb4efd-etc-sysctl-conf\") pod \"tuned-swjxd\" (UID: \"3018c6ec-22c6-44ff-951a-5a9867fb4efd\") " pod="openshift-cluster-node-tuning-operator/tuned-swjxd"
Jul 06 12:47:05.798430 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.673998    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3018c6ec-22c6-44ff-951a-5a9867fb4efd-run\") pod \"tuned-swjxd\" (UID: \"3018c6ec-22c6-44ff-951a-5a9867fb4efd\") " pod="openshift-cluster-node-tuning-operator/tuned-swjxd"
Jul 06 12:47:05.798430 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.673936    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2f70de53-34f6-4a59-9a48-015ddec89a47-tuning-conf-dir\") pod \"multus-additional-cni-plugins-frfnj\" (UID: \"2f70de53-34f6-4a59-9a48-015ddec89a47\") " pod="openshift-multus/multus-additional-cni-plugins-frfnj"
Jul 06 12:47:05.798430 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.674074    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4189b076-eba5-4f1c-9c60-c08cd561c37e-multus-daemon-config\") pod \"multus-7j4hl\" (UID: \"4189b076-eba5-4f1c-9c60-c08cd561c37e\") " pod="openshift-multus/multus-7j4hl"
Jul 06 12:47:05.798430 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.674119    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4189b076-eba5-4f1c-9c60-c08cd561c37e-cnibin\") pod \"multus-7j4hl\" (UID: \"4189b076-eba5-4f1c-9c60-c08cd561c37e\") " pod="openshift-multus/multus-7j4hl"
Jul 06 12:47:05.798430 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.674146    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4189b076-eba5-4f1c-9c60-c08cd561c37e-etc-kubernetes\") pod \"multus-7j4hl\" (UID: \"4189b076-eba5-4f1c-9c60-c08cd561c37e\") " pod="openshift-multus/multus-7j4hl"
Jul 06 12:47:05.798430 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.674158    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2f70de53-34f6-4a59-9a48-015ddec89a47-cnibin\") pod \"multus-additional-cni-plugins-frfnj\" (UID: \"2f70de53-34f6-4a59-9a48-015ddec89a47\") " pod="openshift-multus/multus-additional-cni-plugins-frfnj"
Jul 06 12:47:05.798967 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.674166    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2dc4171e-8076-4168-ac15-27daa9c4fdf2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-drgfv\" (UID: \"2dc4171e-8076-4168-ac15-27daa9c4fdf2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drgfv"
Jul 06 12:47:05.798967 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.674179    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tr7v\" (UniqueName: \"kubernetes.io/projected/4189b076-eba5-4f1c-9c60-c08cd561c37e-kube-api-access-6tr7v\") pod \"multus-7j4hl\" (UID: \"4189b076-eba5-4f1c-9c60-c08cd561c37e\") " pod="openshift-multus/multus-7j4hl"
Jul 06 12:47:05.798967 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.674188    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4189b076-eba5-4f1c-9c60-c08cd561c37e-multus-socket-dir-parent\") pod \"multus-7j4hl\" (UID: \"4189b076-eba5-4f1c-9c60-c08cd561c37e\") " pod="openshift-multus/multus-7j4hl"
Jul 06 12:47:05.798967 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.674207    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/824c3385-d7b5-42ff-8db7-8189f6015cca-run-systemd\") pod \"ovnkube-node-mp2mx\" (UID: \"824c3385-d7b5-42ff-8db7-8189f6015cca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp2mx"
Jul 06 12:47:05.798967 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.674253    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sp45q\" (UniqueName: \"kubernetes.io/projected/824c3385-d7b5-42ff-8db7-8189f6015cca-kube-api-access-sp45q\") pod \"ovnkube-node-mp2mx\" (UID: \"824c3385-d7b5-42ff-8db7-8189f6015cca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp2mx"
Jul 06 12:47:05.798967 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.674273    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/824c3385-d7b5-42ff-8db7-8189f6015cca-run-systemd\") pod \"ovnkube-node-mp2mx\" (UID: \"824c3385-d7b5-42ff-8db7-8189f6015cca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp2mx"
Jul 06 12:47:05.798967 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.674281    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4189b076-eba5-4f1c-9c60-c08cd561c37e-host-run-k8s-cni-cncf-io\") pod \"multus-7j4hl\" (UID: \"4189b076-eba5-4f1c-9c60-c08cd561c37e\") " pod="openshift-multus/multus-7j4hl"
Jul 06 12:47:05.798967 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.674316    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e61427e6-62cd-44b6-9f9a-5f3bd906d29a-hosts-file\") pod \"node-resolver-9jrvv\" (UID: \"e61427e6-62cd-44b6-9f9a-5f3bd906d29a\") " pod="openshift-dns/node-resolver-9jrvv"
Jul 06 12:47:05.798967 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.674324    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4189b076-eba5-4f1c-9c60-c08cd561c37e-host-run-k8s-cni-cncf-io\") pod \"multus-7j4hl\" (UID: \"4189b076-eba5-4f1c-9c60-c08cd561c37e\") " pod="openshift-multus/multus-7j4hl"
Jul 06 12:47:05.798967 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.674346    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4189b076-eba5-4f1c-9c60-c08cd561c37e-etc-kubernetes\") pod \"multus-7j4hl\" (UID: \"4189b076-eba5-4f1c-9c60-c08cd561c37e\") " pod="openshift-multus/multus-7j4hl"
Jul 06 12:47:05.798967 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.674342    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/824c3385-d7b5-42ff-8db7-8189f6015cca-log-socket\") pod \"ovnkube-node-mp2mx\" (UID: \"824c3385-d7b5-42ff-8db7-8189f6015cca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp2mx"
Jul 06 12:47:05.798967 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.674385    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w94k6\" (UniqueName: \"kubernetes.io/projected/e09437b4-0f91-4b6f-a017-784f7515276b-kube-api-access-w94k6\") pod \"node-ca-tr8t2\" (UID: \"e09437b4-0f91-4b6f-a017-784f7515276b\") " pod="openshift-image-registry/node-ca-tr8t2"
Jul 06 12:47:05.798967 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.674393    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/824c3385-d7b5-42ff-8db7-8189f6015cca-var-lib-openvswitch\") pod \"ovnkube-node-mp2mx\" (UID: \"824c3385-d7b5-42ff-8db7-8189f6015cca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp2mx"
Jul 06 12:47:05.798967 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.674427    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/824c3385-d7b5-42ff-8db7-8189f6015cca-log-socket\") pod \"ovnkube-node-mp2mx\" (UID: \"824c3385-d7b5-42ff-8db7-8189f6015cca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp2mx"
Jul 06 12:47:05.798967 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.674451    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4189b076-eba5-4f1c-9c60-c08cd561c37e-multus-cni-dir\") pod \"multus-7j4hl\" (UID: \"4189b076-eba5-4f1c-9c60-c08cd561c37e\") " pod="openshift-multus/multus-7j4hl"
Jul 06 12:47:05.799523 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.674460    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2f70de53-34f6-4a59-9a48-015ddec89a47-system-cni-dir\") pod \"multus-additional-cni-plugins-frfnj\" (UID: \"2f70de53-34f6-4a59-9a48-015ddec89a47\") " pod="openshift-multus/multus-additional-cni-plugins-frfnj"
Jul 06 12:47:05.799523 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.674484    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4189b076-eba5-4f1c-9c60-c08cd561c37e-os-release\") pod \"multus-7j4hl\" (UID: \"4189b076-eba5-4f1c-9c60-c08cd561c37e\") " pod="openshift-multus/multus-7j4hl"
Jul 06 12:47:05.799523 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.674517    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbfqs\" (UniqueName: \"kubernetes.io/projected/2f70de53-34f6-4a59-9a48-015ddec89a47-kube-api-access-fbfqs\") pod \"multus-additional-cni-plugins-frfnj\" (UID: \"2f70de53-34f6-4a59-9a48-015ddec89a47\") " pod="openshift-multus/multus-additional-cni-plugins-frfnj"
Jul 06 12:47:05.799523 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.674548    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3018c6ec-22c6-44ff-951a-5a9867fb4efd-host\") pod \"tuned-swjxd\" (UID: \"3018c6ec-22c6-44ff-951a-5a9867fb4efd\") " pod="openshift-cluster-node-tuning-operator/tuned-swjxd"
Jul 06 12:47:05.799523 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.674571    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4189b076-eba5-4f1c-9c60-c08cd561c37e-multus-cni-dir\") pod \"multus-7j4hl\" (UID: \"4189b076-eba5-4f1c-9c60-c08cd561c37e\") " pod="openshift-multus/multus-7j4hl"
Jul 06 12:47:05.799523 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.674591    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3018c6ec-22c6-44ff-951a-5a9867fb4efd-tmp\") pod \"tuned-swjxd\" (UID: \"3018c6ec-22c6-44ff-951a-5a9867fb4efd\") " pod="openshift-cluster-node-tuning-operator/tuned-swjxd"
Jul 06 12:47:05.799523 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.674624    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pc7x\" (UniqueName: \"kubernetes.io/projected/2e3e9cee-032c-466e-8808-9d91f3fe2fc5-kube-api-access-7pc7x\") pod \"network-check-target-xj4sm\" (UID: \"2e3e9cee-032c-466e-8808-9d91f3fe2fc5\") " pod="openshift-network-diagnostics/network-check-target-xj4sm"
Jul 06 12:47:05.799523 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.674619    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4189b076-eba5-4f1c-9c60-c08cd561c37e-os-release\") pod \"multus-7j4hl\" (UID: \"4189b076-eba5-4f1c-9c60-c08cd561c37e\") " pod="openshift-multus/multus-7j4hl"
Jul 06 12:47:05.799523 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.674790    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2dc4171e-8076-4168-ac15-27daa9c4fdf2-etc-selinux\") pod \"aws-ebs-csi-driver-node-drgfv\" (UID: \"2dc4171e-8076-4168-ac15-27daa9c4fdf2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drgfv"
Jul 06 12:47:05.799523 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.674859    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2f70de53-34f6-4a59-9a48-015ddec89a47-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-frfnj\" (UID: \"2f70de53-34f6-4a59-9a48-015ddec89a47\") " pod="openshift-multus/multus-additional-cni-plugins-frfnj"
Jul 06 12:47:05.799523 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.674903    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/824c3385-d7b5-42ff-8db7-8189f6015cca-node-log\") pod \"ovnkube-node-mp2mx\" (UID: \"824c3385-d7b5-42ff-8db7-8189f6015cca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp2mx"
Jul 06 12:47:05.799523 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.674946    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/824c3385-d7b5-42ff-8db7-8189f6015cca-host-cni-bin\") pod \"ovnkube-node-mp2mx\" (UID: \"824c3385-d7b5-42ff-8db7-8189f6015cca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp2mx"
Jul 06 12:47:05.799523 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.674970    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e09437b4-0f91-4b6f-a017-784f7515276b-host\") pod \"node-ca-tr8t2\" (UID: \"e09437b4-0f91-4b6f-a017-784f7515276b\") " pod="openshift-image-registry/node-ca-tr8t2"
Jul 06 12:47:05.799523 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.675010    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4189b076-eba5-4f1c-9c60-c08cd561c37e-host-var-lib-kubelet\") pod \"multus-7j4hl\" (UID: \"4189b076-eba5-4f1c-9c60-c08cd561c37e\") " pod="openshift-multus/multus-7j4hl"
Jul 06 12:47:05.800057 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.675070    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4189b076-eba5-4f1c-9c60-c08cd561c37e-hostroot\") pod \"multus-7j4hl\" (UID: \"4189b076-eba5-4f1c-9c60-c08cd561c37e\") " pod="openshift-multus/multus-7j4hl"
Jul 06 12:47:05.800057 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.675111    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4189b076-eba5-4f1c-9c60-c08cd561c37e-multus-conf-dir\") pod \"multus-7j4hl\" (UID: \"4189b076-eba5-4f1c-9c60-c08cd561c37e\") " pod="openshift-multus/multus-7j4hl"
Jul 06 12:47:05.800057 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.675138    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6dc153e6-3403-42ca-ae21-cd7056b3cb47-iptables-alerter-script\") pod \"iptables-alerter-hldtt\" (UID: \"6dc153e6-3403-42ca-ae21-cd7056b3cb47\") " pod="openshift-network-operator/iptables-alerter-hldtt"
Jul 06 12:47:05.800057 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.675172    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/824c3385-d7b5-42ff-8db7-8189f6015cca-node-log\") pod \"ovnkube-node-mp2mx\" (UID: \"824c3385-d7b5-42ff-8db7-8189f6015cca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp2mx"
Jul 06 12:47:05.800057 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.675210    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/da8ef940-6a0f-4692-9c14-6f58ae35e1e0-konnectivity-ca\") pod \"konnectivity-agent-6l9nm\" (UID: \"da8ef940-6a0f-4692-9c14-6f58ae35e1e0\") " pod="kube-system/konnectivity-agent-6l9nm"
Jul 06 12:47:05.800057 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.675221    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/824c3385-d7b5-42ff-8db7-8189f6015cca-host-cni-bin\") pod \"ovnkube-node-mp2mx\" (UID: \"824c3385-d7b5-42ff-8db7-8189f6015cca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp2mx"
Jul 06 12:47:05.800057 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.675259    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4189b076-eba5-4f1c-9c60-c08cd561c37e-host-var-lib-kubelet\") pod \"multus-7j4hl\" (UID: \"4189b076-eba5-4f1c-9c60-c08cd561c37e\") " pod="openshift-multus/multus-7j4hl"
Jul 06 12:47:05.800057 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.675248    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2dc4171e-8076-4168-ac15-27daa9c4fdf2-registration-dir\") pod \"aws-ebs-csi-driver-node-drgfv\" (UID: \"2dc4171e-8076-4168-ac15-27daa9c4fdf2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drgfv"
Jul 06 12:47:05.800057 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.675302    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4189b076-eba5-4f1c-9c60-c08cd561c37e-host-run-netns\") pod \"multus-7j4hl\" (UID: \"4189b076-eba5-4f1c-9c60-c08cd561c37e\") " pod="openshift-multus/multus-7j4hl"
Jul 06 12:47:05.800057 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.675315    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2dc4171e-8076-4168-ac15-27daa9c4fdf2-registration-dir\") pod \"aws-ebs-csi-driver-node-drgfv\" (UID: \"2dc4171e-8076-4168-ac15-27daa9c4fdf2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drgfv"
Jul 06 12:47:05.800057 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.675333    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4189b076-eba5-4f1c-9c60-c08cd561c37e-host-var-lib-cni-multus\") pod \"multus-7j4hl\" (UID: \"4189b076-eba5-4f1c-9c60-c08cd561c37e\") " pod="openshift-multus/multus-7j4hl"
Jul 06 12:47:05.800057 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.675394    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2f70de53-34f6-4a59-9a48-015ddec89a47-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-frfnj\" (UID: \"2f70de53-34f6-4a59-9a48-015ddec89a47\") " pod="openshift-multus/multus-additional-cni-plugins-frfnj"
Jul 06 12:47:05.800057 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.675416    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4189b076-eba5-4f1c-9c60-c08cd561c37e-host-run-netns\") pod \"multus-7j4hl\" (UID: \"4189b076-eba5-4f1c-9c60-c08cd561c37e\") " pod="openshift-multus/multus-7j4hl"
Jul 06 12:47:05.800057 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.675430    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2f70de53-34f6-4a59-9a48-015ddec89a47-cni-binary-copy\") pod \"multus-additional-cni-plugins-frfnj\" (UID: \"2f70de53-34f6-4a59-9a48-015ddec89a47\") " pod="openshift-multus/multus-additional-cni-plugins-frfnj"
Jul 06 12:47:05.800574 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.675407    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ph96h\" (UniqueName: \"kubernetes.io/projected/6dc153e6-3403-42ca-ae21-cd7056b3cb47-kube-api-access-ph96h\") pod \"iptables-alerter-hldtt\" (UID: \"6dc153e6-3403-42ca-ae21-cd7056b3cb47\") " pod="openshift-network-operator/iptables-alerter-hldtt"
Jul 06 12:47:05.800574 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.675466    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3018c6ec-22c6-44ff-951a-5a9867fb4efd-etc-sysctl-d\") pod \"tuned-swjxd\" (UID: \"3018c6ec-22c6-44ff-951a-5a9867fb4efd\") " pod="openshift-cluster-node-tuning-operator/tuned-swjxd"
Jul 06 12:47:05.800574 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.675477    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4189b076-eba5-4f1c-9c60-c08cd561c37e-host-var-lib-cni-multus\") pod \"multus-7j4hl\" (UID: \"4189b076-eba5-4f1c-9c60-c08cd561c37e\") " pod="openshift-multus/multus-7j4hl"
Jul 06 12:47:05.800574 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.675499    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2dc4171e-8076-4168-ac15-27daa9c4fdf2-etc-selinux\") pod \"aws-ebs-csi-driver-node-drgfv\" (UID: \"2dc4171e-8076-4168-ac15-27daa9c4fdf2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drgfv"
Jul 06 12:47:05.800574 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.675516    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4189b076-eba5-4f1c-9c60-c08cd561c37e-multus-conf-dir\") pod \"multus-7j4hl\" (UID: \"4189b076-eba5-4f1c-9c60-c08cd561c37e\") " pod="openshift-multus/multus-7j4hl"
Jul 06 12:47:05.800574 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.675492    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3018c6ec-22c6-44ff-951a-5a9867fb4efd-lib-modules\") pod \"tuned-swjxd\" (UID: \"3018c6ec-22c6-44ff-951a-5a9867fb4efd\") " pod="openshift-cluster-node-tuning-operator/tuned-swjxd"
Jul 06 12:47:05.800574 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.675552    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e09437b4-0f91-4b6f-a017-784f7515276b-host\") pod \"node-ca-tr8t2\" (UID: \"e09437b4-0f91-4b6f-a017-784f7515276b\") " pod="openshift-image-registry/node-ca-tr8t2"
Jul 06 12:47:05.800574 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.675637    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4189b076-eba5-4f1c-9c60-c08cd561c37e-hostroot\") pod \"multus-7j4hl\" (UID: \"4189b076-eba5-4f1c-9c60-c08cd561c37e\") " pod="openshift-multus/multus-7j4hl"
Jul 06 12:47:05.800574 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.675744    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2f70de53-34f6-4a59-9a48-015ddec89a47-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-frfnj\" (UID: \"2f70de53-34f6-4a59-9a48-015ddec89a47\") " pod="openshift-multus/multus-additional-cni-plugins-frfnj"
Jul 06 12:47:05.800574 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.675935    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e09437b4-0f91-4b6f-a017-784f7515276b-serviceca\") pod \"node-ca-tr8t2\" (UID: \"e09437b4-0f91-4b6f-a017-784f7515276b\") " pod="openshift-image-registry/node-ca-tr8t2"
Jul 06 12:47:05.800574 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.676359    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6dc153e6-3403-42ca-ae21-cd7056b3cb47-iptables-alerter-script\") pod \"iptables-alerter-hldtt\" (UID: \"6dc153e6-3403-42ca-ae21-cd7056b3cb47\") " pod="openshift-network-operator/iptables-alerter-hldtt"
Jul 06 12:47:05.800574 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.676649    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/824c3385-d7b5-42ff-8db7-8189f6015cca-ovnkube-script-lib\") pod \"ovnkube-node-mp2mx\" (UID: \"824c3385-d7b5-42ff-8db7-8189f6015cca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp2mx"
Jul 06 12:47:05.800574 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.676693    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2dc4171e-8076-4168-ac15-27daa9c4fdf2-socket-dir\") pod \"aws-ebs-csi-driver-node-drgfv\" (UID: \"2dc4171e-8076-4168-ac15-27daa9c4fdf2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drgfv"
Jul 06 12:47:05.800574 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.676718    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4189b076-eba5-4f1c-9c60-c08cd561c37e-system-cni-dir\") pod \"multus-7j4hl\" (UID: \"4189b076-eba5-4f1c-9c60-c08cd561c37e\") " pod="openshift-multus/multus-7j4hl"
Jul 06 12:47:05.800574 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.676817    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4189b076-eba5-4f1c-9c60-c08cd561c37e-system-cni-dir\") pod \"multus-7j4hl\" (UID: \"4189b076-eba5-4f1c-9c60-c08cd561c37e\") " pod="openshift-multus/multus-7j4hl"
Jul 06 12:47:05.801180 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.676843    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2dc4171e-8076-4168-ac15-27daa9c4fdf2-socket-dir\") pod \"aws-ebs-csi-driver-node-drgfv\" (UID: \"2dc4171e-8076-4168-ac15-27daa9c4fdf2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drgfv"
Jul 06 12:47:05.801180 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.676887    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4189b076-eba5-4f1c-9c60-c08cd561c37e-host-run-multus-certs\") pod \"multus-7j4hl\" (UID: \"4189b076-eba5-4f1c-9c60-c08cd561c37e\") " pod="openshift-multus/multus-7j4hl"
Jul 06 12:47:05.801180 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.676914    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/063b9802-bd30-43d5-8969-819da64e14b0-dbus\") pod \"global-pull-secret-syncer-vdbtk\" (UID: \"063b9802-bd30-43d5-8969-819da64e14b0\") " pod="kube-system/global-pull-secret-syncer-vdbtk"
Jul 06 12:47:05.801180 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.676934    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4189b076-eba5-4f1c-9c60-c08cd561c37e-host-run-multus-certs\") pod \"multus-7j4hl\" (UID: \"4189b076-eba5-4f1c-9c60-c08cd561c37e\") " pod="openshift-multus/multus-7j4hl"
Jul 06 12:47:05.801180 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.676946    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3018c6ec-22c6-44ff-951a-5a9867fb4efd-etc-kubernetes\") pod \"tuned-swjxd\" (UID: \"3018c6ec-22c6-44ff-951a-5a9867fb4efd\") " pod="openshift-cluster-node-tuning-operator/tuned-swjxd"
Jul 06 12:47:05.801180 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.676969    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3018c6ec-22c6-44ff-951a-5a9867fb4efd-var-lib-kubelet\") pod \"tuned-swjxd\" (UID: \"3018c6ec-22c6-44ff-951a-5a9867fb4efd\") " pod="openshift-cluster-node-tuning-operator/tuned-swjxd"
Jul 06 12:47:05.801180 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.676993    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/824c3385-d7b5-42ff-8db7-8189f6015cca-run-openvswitch\") pod \"ovnkube-node-mp2mx\" (UID: \"824c3385-d7b5-42ff-8db7-8189f6015cca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp2mx"
Jul 06 12:47:05.801180 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.677015    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/824c3385-d7b5-42ff-8db7-8189f6015cca-host-cni-netd\") pod \"ovnkube-node-mp2mx\" (UID: \"824c3385-d7b5-42ff-8db7-8189f6015cca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp2mx"
Jul 06 12:47:05.801180 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.677021    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/824c3385-d7b5-42ff-8db7-8189f6015cca-ovnkube-script-lib\") pod \"ovnkube-node-mp2mx\" (UID: \"824c3385-d7b5-42ff-8db7-8189f6015cca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp2mx"
Jul 06 12:47:05.801180 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.677075    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/824c3385-d7b5-42ff-8db7-8189f6015cca-run-openvswitch\") pod \"ovnkube-node-mp2mx\" (UID: \"824c3385-d7b5-42ff-8db7-8189f6015cca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp2mx"
Jul 06 12:47:05.801180 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.677084    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/824c3385-d7b5-42ff-8db7-8189f6015cca-host-cni-netd\") pod \"ovnkube-node-mp2mx\" (UID: \"824c3385-d7b5-42ff-8db7-8189f6015cca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp2mx"
Jul 06 12:47:05.801180 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.678689    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/824c3385-d7b5-42ff-8db7-8189f6015cca-ovn-node-metrics-cert\") pod \"ovnkube-node-mp2mx\" (UID: \"824c3385-d7b5-42ff-8db7-8189f6015cca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp2mx"
Jul 06 12:47:05.801180 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.687539    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pz5fq\" (UniqueName: \"kubernetes.io/projected/2dc4171e-8076-4168-ac15-27daa9c4fdf2-kube-api-access-pz5fq\") pod \"aws-ebs-csi-driver-node-drgfv\" (UID: \"2dc4171e-8076-4168-ac15-27daa9c4fdf2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drgfv"
Jul 06 12:47:05.801180 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.689806    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbjgr\" (UniqueName: \"kubernetes.io/projected/efc0433a-6604-414a-b029-97f8b1075928-kube-api-access-xbjgr\") pod \"network-metrics-daemon-nhdrh\" (UID: \"efc0433a-6604-414a-b029-97f8b1075928\") " pod="openshift-multus/network-metrics-daemon-nhdrh"
Jul 06 12:47:05.801180 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:05.692632    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 12:47:05.801727 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:05.692648    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 12:47:05.801727 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:05.692660    2579 projected.go:196] Error preparing data for projected volume kube-api-access-7pc7x for pod openshift-network-diagnostics/network-check-target-xj4sm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 12:47:05.801727 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:05.692727    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2e3e9cee-032c-466e-8808-9d91f3fe2fc5-kube-api-access-7pc7x podName:2e3e9cee-032c-466e-8808-9d91f3fe2fc5 nodeName:}" failed. No retries permitted until 2026-07-06 12:47:06.192711589 +0000 UTC m=+3.061599228 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-7pc7x" (UniqueName: "kubernetes.io/projected/2e3e9cee-032c-466e-8808-9d91f3fe2fc5-kube-api-access-7pc7x") pod "network-check-target-xj4sm" (UID: "2e3e9cee-032c-466e-8808-9d91f3fe2fc5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 12:47:05.801727 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.694659    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbfqs\" (UniqueName: \"kubernetes.io/projected/2f70de53-34f6-4a59-9a48-015ddec89a47-kube-api-access-fbfqs\") pod \"multus-additional-cni-plugins-frfnj\" (UID: \"2f70de53-34f6-4a59-9a48-015ddec89a47\") " pod="openshift-multus/multus-additional-cni-plugins-frfnj"
Jul 06 12:47:05.801727 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.698199    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sp45q\" (UniqueName: \"kubernetes.io/projected/824c3385-d7b5-42ff-8db7-8189f6015cca-kube-api-access-sp45q\") pod \"ovnkube-node-mp2mx\" (UID: \"824c3385-d7b5-42ff-8db7-8189f6015cca\") " pod="openshift-ovn-kubernetes/ovnkube-node-mp2mx"
Jul 06 12:47:05.801727 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.699592    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w94k6\" (UniqueName: \"kubernetes.io/projected/e09437b4-0f91-4b6f-a017-784f7515276b-kube-api-access-w94k6\") pod \"node-ca-tr8t2\" (UID: \"e09437b4-0f91-4b6f-a017-784f7515276b\") " pod="openshift-image-registry/node-ca-tr8t2"
Jul 06 12:47:05.801727 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.700219    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ph96h\" (UniqueName: \"kubernetes.io/projected/6dc153e6-3403-42ca-ae21-cd7056b3cb47-kube-api-access-ph96h\") pod \"iptables-alerter-hldtt\" (UID: \"6dc153e6-3403-42ca-ae21-cd7056b3cb47\") " pod="openshift-network-operator/iptables-alerter-hldtt"
Jul 06 12:47:05.801727 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.700325    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tr7v\" (UniqueName: \"kubernetes.io/projected/4189b076-eba5-4f1c-9c60-c08cd561c37e-kube-api-access-6tr7v\") pod \"multus-7j4hl\" (UID: \"4189b076-eba5-4f1c-9c60-c08cd561c37e\") " pod="openshift-multus/multus-7j4hl"
Jul 06 12:47:05.801727 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.752991    2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 12:47:05.801727 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.777599    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e61427e6-62cd-44b6-9f9a-5f3bd906d29a-hosts-file\") pod \"node-resolver-9jrvv\" (UID: \"e61427e6-62cd-44b6-9f9a-5f3bd906d29a\") " pod="openshift-dns/node-resolver-9jrvv"
Jul 06 12:47:05.801727 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.777626    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3018c6ec-22c6-44ff-951a-5a9867fb4efd-host\") pod \"tuned-swjxd\" (UID: \"3018c6ec-22c6-44ff-951a-5a9867fb4efd\") " pod="openshift-cluster-node-tuning-operator/tuned-swjxd"
Jul 06 12:47:05.801727 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.777648    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3018c6ec-22c6-44ff-951a-5a9867fb4efd-tmp\") pod \"tuned-swjxd\" (UID: \"3018c6ec-22c6-44ff-951a-5a9867fb4efd\") " pod="openshift-cluster-node-tuning-operator/tuned-swjxd"
Jul 06 12:47:05.801727 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.777685    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/da8ef940-6a0f-4692-9c14-6f58ae35e1e0-konnectivity-ca\") pod \"konnectivity-agent-6l9nm\" (UID: \"da8ef940-6a0f-4692-9c14-6f58ae35e1e0\") " pod="kube-system/konnectivity-agent-6l9nm"
Jul 06 12:47:05.801727 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.777708    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3018c6ec-22c6-44ff-951a-5a9867fb4efd-etc-sysctl-d\") pod \"tuned-swjxd\" (UID: \"3018c6ec-22c6-44ff-951a-5a9867fb4efd\") " pod="openshift-cluster-node-tuning-operator/tuned-swjxd"
Jul 06 12:47:05.802224 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.777707    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e61427e6-62cd-44b6-9f9a-5f3bd906d29a-hosts-file\") pod \"node-resolver-9jrvv\" (UID: \"e61427e6-62cd-44b6-9f9a-5f3bd906d29a\") " pod="openshift-dns/node-resolver-9jrvv"
Jul 06 12:47:05.802224 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.777726    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3018c6ec-22c6-44ff-951a-5a9867fb4efd-lib-modules\") pod \"tuned-swjxd\" (UID: \"3018c6ec-22c6-44ff-951a-5a9867fb4efd\") " pod="openshift-cluster-node-tuning-operator/tuned-swjxd"
Jul 06 12:47:05.802224 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.777732    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3018c6ec-22c6-44ff-951a-5a9867fb4efd-host\") pod \"tuned-swjxd\" (UID: \"3018c6ec-22c6-44ff-951a-5a9867fb4efd\") " pod="openshift-cluster-node-tuning-operator/tuned-swjxd"
Jul 06 12:47:05.802224 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.777749    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/063b9802-bd30-43d5-8969-819da64e14b0-dbus\") pod \"global-pull-secret-syncer-vdbtk\" (UID: \"063b9802-bd30-43d5-8969-819da64e14b0\") " pod="kube-system/global-pull-secret-syncer-vdbtk"
Jul 06 12:47:05.802224 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.777771    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3018c6ec-22c6-44ff-951a-5a9867fb4efd-etc-kubernetes\") pod \"tuned-swjxd\" (UID: \"3018c6ec-22c6-44ff-951a-5a9867fb4efd\") " pod="openshift-cluster-node-tuning-operator/tuned-swjxd"
Jul 06 12:47:05.802224 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.777791    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3018c6ec-22c6-44ff-951a-5a9867fb4efd-var-lib-kubelet\") pod \"tuned-swjxd\" (UID: \"3018c6ec-22c6-44ff-951a-5a9867fb4efd\") " pod="openshift-cluster-node-tuning-operator/tuned-swjxd"
Jul 06 12:47:05.802224 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.777823    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/063b9802-bd30-43d5-8969-819da64e14b0-kubelet-config\") pod \"global-pull-secret-syncer-vdbtk\" (UID: \"063b9802-bd30-43d5-8969-819da64e14b0\") " pod="kube-system/global-pull-secret-syncer-vdbtk"
Jul 06 12:47:05.802224 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.777843    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3018c6ec-22c6-44ff-951a-5a9867fb4efd-etc-modprobe-d\") pod \"tuned-swjxd\" (UID: \"3018c6ec-22c6-44ff-951a-5a9867fb4efd\") " pod="openshift-cluster-node-tuning-operator/tuned-swjxd"
Jul 06 12:47:05.802224 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.777861    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3018c6ec-22c6-44ff-951a-5a9867fb4efd-etc-sysconfig\") pod \"tuned-swjxd\" (UID: \"3018c6ec-22c6-44ff-951a-5a9867fb4efd\") " pod="openshift-cluster-node-tuning-operator/tuned-swjxd"
Jul 06 12:47:05.802224 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.777899    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ff4w2\" (UniqueName: \"kubernetes.io/projected/3018c6ec-22c6-44ff-951a-5a9867fb4efd-kube-api-access-ff4w2\") pod \"tuned-swjxd\" (UID: \"3018c6ec-22c6-44ff-951a-5a9867fb4efd\") " pod="openshift-cluster-node-tuning-operator/tuned-swjxd"
Jul 06 12:47:05.802224 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.777919    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3018c6ec-22c6-44ff-951a-5a9867fb4efd-etc-kubernetes\") pod \"tuned-swjxd\" (UID: \"3018c6ec-22c6-44ff-951a-5a9867fb4efd\") " pod="openshift-cluster-node-tuning-operator/tuned-swjxd"
Jul 06 12:47:05.802224 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.777924    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/da8ef940-6a0f-4692-9c14-6f58ae35e1e0-agent-certs\") pod \"konnectivity-agent-6l9nm\" (UID: \"da8ef940-6a0f-4692-9c14-6f58ae35e1e0\") " pod="kube-system/konnectivity-agent-6l9nm"
Jul 06 12:47:05.802224 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.777968    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e61427e6-62cd-44b6-9f9a-5f3bd906d29a-tmp-dir\") pod \"node-resolver-9jrvv\" (UID: \"e61427e6-62cd-44b6-9f9a-5f3bd906d29a\") " pod="openshift-dns/node-resolver-9jrvv"
Jul 06 12:47:05.802224 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.778006    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/063b9802-bd30-43d5-8969-819da64e14b0-original-pull-secret\") pod \"global-pull-secret-syncer-vdbtk\" (UID: \"063b9802-bd30-43d5-8969-819da64e14b0\") " pod="kube-system/global-pull-secret-syncer-vdbtk"
Jul 06 12:47:05.802224 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.778032    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3018c6ec-22c6-44ff-951a-5a9867fb4efd-etc-tuned\") pod \"tuned-swjxd\" (UID: \"3018c6ec-22c6-44ff-951a-5a9867fb4efd\") " pod="openshift-cluster-node-tuning-operator/tuned-swjxd"
Jul 06 12:47:05.802660 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.778057    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kq7c\" (UniqueName: \"kubernetes.io/projected/e61427e6-62cd-44b6-9f9a-5f3bd906d29a-kube-api-access-6kq7c\") pod \"node-resolver-9jrvv\" (UID: \"e61427e6-62cd-44b6-9f9a-5f3bd906d29a\") " pod="openshift-dns/node-resolver-9jrvv"
Jul 06 12:47:05.802660 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.778083    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3018c6ec-22c6-44ff-951a-5a9867fb4efd-etc-systemd\") pod \"tuned-swjxd\" (UID: \"3018c6ec-22c6-44ff-951a-5a9867fb4efd\") " pod="openshift-cluster-node-tuning-operator/tuned-swjxd"
Jul 06 12:47:05.802660 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.778107    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3018c6ec-22c6-44ff-951a-5a9867fb4efd-sys\") pod \"tuned-swjxd\" (UID: \"3018c6ec-22c6-44ff-951a-5a9867fb4efd\") " pod="openshift-cluster-node-tuning-operator/tuned-swjxd"
Jul 06 12:47:05.802660 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.778139    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3018c6ec-22c6-44ff-951a-5a9867fb4efd-etc-sysctl-conf\") pod \"tuned-swjxd\" (UID: \"3018c6ec-22c6-44ff-951a-5a9867fb4efd\") " pod="openshift-cluster-node-tuning-operator/tuned-swjxd"
Jul 06 12:47:05.802660 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.778165    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3018c6ec-22c6-44ff-951a-5a9867fb4efd-run\") pod \"tuned-swjxd\" (UID: \"3018c6ec-22c6-44ff-951a-5a9867fb4efd\") " pod="openshift-cluster-node-tuning-operator/tuned-swjxd"
Jul 06 12:47:05.802660 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.778188    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3018c6ec-22c6-44ff-951a-5a9867fb4efd-etc-modprobe-d\") pod \"tuned-swjxd\" (UID: \"3018c6ec-22c6-44ff-951a-5a9867fb4efd\") " pod="openshift-cluster-node-tuning-operator/tuned-swjxd"
Jul 06 12:47:05.802660 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.778242    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3018c6ec-22c6-44ff-951a-5a9867fb4efd-run\") pod \"tuned-swjxd\" (UID: \"3018c6ec-22c6-44ff-951a-5a9867fb4efd\") " pod="openshift-cluster-node-tuning-operator/tuned-swjxd"
Jul 06 12:47:05.802660 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.778256    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3018c6ec-22c6-44ff-951a-5a9867fb4efd-var-lib-kubelet\") pod \"tuned-swjxd\" (UID: \"3018c6ec-22c6-44ff-951a-5a9867fb4efd\") " pod="openshift-cluster-node-tuning-operator/tuned-swjxd"
Jul 06 12:47:05.802660 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.778301    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/063b9802-bd30-43d5-8969-819da64e14b0-kubelet-config\") pod \"global-pull-secret-syncer-vdbtk\" (UID: \"063b9802-bd30-43d5-8969-819da64e14b0\") " pod="kube-system/global-pull-secret-syncer-vdbtk"
Jul 06 12:47:05.802660 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.778351    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3018c6ec-22c6-44ff-951a-5a9867fb4efd-lib-modules\") pod \"tuned-swjxd\" (UID: \"3018c6ec-22c6-44ff-951a-5a9867fb4efd\") " pod="openshift-cluster-node-tuning-operator/tuned-swjxd"
Jul 06 12:47:05.802660 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.778388    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/da8ef940-6a0f-4692-9c14-6f58ae35e1e0-konnectivity-ca\") pod \"konnectivity-agent-6l9nm\" (UID: \"da8ef940-6a0f-4692-9c14-6f58ae35e1e0\") " pod="kube-system/konnectivity-agent-6l9nm"
Jul 06 12:47:05.802660 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.778464    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3018c6ec-22c6-44ff-951a-5a9867fb4efd-etc-sysconfig\") pod \"tuned-swjxd\" (UID: \"3018c6ec-22c6-44ff-951a-5a9867fb4efd\") " pod="openshift-cluster-node-tuning-operator/tuned-swjxd"
Jul 06 12:47:05.802660 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.777869    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3018c6ec-22c6-44ff-951a-5a9867fb4efd-etc-sysctl-d\") pod \"tuned-swjxd\" (UID: \"3018c6ec-22c6-44ff-951a-5a9867fb4efd\") " pod="openshift-cluster-node-tuning-operator/tuned-swjxd"
Jul 06 12:47:05.802660 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.778597    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3018c6ec-22c6-44ff-951a-5a9867fb4efd-etc-systemd\") pod \"tuned-swjxd\" (UID: \"3018c6ec-22c6-44ff-951a-5a9867fb4efd\") " pod="openshift-cluster-node-tuning-operator/tuned-swjxd"
Jul 06 12:47:05.802660 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.778650    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3018c6ec-22c6-44ff-951a-5a9867fb4efd-sys\") pod \"tuned-swjxd\" (UID: \"3018c6ec-22c6-44ff-951a-5a9867fb4efd\") " pod="openshift-cluster-node-tuning-operator/tuned-swjxd"
Jul 06 12:47:05.803106 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:05.778725    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 12:47:05.803106 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.778727    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3018c6ec-22c6-44ff-951a-5a9867fb4efd-etc-sysctl-conf\") pod \"tuned-swjxd\" (UID: \"3018c6ec-22c6-44ff-951a-5a9867fb4efd\") " pod="openshift-cluster-node-tuning-operator/tuned-swjxd"
Jul 06 12:47:05.803106 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.778771    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e61427e6-62cd-44b6-9f9a-5f3bd906d29a-tmp-dir\") pod \"node-resolver-9jrvv\" (UID: \"e61427e6-62cd-44b6-9f9a-5f3bd906d29a\") " pod="openshift-dns/node-resolver-9jrvv"
Jul 06 12:47:05.803106 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.778814    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/063b9802-bd30-43d5-8969-819da64e14b0-dbus\") pod \"global-pull-secret-syncer-vdbtk\" (UID: \"063b9802-bd30-43d5-8969-819da64e14b0\") " pod="kube-system/global-pull-secret-syncer-vdbtk"
Jul 06 12:47:05.803106 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:05.778828    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/063b9802-bd30-43d5-8969-819da64e14b0-original-pull-secret podName:063b9802-bd30-43d5-8969-819da64e14b0 nodeName:}" failed. No retries permitted until 2026-07-06 12:47:06.278810479 +0000 UTC m=+3.147698132 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/063b9802-bd30-43d5-8969-819da64e14b0-original-pull-secret") pod "global-pull-secret-syncer-vdbtk" (UID: "063b9802-bd30-43d5-8969-819da64e14b0") : object "kube-system"/"original-pull-secret" not registered
Jul 06 12:47:05.803106 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.779967    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3018c6ec-22c6-44ff-951a-5a9867fb4efd-tmp\") pod \"tuned-swjxd\" (UID: \"3018c6ec-22c6-44ff-951a-5a9867fb4efd\") " pod="openshift-cluster-node-tuning-operator/tuned-swjxd"
Jul 06 12:47:05.803106 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.780315    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3018c6ec-22c6-44ff-951a-5a9867fb4efd-etc-tuned\") pod \"tuned-swjxd\" (UID: \"3018c6ec-22c6-44ff-951a-5a9867fb4efd\") " pod="openshift-cluster-node-tuning-operator/tuned-swjxd"
Jul 06 12:47:05.803106 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.780644    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/da8ef940-6a0f-4692-9c14-6f58ae35e1e0-agent-certs\") pod \"konnectivity-agent-6l9nm\" (UID: \"da8ef940-6a0f-4692-9c14-6f58ae35e1e0\") " pod="kube-system/konnectivity-agent-6l9nm"
Jul 06 12:47:05.803106 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.791911    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kq7c\" (UniqueName: \"kubernetes.io/projected/e61427e6-62cd-44b6-9f9a-5f3bd906d29a-kube-api-access-6kq7c\") pod \"node-resolver-9jrvv\" (UID: \"e61427e6-62cd-44b6-9f9a-5f3bd906d29a\") " pod="openshift-dns/node-resolver-9jrvv"
Jul 06 12:47:05.803106 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.793417    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ff4w2\" (UniqueName: \"kubernetes.io/projected/3018c6ec-22c6-44ff-951a-5a9867fb4efd-kube-api-access-ff4w2\") pod \"tuned-swjxd\" (UID: \"3018c6ec-22c6-44ff-951a-5a9867fb4efd\") " pod="openshift-cluster-node-tuning-operator/tuned-swjxd"
Jul 06 12:47:05.862951 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:05.862918    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb09a290c651e1aea4d449f3ffc2514d4.slice/crio-c518eb35293b4560bbdd15b2511bfe13711a37bb9e51581fac1e774c2f8488a9 WatchSource:0}: Error finding container c518eb35293b4560bbdd15b2511bfe13711a37bb9e51581fac1e774c2f8488a9: Status 404 returned error can't find the container with id c518eb35293b4560bbdd15b2511bfe13711a37bb9e51581fac1e774c2f8488a9
Jul 06 12:47:05.867652 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.867636    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 12:47:05.877048 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.877026    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7j4hl"
Jul 06 12:47:05.881136 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.881119    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-frfnj"
Jul 06 12:47:05.888153 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.888133    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hldtt"
Jul 06 12:47:05.889455 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:05.889431    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4189b076_eba5_4f1c_9c60_c08cd561c37e.slice/crio-c1c7199830176addea54a0164c0a1ba921a2264789f420cd47ada382d130c3e8 WatchSource:0}: Error finding container c1c7199830176addea54a0164c0a1ba921a2264789f420cd47ada382d130c3e8: Status 404 returned error can't find the container with id c1c7199830176addea54a0164c0a1ba921a2264789f420cd47ada382d130c3e8
Jul 06 12:47:05.892491 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:05.892309    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f70de53_34f6_4a59_9a48_015ddec89a47.slice/crio-82fbf153a95f82989dc1aa68c19003fb836e15bd7aeba549efbd3ae47f3aa73b WatchSource:0}: Error finding container 82fbf153a95f82989dc1aa68c19003fb836e15bd7aeba549efbd3ae47f3aa73b: Status 404 returned error can't find the container with id 82fbf153a95f82989dc1aa68c19003fb836e15bd7aeba549efbd3ae47f3aa73b
Jul 06 12:47:05.895177 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.895158    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drgfv"
Jul 06 12:47:05.900215 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:05.900191    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dc153e6_3403_42ca_ae21_cd7056b3cb47.slice/crio-4113c3b0cfa6e25086bb30e42e37e846c471c1713ecc0539dd9d95554a3f5b86 WatchSource:0}: Error finding container 4113c3b0cfa6e25086bb30e42e37e846c471c1713ecc0539dd9d95554a3f5b86: Status 404 returned error can't find the container with id 4113c3b0cfa6e25086bb30e42e37e846c471c1713ecc0539dd9d95554a3f5b86
Jul 06 12:47:05.902186 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.902167    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tr8t2"
Jul 06 12:47:05.907179 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:05.907159    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dc4171e_8076_4168_ac15_27daa9c4fdf2.slice/crio-d998738b348bf88df80fdb336db74b3c47f72a67448fc70056859ef452b8bb3a WatchSource:0}: Error finding container d998738b348bf88df80fdb336db74b3c47f72a67448fc70056859ef452b8bb3a: Status 404 returned error can't find the container with id d998738b348bf88df80fdb336db74b3c47f72a67448fc70056859ef452b8bb3a
Jul 06 12:47:05.909326 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.908978    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mp2mx"
Jul 06 12:47:05.912281 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:05.912258    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode09437b4_0f91_4b6f_a017_784f7515276b.slice/crio-08787baac42fb4d9b3fc27dea54cf99440df195dc466157e141d5adc3ace6ff0 WatchSource:0}: Error finding container 08787baac42fb4d9b3fc27dea54cf99440df195dc466157e141d5adc3ace6ff0: Status 404 returned error can't find the container with id 08787baac42fb4d9b3fc27dea54cf99440df195dc466157e141d5adc3ace6ff0
Jul 06 12:47:05.916181 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.916160    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6l9nm"
Jul 06 12:47:05.918798 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:05.918777    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod824c3385_d7b5_42ff_8db7_8189f6015cca.slice/crio-c0ec114b8f8bdd34de591ccfd35c1eb762a8d87e6df0b5ad01b0e25e1cf0b7d1 WatchSource:0}: Error finding container c0ec114b8f8bdd34de591ccfd35c1eb762a8d87e6df0b5ad01b0e25e1cf0b7d1: Status 404 returned error can't find the container with id c0ec114b8f8bdd34de591ccfd35c1eb762a8d87e6df0b5ad01b0e25e1cf0b7d1
Jul 06 12:47:05.924063 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.923882    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-swjxd"
Jul 06 12:47:05.925824 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:05.925803    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda8ef940_6a0f_4692_9c14_6f58ae35e1e0.slice/crio-f85c1b158a2abff38d9f4a2c4cc0a4217b00e58000a0bcef26b34fa62cf14396 WatchSource:0}: Error finding container f85c1b158a2abff38d9f4a2c4cc0a4217b00e58000a0bcef26b34fa62cf14396: Status 404 returned error can't find the container with id f85c1b158a2abff38d9f4a2c4cc0a4217b00e58000a0bcef26b34fa62cf14396
Jul 06 12:47:05.929278 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:05.929259    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9jrvv"
Jul 06 12:47:05.933574 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:05.933527    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3018c6ec_22c6_44ff_951a_5a9867fb4efd.slice/crio-2f5ddc7079fe2ff2d9ca44fe785ecb9a2f8104c76d01d17600ba6cc8ab4fc930 WatchSource:0}: Error finding container 2f5ddc7079fe2ff2d9ca44fe785ecb9a2f8104c76d01d17600ba6cc8ab4fc930: Status 404 returned error can't find the container with id 2f5ddc7079fe2ff2d9ca44fe785ecb9a2f8104c76d01d17600ba6cc8ab4fc930
Jul 06 12:47:05.939586 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:05.939558    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode61427e6_62cd_44b6_9f9a_5f3bd906d29a.slice/crio-cac6eba2e727054a236a4f5f84d12e6ad96ea25dae807b7a33a1131bd6d49187 WatchSource:0}: Error finding container cac6eba2e727054a236a4f5f84d12e6ad96ea25dae807b7a33a1131bd6d49187: Status 404 returned error can't find the container with id cac6eba2e727054a236a4f5f84d12e6ad96ea25dae807b7a33a1131bd6d49187
Jul 06 12:47:06.181893 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:06.181807    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/efc0433a-6604-414a-b029-97f8b1075928-metrics-certs\") pod \"network-metrics-daemon-nhdrh\" (UID: \"efc0433a-6604-414a-b029-97f8b1075928\") " pod="openshift-multus/network-metrics-daemon-nhdrh"
Jul 06 12:47:06.182031 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:06.181971    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 12:47:06.182101 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:06.182042    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/efc0433a-6604-414a-b029-97f8b1075928-metrics-certs podName:efc0433a-6604-414a-b029-97f8b1075928 nodeName:}" failed. No retries permitted until 2026-07-06 12:47:07.182019206 +0000 UTC m=+4.050906851 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/efc0433a-6604-414a-b029-97f8b1075928-metrics-certs") pod "network-metrics-daemon-nhdrh" (UID: "efc0433a-6604-414a-b029-97f8b1075928") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 12:47:06.188195 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:06.188161    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f88e660f9398535f6ba4e54f660d4b7.slice/crio-4fa1c17c9d92fbdf693cbe28131ca38275258b5f0ca6ebb34ac34f7172ac9b83 WatchSource:0}: Error finding container 4fa1c17c9d92fbdf693cbe28131ca38275258b5f0ca6ebb34ac34f7172ac9b83: Status 404 returned error can't find the container with id 4fa1c17c9d92fbdf693cbe28131ca38275258b5f0ca6ebb34ac34f7172ac9b83
Jul 06 12:47:06.282095 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:06.282072    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/063b9802-bd30-43d5-8969-819da64e14b0-original-pull-secret\") pod \"global-pull-secret-syncer-vdbtk\" (UID: \"063b9802-bd30-43d5-8969-819da64e14b0\") " pod="kube-system/global-pull-secret-syncer-vdbtk"
Jul 06 12:47:06.282198 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:06.282109    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 12:47:06.282198 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:06.282150    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pc7x\" (UniqueName: \"kubernetes.io/projected/2e3e9cee-032c-466e-8808-9d91f3fe2fc5-kube-api-access-7pc7x\") pod \"network-check-target-xj4sm\" (UID: \"2e3e9cee-032c-466e-8808-9d91f3fe2fc5\") " pod="openshift-network-diagnostics/network-check-target-xj4sm"
Jul 06 12:47:06.282198 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:06.282164    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/063b9802-bd30-43d5-8969-819da64e14b0-original-pull-secret podName:063b9802-bd30-43d5-8969-819da64e14b0 nodeName:}" failed. No retries permitted until 2026-07-06 12:47:07.282144891 +0000 UTC m=+4.151032529 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/063b9802-bd30-43d5-8969-819da64e14b0-original-pull-secret") pod "global-pull-secret-syncer-vdbtk" (UID: "063b9802-bd30-43d5-8969-819da64e14b0") : object "kube-system"/"original-pull-secret" not registered
Jul 06 12:47:06.282945 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:06.282481    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 12:47:06.282945 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:06.282518    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 12:47:06.282945 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:06.282531    2579 projected.go:196] Error preparing data for projected volume kube-api-access-7pc7x for pod openshift-network-diagnostics/network-check-target-xj4sm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 12:47:06.282945 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:06.282587    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2e3e9cee-032c-466e-8808-9d91f3fe2fc5-kube-api-access-7pc7x podName:2e3e9cee-032c-466e-8808-9d91f3fe2fc5 nodeName:}" failed. No retries permitted until 2026-07-06 12:47:07.282571339 +0000 UTC m=+4.151458994 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-7pc7x" (UniqueName: "kubernetes.io/projected/2e3e9cee-032c-466e-8808-9d91f3fe2fc5-kube-api-access-7pc7x") pod "network-check-target-xj4sm" (UID: "2e3e9cee-032c-466e-8808-9d91f3fe2fc5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 12:47:06.619991 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:06.619301    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 12:42:06 +0000 UTC" deadline="2028-03-14 17:32:50.558313126 +0000 UTC"
Jul 06 12:47:06.619991 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:06.619374    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14812h45m43.938944443s"
Jul 06 12:47:06.649137 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:06.649103    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xj4sm"
Jul 06 12:47:06.649297 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:06.649237    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xj4sm" podUID="2e3e9cee-032c-466e-8808-9d91f3fe2fc5"
Jul 06 12:47:06.850906 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:06.850819    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drgfv" event={"ID":"2dc4171e-8076-4168-ac15-27daa9c4fdf2","Type":"ContainerStarted","Data":"d998738b348bf88df80fdb336db74b3c47f72a67448fc70056859ef452b8bb3a"}
Jul 06 12:47:06.853153 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:06.853120    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hldtt" event={"ID":"6dc153e6-3403-42ca-ae21-cd7056b3cb47","Type":"ContainerStarted","Data":"4113c3b0cfa6e25086bb30e42e37e846c471c1713ecc0539dd9d95554a3f5b86"}
Jul 06 12:47:06.866762 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:06.866598    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-126.ec2.internal" event={"ID":"b09a290c651e1aea4d449f3ffc2514d4","Type":"ContainerStarted","Data":"c518eb35293b4560bbdd15b2511bfe13711a37bb9e51581fac1e774c2f8488a9"}
Jul 06 12:47:06.880561 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:06.880494    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-126.ec2.internal" event={"ID":"9f88e660f9398535f6ba4e54f660d4b7","Type":"ContainerStarted","Data":"4fa1c17c9d92fbdf693cbe28131ca38275258b5f0ca6ebb34ac34f7172ac9b83"}
Jul 06 12:47:06.890682 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:06.890651    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9jrvv" event={"ID":"e61427e6-62cd-44b6-9f9a-5f3bd906d29a","Type":"ContainerStarted","Data":"cac6eba2e727054a236a4f5f84d12e6ad96ea25dae807b7a33a1131bd6d49187"}
Jul 06 12:47:06.912824 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:06.912786    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-swjxd" event={"ID":"3018c6ec-22c6-44ff-951a-5a9867fb4efd","Type":"ContainerStarted","Data":"2f5ddc7079fe2ff2d9ca44fe785ecb9a2f8104c76d01d17600ba6cc8ab4fc930"}
Jul 06 12:47:06.922668 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:06.922639    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6l9nm" event={"ID":"da8ef940-6a0f-4692-9c14-6f58ae35e1e0","Type":"ContainerStarted","Data":"f85c1b158a2abff38d9f4a2c4cc0a4217b00e58000a0bcef26b34fa62cf14396"}
Jul 06 12:47:06.933083 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:06.932896    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mp2mx" event={"ID":"824c3385-d7b5-42ff-8db7-8189f6015cca","Type":"ContainerStarted","Data":"c0ec114b8f8bdd34de591ccfd35c1eb762a8d87e6df0b5ad01b0e25e1cf0b7d1"}
Jul 06 12:47:06.969148 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:06.969120    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-frfnj" event={"ID":"2f70de53-34f6-4a59-9a48-015ddec89a47","Type":"ContainerStarted","Data":"82fbf153a95f82989dc1aa68c19003fb836e15bd7aeba549efbd3ae47f3aa73b"}
Jul 06 12:47:06.981933 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:06.981704    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7j4hl" event={"ID":"4189b076-eba5-4f1c-9c60-c08cd561c37e","Type":"ContainerStarted","Data":"c1c7199830176addea54a0164c0a1ba921a2264789f420cd47ada382d130c3e8"}
Jul 06 12:47:07.004410 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:07.004376    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tr8t2" event={"ID":"e09437b4-0f91-4b6f-a017-784f7515276b","Type":"ContainerStarted","Data":"08787baac42fb4d9b3fc27dea54cf99440df195dc466157e141d5adc3ace6ff0"}
Jul 06 12:47:07.029868 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:07.029838    2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 12:47:07.194389 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:07.194294    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/efc0433a-6604-414a-b029-97f8b1075928-metrics-certs\") pod \"network-metrics-daemon-nhdrh\" (UID: \"efc0433a-6604-414a-b029-97f8b1075928\") " pod="openshift-multus/network-metrics-daemon-nhdrh"
Jul 06 12:47:07.194560 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:07.194490    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 12:47:07.194560 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:07.194559    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/efc0433a-6604-414a-b029-97f8b1075928-metrics-certs podName:efc0433a-6604-414a-b029-97f8b1075928 nodeName:}" failed. No retries permitted until 2026-07-06 12:47:09.19454048 +0000 UTC m=+6.063428123 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/efc0433a-6604-414a-b029-97f8b1075928-metrics-certs") pod "network-metrics-daemon-nhdrh" (UID: "efc0433a-6604-414a-b029-97f8b1075928") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 12:47:07.294910 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:07.294874    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/063b9802-bd30-43d5-8969-819da64e14b0-original-pull-secret\") pod \"global-pull-secret-syncer-vdbtk\" (UID: \"063b9802-bd30-43d5-8969-819da64e14b0\") " pod="kube-system/global-pull-secret-syncer-vdbtk"
Jul 06 12:47:07.295121 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:07.294937    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pc7x\" (UniqueName: \"kubernetes.io/projected/2e3e9cee-032c-466e-8808-9d91f3fe2fc5-kube-api-access-7pc7x\") pod \"network-check-target-xj4sm\" (UID: \"2e3e9cee-032c-466e-8808-9d91f3fe2fc5\") " pod="openshift-network-diagnostics/network-check-target-xj4sm"
Jul 06 12:47:07.295190 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:07.295130    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 12:47:07.295190 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:07.295154    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 12:47:07.295190 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:07.295169    2579 projected.go:196] Error preparing data for projected volume kube-api-access-7pc7x for pod openshift-network-diagnostics/network-check-target-xj4sm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 12:47:07.295339 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:07.295231    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2e3e9cee-032c-466e-8808-9d91f3fe2fc5-kube-api-access-7pc7x podName:2e3e9cee-032c-466e-8808-9d91f3fe2fc5 nodeName:}" failed. No retries permitted until 2026-07-06 12:47:09.29521161 +0000 UTC m=+6.164099270 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-7pc7x" (UniqueName: "kubernetes.io/projected/2e3e9cee-032c-466e-8808-9d91f3fe2fc5-kube-api-access-7pc7x") pod "network-check-target-xj4sm" (UID: "2e3e9cee-032c-466e-8808-9d91f3fe2fc5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 12:47:07.295674 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:07.295653    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 12:47:07.295780 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:07.295712    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/063b9802-bd30-43d5-8969-819da64e14b0-original-pull-secret podName:063b9802-bd30-43d5-8969-819da64e14b0 nodeName:}" failed. No retries permitted until 2026-07-06 12:47:09.295697378 +0000 UTC m=+6.164585034 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/063b9802-bd30-43d5-8969-819da64e14b0-original-pull-secret") pod "global-pull-secret-syncer-vdbtk" (UID: "063b9802-bd30-43d5-8969-819da64e14b0") : object "kube-system"/"original-pull-secret" not registered
Jul 06 12:47:07.625027 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:07.624932    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 12:42:06 +0000 UTC" deadline="2028-02-26 13:20:59.622418784 +0000 UTC"
Jul 06 12:47:07.625027 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:07.624975    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14400h33m51.997450703s"
Jul 06 12:47:07.650815 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:07.650791    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nhdrh"
Jul 06 12:47:07.651144 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:07.650954    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nhdrh" podUID="efc0433a-6604-414a-b029-97f8b1075928"
Jul 06 12:47:07.651562 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:07.651367    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vdbtk"
Jul 06 12:47:07.651562 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:07.651463    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vdbtk" podUID="063b9802-bd30-43d5-8969-819da64e14b0"
Jul 06 12:47:08.648772 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:08.648247    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xj4sm"
Jul 06 12:47:08.648772 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:08.648371    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xj4sm" podUID="2e3e9cee-032c-466e-8808-9d91f3fe2fc5"
Jul 06 12:47:09.217369 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:09.217280    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/efc0433a-6604-414a-b029-97f8b1075928-metrics-certs\") pod \"network-metrics-daemon-nhdrh\" (UID: \"efc0433a-6604-414a-b029-97f8b1075928\") " pod="openshift-multus/network-metrics-daemon-nhdrh"
Jul 06 12:47:09.217592 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:09.217483    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 12:47:09.217592 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:09.217553    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/efc0433a-6604-414a-b029-97f8b1075928-metrics-certs podName:efc0433a-6604-414a-b029-97f8b1075928 nodeName:}" failed. No retries permitted until 2026-07-06 12:47:13.217524654 +0000 UTC m=+10.086412297 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/efc0433a-6604-414a-b029-97f8b1075928-metrics-certs") pod "network-metrics-daemon-nhdrh" (UID: "efc0433a-6604-414a-b029-97f8b1075928") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 12:47:09.318029 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:09.317990    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/063b9802-bd30-43d5-8969-819da64e14b0-original-pull-secret\") pod \"global-pull-secret-syncer-vdbtk\" (UID: \"063b9802-bd30-43d5-8969-819da64e14b0\") " pod="kube-system/global-pull-secret-syncer-vdbtk"
Jul 06 12:47:09.318233 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:09.318060    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pc7x\" (UniqueName: \"kubernetes.io/projected/2e3e9cee-032c-466e-8808-9d91f3fe2fc5-kube-api-access-7pc7x\") pod \"network-check-target-xj4sm\" (UID: \"2e3e9cee-032c-466e-8808-9d91f3fe2fc5\") " pod="openshift-network-diagnostics/network-check-target-xj4sm"
Jul 06 12:47:09.318233 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:09.318198    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 12:47:09.318233 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:09.318217    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 12:47:09.318233 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:09.318229    2579 projected.go:196] Error preparing data for projected volume kube-api-access-7pc7x for pod openshift-network-diagnostics/network-check-target-xj4sm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 12:47:09.318443 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:09.318285    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2e3e9cee-032c-466e-8808-9d91f3fe2fc5-kube-api-access-7pc7x podName:2e3e9cee-032c-466e-8808-9d91f3fe2fc5 nodeName:}" failed. No retries permitted until 2026-07-06 12:47:13.318263915 +0000 UTC m=+10.187151576 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-7pc7x" (UniqueName: "kubernetes.io/projected/2e3e9cee-032c-466e-8808-9d91f3fe2fc5-kube-api-access-7pc7x") pod "network-check-target-xj4sm" (UID: "2e3e9cee-032c-466e-8808-9d91f3fe2fc5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 12:47:09.318760 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:09.318738    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 12:47:09.318887 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:09.318795    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/063b9802-bd30-43d5-8969-819da64e14b0-original-pull-secret podName:063b9802-bd30-43d5-8969-819da64e14b0 nodeName:}" failed. No retries permitted until 2026-07-06 12:47:13.318780654 +0000 UTC m=+10.187668313 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/063b9802-bd30-43d5-8969-819da64e14b0-original-pull-secret") pod "global-pull-secret-syncer-vdbtk" (UID: "063b9802-bd30-43d5-8969-819da64e14b0") : object "kube-system"/"original-pull-secret" not registered
Jul 06 12:47:09.649043 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:09.648900    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nhdrh"
Jul 06 12:47:09.649487 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:09.649077    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nhdrh" podUID="efc0433a-6604-414a-b029-97f8b1075928"
Jul 06 12:47:09.649487 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:09.649470    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vdbtk"
Jul 06 12:47:09.649605 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:09.649581    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vdbtk" podUID="063b9802-bd30-43d5-8969-819da64e14b0"
Jul 06 12:47:10.648695 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:10.648648    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xj4sm"
Jul 06 12:47:10.648903 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:10.648799    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xj4sm" podUID="2e3e9cee-032c-466e-8808-9d91f3fe2fc5"
Jul 06 12:47:11.649511 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:11.649282    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nhdrh"
Jul 06 12:47:11.649511 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:11.649441    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nhdrh" podUID="efc0433a-6604-414a-b029-97f8b1075928"
Jul 06 12:47:11.650106 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:11.649861    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vdbtk"
Jul 06 12:47:11.650106 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:11.649982    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vdbtk" podUID="063b9802-bd30-43d5-8969-819da64e14b0"
Jul 06 12:47:12.648537 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:12.648497    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xj4sm"
Jul 06 12:47:12.648798 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:12.648638    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xj4sm" podUID="2e3e9cee-032c-466e-8808-9d91f3fe2fc5"
Jul 06 12:47:13.253771 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:13.253688    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/efc0433a-6604-414a-b029-97f8b1075928-metrics-certs\") pod \"network-metrics-daemon-nhdrh\" (UID: \"efc0433a-6604-414a-b029-97f8b1075928\") " pod="openshift-multus/network-metrics-daemon-nhdrh"
Jul 06 12:47:13.254254 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:13.253900    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 12:47:13.254254 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:13.253994    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/efc0433a-6604-414a-b029-97f8b1075928-metrics-certs podName:efc0433a-6604-414a-b029-97f8b1075928 nodeName:}" failed. No retries permitted until 2026-07-06 12:47:21.253970926 +0000 UTC m=+18.122858569 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/efc0433a-6604-414a-b029-97f8b1075928-metrics-certs") pod "network-metrics-daemon-nhdrh" (UID: "efc0433a-6604-414a-b029-97f8b1075928") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 12:47:13.354757 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:13.354610    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/063b9802-bd30-43d5-8969-819da64e14b0-original-pull-secret\") pod \"global-pull-secret-syncer-vdbtk\" (UID: \"063b9802-bd30-43d5-8969-819da64e14b0\") " pod="kube-system/global-pull-secret-syncer-vdbtk"
Jul 06 12:47:13.354757 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:13.354684    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pc7x\" (UniqueName: \"kubernetes.io/projected/2e3e9cee-032c-466e-8808-9d91f3fe2fc5-kube-api-access-7pc7x\") pod \"network-check-target-xj4sm\" (UID: \"2e3e9cee-032c-466e-8808-9d91f3fe2fc5\") " pod="openshift-network-diagnostics/network-check-target-xj4sm"
Jul 06 12:47:13.355030 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:13.354783    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 12:47:13.355030 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:13.354812    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 12:47:13.355030 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:13.354830    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 12:47:13.355030 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:13.354844    2579 projected.go:196] Error preparing data for projected volume kube-api-access-7pc7x for pod openshift-network-diagnostics/network-check-target-xj4sm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 12:47:13.355030 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:13.354885    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/063b9802-bd30-43d5-8969-819da64e14b0-original-pull-secret podName:063b9802-bd30-43d5-8969-819da64e14b0 nodeName:}" failed. No retries permitted until 2026-07-06 12:47:21.354844833 +0000 UTC m=+18.223732481 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/063b9802-bd30-43d5-8969-819da64e14b0-original-pull-secret") pod "global-pull-secret-syncer-vdbtk" (UID: "063b9802-bd30-43d5-8969-819da64e14b0") : object "kube-system"/"original-pull-secret" not registered
Jul 06 12:47:13.355030 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:13.354920    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2e3e9cee-032c-466e-8808-9d91f3fe2fc5-kube-api-access-7pc7x podName:2e3e9cee-032c-466e-8808-9d91f3fe2fc5 nodeName:}" failed. No retries permitted until 2026-07-06 12:47:21.354902416 +0000 UTC m=+18.223790069 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-7pc7x" (UniqueName: "kubernetes.io/projected/2e3e9cee-032c-466e-8808-9d91f3fe2fc5-kube-api-access-7pc7x") pod "network-check-target-xj4sm" (UID: "2e3e9cee-032c-466e-8808-9d91f3fe2fc5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 12:47:13.650223 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:13.650139    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nhdrh"
Jul 06 12:47:13.650394 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:13.650260    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nhdrh" podUID="efc0433a-6604-414a-b029-97f8b1075928"
Jul 06 12:47:13.650394 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:13.650326    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vdbtk"
Jul 06 12:47:13.650511 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:13.650395    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vdbtk" podUID="063b9802-bd30-43d5-8969-819da64e14b0"
Jul 06 12:47:14.648996 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:14.648957    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xj4sm"
Jul 06 12:47:14.649451 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:14.649109    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xj4sm" podUID="2e3e9cee-032c-466e-8808-9d91f3fe2fc5"
Jul 06 12:47:15.648812 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:15.648772    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nhdrh"
Jul 06 12:47:15.648999 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:15.648944    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nhdrh" podUID="efc0433a-6604-414a-b029-97f8b1075928"
Jul 06 12:47:15.649066 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:15.649007    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vdbtk"
Jul 06 12:47:15.649490 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:15.649123    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vdbtk" podUID="063b9802-bd30-43d5-8969-819da64e14b0"
Jul 06 12:47:16.649463 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:16.649244    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xj4sm"
Jul 06 12:47:16.649463 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:16.649379    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xj4sm" podUID="2e3e9cee-032c-466e-8808-9d91f3fe2fc5"
Jul 06 12:47:17.648665 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:17.648598    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vdbtk"
Jul 06 12:47:17.648862 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:17.648597    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nhdrh"
Jul 06 12:47:17.648862 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:17.648746    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vdbtk" podUID="063b9802-bd30-43d5-8969-819da64e14b0"
Jul 06 12:47:17.648862 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:17.648797    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nhdrh" podUID="efc0433a-6604-414a-b029-97f8b1075928"
Jul 06 12:47:18.648925 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:18.648836    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xj4sm"
Jul 06 12:47:18.649360 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:18.648971    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xj4sm" podUID="2e3e9cee-032c-466e-8808-9d91f3fe2fc5"
Jul 06 12:47:19.648360 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:19.648330    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nhdrh"
Jul 06 12:47:19.648554 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:19.648466    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vdbtk"
Jul 06 12:47:19.648554 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:19.648464    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nhdrh" podUID="efc0433a-6604-414a-b029-97f8b1075928"
Jul 06 12:47:19.648660 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:19.648550    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vdbtk" podUID="063b9802-bd30-43d5-8969-819da64e14b0"
Jul 06 12:47:20.648573 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:20.648544    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xj4sm"
Jul 06 12:47:20.648950 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:20.648639    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xj4sm" podUID="2e3e9cee-032c-466e-8808-9d91f3fe2fc5"
Jul 06 12:47:21.314521 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:21.314479    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/efc0433a-6604-414a-b029-97f8b1075928-metrics-certs\") pod \"network-metrics-daemon-nhdrh\" (UID: \"efc0433a-6604-414a-b029-97f8b1075928\") " pod="openshift-multus/network-metrics-daemon-nhdrh"
Jul 06 12:47:21.314737 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:21.314609    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 12:47:21.314737 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:21.314666    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/efc0433a-6604-414a-b029-97f8b1075928-metrics-certs podName:efc0433a-6604-414a-b029-97f8b1075928 nodeName:}" failed. No retries permitted until 2026-07-06 12:47:37.314649743 +0000 UTC m=+34.183537383 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/efc0433a-6604-414a-b029-97f8b1075928-metrics-certs") pod "network-metrics-daemon-nhdrh" (UID: "efc0433a-6604-414a-b029-97f8b1075928") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 12:47:21.414790 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:21.414755    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pc7x\" (UniqueName: \"kubernetes.io/projected/2e3e9cee-032c-466e-8808-9d91f3fe2fc5-kube-api-access-7pc7x\") pod \"network-check-target-xj4sm\" (UID: \"2e3e9cee-032c-466e-8808-9d91f3fe2fc5\") " pod="openshift-network-diagnostics/network-check-target-xj4sm"
Jul 06 12:47:21.414970 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:21.414834    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/063b9802-bd30-43d5-8969-819da64e14b0-original-pull-secret\") pod \"global-pull-secret-syncer-vdbtk\" (UID: \"063b9802-bd30-43d5-8969-819da64e14b0\") " pod="kube-system/global-pull-secret-syncer-vdbtk"
Jul 06 12:47:21.414970 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:21.414939    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 12:47:21.415066 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:21.414996    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/063b9802-bd30-43d5-8969-819da64e14b0-original-pull-secret podName:063b9802-bd30-43d5-8969-819da64e14b0 nodeName:}" failed. No retries permitted until 2026-07-06 12:47:37.414981162 +0000 UTC m=+34.283868799 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/063b9802-bd30-43d5-8969-819da64e14b0-original-pull-secret") pod "global-pull-secret-syncer-vdbtk" (UID: "063b9802-bd30-43d5-8969-819da64e14b0") : object "kube-system"/"original-pull-secret" not registered
Jul 06 12:47:21.415066 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:21.414940    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 12:47:21.415066 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:21.415051    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 12:47:21.415066 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:21.415063    2579 projected.go:196] Error preparing data for projected volume kube-api-access-7pc7x for pod openshift-network-diagnostics/network-check-target-xj4sm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 12:47:21.415194 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:21.415105    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2e3e9cee-032c-466e-8808-9d91f3fe2fc5-kube-api-access-7pc7x podName:2e3e9cee-032c-466e-8808-9d91f3fe2fc5 nodeName:}" failed. No retries permitted until 2026-07-06 12:47:37.415093079 +0000 UTC m=+34.283980720 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-7pc7x" (UniqueName: "kubernetes.io/projected/2e3e9cee-032c-466e-8808-9d91f3fe2fc5-kube-api-access-7pc7x") pod "network-check-target-xj4sm" (UID: "2e3e9cee-032c-466e-8808-9d91f3fe2fc5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 12:47:21.649004 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:21.648928    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nhdrh"
Jul 06 12:47:21.649327 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:21.648944    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vdbtk"
Jul 06 12:47:21.649327 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:21.649069    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nhdrh" podUID="efc0433a-6604-414a-b029-97f8b1075928"
Jul 06 12:47:21.649327 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:21.649104    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vdbtk" podUID="063b9802-bd30-43d5-8969-819da64e14b0"
Jul 06 12:47:22.648448 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:22.648421    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xj4sm"
Jul 06 12:47:22.648573 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:22.648504    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xj4sm" podUID="2e3e9cee-032c-466e-8808-9d91f3fe2fc5"
Jul 06 12:47:23.649675 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:23.649643    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nhdrh"
Jul 06 12:47:23.650086 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:23.649756    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nhdrh" podUID="efc0433a-6604-414a-b029-97f8b1075928"
Jul 06 12:47:23.650086 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:23.649786    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vdbtk"
Jul 06 12:47:23.650086 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:23.649857    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vdbtk" podUID="063b9802-bd30-43d5-8969-819da64e14b0"
Jul 06 12:47:24.648771 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:24.648742    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xj4sm"
Jul 06 12:47:24.648942 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:24.648862    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xj4sm" podUID="2e3e9cee-032c-466e-8808-9d91f3fe2fc5"
Jul 06 12:47:25.648705 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:25.648664    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nhdrh"
Jul 06 12:47:25.649139 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:25.648833    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nhdrh" podUID="efc0433a-6604-414a-b029-97f8b1075928"
Jul 06 12:47:25.649139 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:25.648884    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vdbtk"
Jul 06 12:47:25.649139 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:25.648995    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vdbtk" podUID="063b9802-bd30-43d5-8969-819da64e14b0"
Jul 06 12:47:26.649384 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:26.649249    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xj4sm"
Jul 06 12:47:26.649714 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:26.649464    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xj4sm" podUID="2e3e9cee-032c-466e-8808-9d91f3fe2fc5"
Jul 06 12:47:27.050743 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:27.050694    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-swjxd" event={"ID":"3018c6ec-22c6-44ff-951a-5a9867fb4efd","Type":"ContainerStarted","Data":"4d9d72b89c05a79d57f66a2c4adfcfbdd0a9c11592f75a6b94a7eea92a2957d1"}
Jul 06 12:47:27.053672 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:27.053620    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mp2mx" event={"ID":"824c3385-d7b5-42ff-8db7-8189f6015cca","Type":"ContainerStarted","Data":"29e9c6d68a9358e19c5a8129e6a1fb590478ae41ddecf077d3bd640199d224cf"}
Jul 06 12:47:27.053770 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:27.053709    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mp2mx" event={"ID":"824c3385-d7b5-42ff-8db7-8189f6015cca","Type":"ContainerStarted","Data":"cd6718954c9e9a6ac25bda3185ece4c62e6f8b29dc6011ec396d69ab6c7cb711"}
Jul 06 12:47:27.053770 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:27.053753    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mp2mx" event={"ID":"824c3385-d7b5-42ff-8db7-8189f6015cca","Type":"ContainerStarted","Data":"f62375b1f31ff0c59779f31639861998b3216d9ab7b5505fb5b04c3d3dddfaea"}
Jul 06 12:47:27.053891 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:27.053785    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mp2mx" event={"ID":"824c3385-d7b5-42ff-8db7-8189f6015cca","Type":"ContainerStarted","Data":"8b54ad899e086cc1a585e71b7b7b8fb757a5d02f3c30fe8a29a82d8afbff6550"}
Jul 06 12:47:27.053891 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:27.053811    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mp2mx" event={"ID":"824c3385-d7b5-42ff-8db7-8189f6015cca","Type":"ContainerStarted","Data":"d0f72cc168b11f75156206c2c4692d46cc079cdad7ae4006bb350f8ded0dbbeb"}
Jul 06 12:47:27.055171 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:27.055146    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7j4hl" event={"ID":"4189b076-eba5-4f1c-9c60-c08cd561c37e","Type":"ContainerStarted","Data":"2bc27238b643903b56f836cfc69d77a65e96d0f46d9bf18b61eba4abdba975b7"}
Jul 06 12:47:27.056379 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:27.056359    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-126.ec2.internal" event={"ID":"b09a290c651e1aea4d449f3ffc2514d4","Type":"ContainerStarted","Data":"cfbcb9568bfec8d4ab12ffbc6d107ba54f31a741ed1524ba5bbb492da471eebd"}
Jul 06 12:47:27.071019 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:27.070966    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-swjxd" podStartSLOduration=2.578028739 podStartE2EDuration="23.070955024s" totalImagesPullingTime="20.492926285s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 12:47:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:47:27.070921579 +0000 UTC m=+23.939809239" watchObservedRunningTime="2026-07-06 12:47:27.070955024 +0000 UTC m=+23.939842682"
Jul 06 12:47:27.087561 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:27.087515    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-126.ec2.internal" podStartSLOduration=22.087499455 podStartE2EDuration="22.087499455s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 12:47:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:47:27.087466857 +0000 UTC m=+23.956354517" watchObservedRunningTime="2026-07-06 12:47:27.087499455 +0000 UTC m=+23.956387115"
Jul 06 12:47:27.648764 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:27.648742    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nhdrh"
Jul 06 12:47:27.648918 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:27.648742    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vdbtk"
Jul 06 12:47:27.648918 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:27.648860    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nhdrh" podUID="efc0433a-6604-414a-b029-97f8b1075928"
Jul 06 12:47:27.649037 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:27.648923    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vdbtk" podUID="063b9802-bd30-43d5-8969-819da64e14b0"
Jul 06 12:47:28.060145 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:28.060072    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6l9nm" event={"ID":"da8ef940-6a0f-4692-9c14-6f58ae35e1e0","Type":"ContainerStarted","Data":"f33eebd7e3d6a56c29cfc1c95eab64a6d9436d4b91f2314f12e57e0ce79b0da0"}
Jul 06 12:47:28.063870 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:28.063669    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mp2mx" event={"ID":"824c3385-d7b5-42ff-8db7-8189f6015cca","Type":"ContainerStarted","Data":"45b30baaeca7f16ae1189b1afc208a5b130bb3248735ef67191fcbcc1e86b37f"}
Jul 06 12:47:28.065199 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:28.065163    2579 generic.go:356] "Generic (PLEG): container finished" podID="2f70de53-34f6-4a59-9a48-015ddec89a47" containerID="d964e5abca92021097b6d4614ae276c85a61f4b4f8420a8c6e1d17d8192d04c9" exitCode=0
Jul 06 12:47:28.065287 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:28.065219    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-frfnj" event={"ID":"2f70de53-34f6-4a59-9a48-015ddec89a47","Type":"ContainerDied","Data":"d964e5abca92021097b6d4614ae276c85a61f4b4f8420a8c6e1d17d8192d04c9"}
Jul 06 12:47:28.067006 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:28.066963    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tr8t2" event={"ID":"e09437b4-0f91-4b6f-a017-784f7515276b","Type":"ContainerStarted","Data":"773d51462fe4a17010985659293bbbe8fb748359edeb5edca264b33491c1d592"}
Jul 06 12:47:28.068791 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:28.068759    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drgfv" event={"ID":"2dc4171e-8076-4168-ac15-27daa9c4fdf2","Type":"ContainerStarted","Data":"dcce53e606c87cf558b24885921772b9fde5b29ec814acf8ac8b327d02a5af9b"}
Jul 06 12:47:28.070334 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:28.070308    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hldtt" event={"ID":"6dc153e6-3403-42ca-ae21-cd7056b3cb47","Type":"ContainerStarted","Data":"6d948e22fff1e6d6c97b5b3002aee40311f65de85da2ef3238ffb3b86a94b6bf"}
Jul 06 12:47:28.072158 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:28.072128    2579 generic.go:356] "Generic (PLEG): container finished" podID="9f88e660f9398535f6ba4e54f660d4b7" containerID="069351fe36146363bdc70eba0b63a28db62956eae7df95e9b854b12d853ebea9" exitCode=0
Jul 06 12:47:28.072264 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:28.072208    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-126.ec2.internal" event={"ID":"9f88e660f9398535f6ba4e54f660d4b7","Type":"ContainerDied","Data":"069351fe36146363bdc70eba0b63a28db62956eae7df95e9b854b12d853ebea9"}
Jul 06 12:47:28.074212 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:28.074190    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9jrvv" event={"ID":"e61427e6-62cd-44b6-9f9a-5f3bd906d29a","Type":"ContainerStarted","Data":"14818da61979fe273de064247b7afbe933a194246a9a4984fefadb1f4e72c71a"}
Jul 06 12:47:28.080997 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:28.080963    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-7j4hl" podStartSLOduration=3.489212013 podStartE2EDuration="24.080952162s" totalImagesPullingTime="20.591740149s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 12:47:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:47:27.114636784 +0000 UTC m=+23.983524443" watchObservedRunningTime="2026-07-06 12:47:28.080952162 +0000 UTC m=+24.949839821"
Jul 06 12:47:28.081155 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:28.081124    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-6l9nm" podStartSLOduration=3.585732765 podStartE2EDuration="24.081119052s" totalImagesPullingTime="20.495386287s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:47:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:47:28.080814909 +0000 UTC m=+24.949702569" watchObservedRunningTime="2026-07-06 12:47:28.081119052 +0000 UTC m=+24.950006711"
Jul 06 12:47:28.119024 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:28.118832    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-9jrvv" podStartSLOduration=3.637145024 podStartE2EDuration="24.118820229s" totalImagesPullingTime="20.481675205s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 12:47:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:47:28.099550674 +0000 UTC m=+24.968438334" watchObservedRunningTime="2026-07-06 12:47:28.118820229 +0000 UTC m=+24.987707889"
Jul 06 12:47:28.163932 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:28.163897    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hldtt" podStartSLOduration=3.643201141 podStartE2EDuration="24.163881923s" totalImagesPullingTime="20.520680782s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 12:47:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:47:28.163435527 +0000 UTC m=+25.032323187" watchObservedRunningTime="2026-07-06 12:47:28.163881923 +0000 UTC m=+25.032769582"
Jul 06 12:47:28.179714 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:28.179675    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-tr8t2" podStartSLOduration=3.667930649 podStartE2EDuration="24.179658322s" totalImagesPullingTime="20.511727673s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 12:47:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:47:28.179223306 +0000 UTC m=+25.048110965" watchObservedRunningTime="2026-07-06 12:47:28.179658322 +0000 UTC m=+25.048545982"
Jul 06 12:47:28.320413 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:28.320337    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:47:28.394043 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:28.394015    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:47:28.648493 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:28.648426    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xj4sm"
Jul 06 12:47:28.648716 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:28.648543    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xj4sm" podUID="2e3e9cee-032c-466e-8808-9d91f3fe2fc5"
Jul 06 12:47:28.765590 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:28.765569    2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 06 12:47:29.078396 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:29.078314    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drgfv" event={"ID":"2dc4171e-8076-4168-ac15-27daa9c4fdf2","Type":"ContainerStarted","Data":"5d75135c0a97c3e6d00f1fe05158b121f59bbd814a08816e271c89a04c133afe"}
Jul 06 12:47:29.080213 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:29.080184    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-126.ec2.internal" event={"ID":"9f88e660f9398535f6ba4e54f660d4b7","Type":"ContainerStarted","Data":"6e8b3ff8a286f0146aeaa676d89221d09bc577aee79ef59ca49178a4a4117e68"}
Jul 06 12:47:29.098104 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:29.098061    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-126.ec2.internal" podStartSLOduration=24.098043853 podStartE2EDuration="24.098043853s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 12:47:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:47:29.098022848 +0000 UTC m=+25.966910509" watchObservedRunningTime="2026-07-06 12:47:29.098043853 +0000 UTC m=+25.966931513"
Jul 06 12:47:29.514025 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:29.513948    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:47:29.637712 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:29.637575    2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T12:47:28.76558558Z","UUID":"8dbff3a4-6d8f-40ac-a3df-5b15aac68b34","Handler":null,"Name":"","Endpoint":""}
Jul 06 12:47:29.639991 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:29.639749    2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 06 12:47:29.639991 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:29.639792    2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 06 12:47:29.648836 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:29.648809    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nhdrh"
Jul 06 12:47:29.648981 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:29.648957    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nhdrh" podUID="efc0433a-6604-414a-b029-97f8b1075928"
Jul 06 12:47:29.649049 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:29.649016    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vdbtk"
Jul 06 12:47:29.649143 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:29.649119    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vdbtk" podUID="063b9802-bd30-43d5-8969-819da64e14b0"
Jul 06 12:47:29.661146 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:29.661125    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:47:30.086828 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:30.086798    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mp2mx" event={"ID":"824c3385-d7b5-42ff-8db7-8189f6015cca","Type":"ContainerStarted","Data":"9ed491813d804b89723a2dfb2466443ef097e50a8ebf179e74fba15c3352af7b"}
Jul 06 12:47:30.648898 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:30.648871    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xj4sm"
Jul 06 12:47:30.649058 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:30.648978    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xj4sm" podUID="2e3e9cee-032c-466e-8808-9d91f3fe2fc5"
Jul 06 12:47:31.091144 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:31.091069    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drgfv" event={"ID":"2dc4171e-8076-4168-ac15-27daa9c4fdf2","Type":"ContainerStarted","Data":"c7c53bae21a082547ba4b3ef94adcee3d2dfb4788dba1026f6cb6e1be6e88cb3"}
Jul 06 12:47:31.121265 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:31.121205    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drgfv" podStartSLOduration=4.021361428 podStartE2EDuration="27.121190218s" totalImagesPullingTime="23.09982879s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 12:47:04 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:47:31.115240061 +0000 UTC m=+27.984127720" watchObservedRunningTime="2026-07-06 12:47:31.121190218 +0000 UTC m=+27.990077878"
Jul 06 12:47:31.140656 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:31.140630    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-6l9nm"
Jul 06 12:47:31.141329 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:31.141308    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-6l9nm"
Jul 06 12:47:31.583611 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:31.583447    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:47:31.649324 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:31.649254    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nhdrh"
Jul 06 12:47:31.649456 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:31.649256    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vdbtk"
Jul 06 12:47:31.649456 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:31.649376    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nhdrh" podUID="efc0433a-6604-414a-b029-97f8b1075928"
Jul 06 12:47:31.649542 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:31.649451    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vdbtk" podUID="063b9802-bd30-43d5-8969-819da64e14b0"
Jul 06 12:47:31.683553 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:31.683524    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:47:32.096087 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:32.096056    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mp2mx" event={"ID":"824c3385-d7b5-42ff-8db7-8189f6015cca","Type":"ContainerStarted","Data":"53b10b44da7c35462ff4ef07069687948301042c0a40751baeff2e013bfee08e"}
Jul 06 12:47:32.096614 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:32.096398    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-6l9nm"
Jul 06 12:47:32.096756 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:32.096740    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-6l9nm"
Jul 06 12:47:32.131812 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:32.131769    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-mp2mx" podStartSLOduration=7.568832212 podStartE2EDuration="28.131755303s" totalImagesPullingTime="20.562923091s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 12:47:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:47:32.131757038 +0000 UTC m=+29.000644696" watchObservedRunningTime="2026-07-06 12:47:32.131755303 +0000 UTC m=+29.000642952"
Jul 06 12:47:32.213461 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:32.213428    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:47:32.650547 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:32.650057    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xj4sm"
Jul 06 12:47:32.650547 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:32.650184    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xj4sm" podUID="2e3e9cee-032c-466e-8808-9d91f3fe2fc5"
Jul 06 12:47:33.100049 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:33.099967    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mp2mx"
Jul 06 12:47:33.100605 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:33.100064    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mp2mx"
Jul 06 12:47:33.100605 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:33.100118    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mp2mx"
Jul 06 12:47:33.117111 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:33.117088    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mp2mx"
Jul 06 12:47:33.117350 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:33.117332    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mp2mx"
Jul 06 12:47:33.505127 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:33.504866    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vdbtk"]
Jul 06 12:47:33.505276 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:33.505247    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vdbtk"
Jul 06 12:47:33.505440 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:33.505404    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vdbtk" podUID="063b9802-bd30-43d5-8969-819da64e14b0"
Jul 06 12:47:33.507525 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:33.507493    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xj4sm"]
Jul 06 12:47:33.507648 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:33.507587    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xj4sm"
Jul 06 12:47:33.507722 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:33.507677    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xj4sm" podUID="2e3e9cee-032c-466e-8808-9d91f3fe2fc5"
Jul 06 12:47:33.508324 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:33.508291    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nhdrh"]
Jul 06 12:47:33.508427 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:33.508406    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nhdrh"
Jul 06 12:47:33.508522 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:33.508499    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nhdrh" podUID="efc0433a-6604-414a-b029-97f8b1075928"
Jul 06 12:47:35.105474 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:35.105400    2579 generic.go:356] "Generic (PLEG): container finished" podID="2f70de53-34f6-4a59-9a48-015ddec89a47" containerID="d10e40c2531b683fcedacf37168edf1d73a0e7f221e0facbe625e036936d8aa1" exitCode=0
Jul 06 12:47:35.105474 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:35.105455    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-frfnj" event={"ID":"2f70de53-34f6-4a59-9a48-015ddec89a47","Type":"ContainerDied","Data":"d10e40c2531b683fcedacf37168edf1d73a0e7f221e0facbe625e036936d8aa1"}
Jul 06 12:47:35.648883 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:35.648801    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nhdrh"
Jul 06 12:47:35.649014 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:35.648801    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xj4sm"
Jul 06 12:47:35.649014 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:35.648808    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vdbtk"
Jul 06 12:47:35.649014 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:35.648970    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nhdrh" podUID="efc0433a-6604-414a-b029-97f8b1075928"
Jul 06 12:47:35.649172 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:35.649033    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xj4sm" podUID="2e3e9cee-032c-466e-8808-9d91f3fe2fc5"
Jul 06 12:47:35.649172 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:35.649094    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vdbtk" podUID="063b9802-bd30-43d5-8969-819da64e14b0"
Jul 06 12:47:36.735040 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:36.735006    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:47:36.835284 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:36.835251    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:47:37.018756 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:37.018691    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:47:37.111525 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:37.111498    2579 generic.go:356] "Generic (PLEG): container finished" podID="2f70de53-34f6-4a59-9a48-015ddec89a47" containerID="c547640d496fa23064b6a70e557307635deecd7ccf0e90746b45b3cb77686938" exitCode=0
Jul 06 12:47:37.111621 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:37.111536    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-frfnj" event={"ID":"2f70de53-34f6-4a59-9a48-015ddec89a47","Type":"ContainerDied","Data":"c547640d496fa23064b6a70e557307635deecd7ccf0e90746b45b3cb77686938"}
Jul 06 12:47:37.117394 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:37.117373    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:47:37.338459 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:37.338400    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/efc0433a-6604-414a-b029-97f8b1075928-metrics-certs\") pod \"network-metrics-daemon-nhdrh\" (UID: \"efc0433a-6604-414a-b029-97f8b1075928\") " pod="openshift-multus/network-metrics-daemon-nhdrh"
Jul 06 12:47:37.338549 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:37.338526    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 12:47:37.338583 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:37.338574    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/efc0433a-6604-414a-b029-97f8b1075928-metrics-certs podName:efc0433a-6604-414a-b029-97f8b1075928 nodeName:}" failed. No retries permitted until 2026-07-06 12:48:09.338562072 +0000 UTC m=+66.207449709 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/efc0433a-6604-414a-b029-97f8b1075928-metrics-certs") pod "network-metrics-daemon-nhdrh" (UID: "efc0433a-6604-414a-b029-97f8b1075928") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 12:47:37.438980 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:37.438955    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pc7x\" (UniqueName: \"kubernetes.io/projected/2e3e9cee-032c-466e-8808-9d91f3fe2fc5-kube-api-access-7pc7x\") pod \"network-check-target-xj4sm\" (UID: \"2e3e9cee-032c-466e-8808-9d91f3fe2fc5\") " pod="openshift-network-diagnostics/network-check-target-xj4sm"
Jul 06 12:47:37.439068 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:37.439001    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/063b9802-bd30-43d5-8969-819da64e14b0-original-pull-secret\") pod \"global-pull-secret-syncer-vdbtk\" (UID: \"063b9802-bd30-43d5-8969-819da64e14b0\") " pod="kube-system/global-pull-secret-syncer-vdbtk"
Jul 06 12:47:37.439107 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:37.439081    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 12:47:37.439107 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:37.439092    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 12:47:37.439165 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:37.439110    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 12:47:37.439165 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:37.439119    2579 projected.go:196] Error preparing data for projected volume kube-api-access-7pc7x for pod openshift-network-diagnostics/network-check-target-xj4sm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 12:47:37.439165 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:37.439121    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/063b9802-bd30-43d5-8969-819da64e14b0-original-pull-secret podName:063b9802-bd30-43d5-8969-819da64e14b0 nodeName:}" failed. No retries permitted until 2026-07-06 12:48:09.439109717 +0000 UTC m=+66.307997354 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/063b9802-bd30-43d5-8969-819da64e14b0-original-pull-secret") pod "global-pull-secret-syncer-vdbtk" (UID: "063b9802-bd30-43d5-8969-819da64e14b0") : object "kube-system"/"original-pull-secret" not registered
Jul 06 12:47:37.439165 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:37.439152    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2e3e9cee-032c-466e-8808-9d91f3fe2fc5-kube-api-access-7pc7x podName:2e3e9cee-032c-466e-8808-9d91f3fe2fc5 nodeName:}" failed. No retries permitted until 2026-07-06 12:48:09.439141067 +0000 UTC m=+66.308028703 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-7pc7x" (UniqueName: "kubernetes.io/projected/2e3e9cee-032c-466e-8808-9d91f3fe2fc5-kube-api-access-7pc7x") pod "network-check-target-xj4sm" (UID: "2e3e9cee-032c-466e-8808-9d91f3fe2fc5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 12:47:37.648809 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:37.648736    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xj4sm"
Jul 06 12:47:37.648809 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:37.648779    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vdbtk"
Jul 06 12:47:37.648988 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:37.648736    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nhdrh"
Jul 06 12:47:37.648988 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:37.648874    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xj4sm" podUID="2e3e9cee-032c-466e-8808-9d91f3fe2fc5"
Jul 06 12:47:37.648988 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:37.648939    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vdbtk" podUID="063b9802-bd30-43d5-8969-819da64e14b0"
Jul 06 12:47:37.649132 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:37.649034    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nhdrh" podUID="efc0433a-6604-414a-b029-97f8b1075928"
Jul 06 12:47:38.115912 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:38.115886    2579 generic.go:356] "Generic (PLEG): container finished" podID="2f70de53-34f6-4a59-9a48-015ddec89a47" containerID="0ba70eccef15ef00024400f13b26c40a67c84a8d088f4215d430ac23f540e6d4" exitCode=0
Jul 06 12:47:38.116219 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:38.115937    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-frfnj" event={"ID":"2f70de53-34f6-4a59-9a48-015ddec89a47","Type":"ContainerDied","Data":"0ba70eccef15ef00024400f13b26c40a67c84a8d088f4215d430ac23f540e6d4"}
Jul 06 12:47:39.649037 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:39.648828    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xj4sm"
Jul 06 12:47:39.649526 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:39.648829    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nhdrh"
Jul 06 12:47:39.649526 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:39.649119    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xj4sm" podUID="2e3e9cee-032c-466e-8808-9d91f3fe2fc5"
Jul 06 12:47:39.649526 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:39.648994    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vdbtk"
Jul 06 12:47:39.649526 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:39.649254    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nhdrh" podUID="efc0433a-6604-414a-b029-97f8b1075928"
Jul 06 12:47:39.649526 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:39.649265    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vdbtk" podUID="063b9802-bd30-43d5-8969-819da64e14b0"
Jul 06 12:47:40.409177 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:40.409094    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-126.ec2.internal" event="NodeReady"
Jul 06 12:47:40.409417 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:40.409286    2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 06 12:47:40.526825 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:40.526796    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-zrttp"]
Jul 06 12:47:40.531899 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:40.531879    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-lpwg5"]
Jul 06 12:47:40.532006 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:40.531993    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zrttp"
Jul 06 12:47:40.534070 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:40.534054    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lpwg5"
Jul 06 12:47:40.537874 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:40.537810    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 06 12:47:40.538003 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:40.537904    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 06 12:47:40.538282 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:40.538261    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 06 12:47:40.538467 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:40.538269    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-28thq\""
Jul 06 12:47:40.538467 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:40.538378    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 06 12:47:40.538467 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:40.538408    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 06 12:47:40.556597 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:40.556575    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9njlh\""
Jul 06 12:47:40.566848 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:40.566827    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lpwg5"]
Jul 06 12:47:40.569705 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:40.569686    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zrttp"]
Jul 06 12:47:40.660799 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:40.660740    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5199a8fa-633f-4cb1-b46d-83ab71d5f651-cert\") pod \"ingress-canary-zrttp\" (UID: \"5199a8fa-633f-4cb1-b46d-83ab71d5f651\") " pod="openshift-ingress-canary/ingress-canary-zrttp"
Jul 06 12:47:40.660799 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:40.660769    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60f37d4d-640e-4be1-9e91-937c6d91aa60-tmp-dir\") pod \"dns-default-lpwg5\" (UID: \"60f37d4d-640e-4be1-9e91-937c6d91aa60\") " pod="openshift-dns/dns-default-lpwg5"
Jul 06 12:47:40.661154 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:40.660804    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4g2z\" (UniqueName: \"kubernetes.io/projected/5199a8fa-633f-4cb1-b46d-83ab71d5f651-kube-api-access-b4g2z\") pod \"ingress-canary-zrttp\" (UID: \"5199a8fa-633f-4cb1-b46d-83ab71d5f651\") " pod="openshift-ingress-canary/ingress-canary-zrttp"
Jul 06 12:47:40.661154 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:40.660824    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/60f37d4d-640e-4be1-9e91-937c6d91aa60-config-volume\") pod \"dns-default-lpwg5\" (UID: \"60f37d4d-640e-4be1-9e91-937c6d91aa60\") " pod="openshift-dns/dns-default-lpwg5"
Jul 06 12:47:40.661154 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:40.660871    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gj9pt\" (UniqueName: \"kubernetes.io/projected/60f37d4d-640e-4be1-9e91-937c6d91aa60-kube-api-access-gj9pt\") pod \"dns-default-lpwg5\" (UID: \"60f37d4d-640e-4be1-9e91-937c6d91aa60\") " pod="openshift-dns/dns-default-lpwg5"
Jul 06 12:47:40.661154 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:40.660914    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/60f37d4d-640e-4be1-9e91-937c6d91aa60-metrics-tls\") pod \"dns-default-lpwg5\" (UID: \"60f37d4d-640e-4be1-9e91-937c6d91aa60\") " pod="openshift-dns/dns-default-lpwg5"
Jul 06 12:47:40.748288 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:40.748268    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:47:40.761146 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:40.761123    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4g2z\" (UniqueName: \"kubernetes.io/projected/5199a8fa-633f-4cb1-b46d-83ab71d5f651-kube-api-access-b4g2z\") pod \"ingress-canary-zrttp\" (UID: \"5199a8fa-633f-4cb1-b46d-83ab71d5f651\") " pod="openshift-ingress-canary/ingress-canary-zrttp"
Jul 06 12:47:40.761260 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:40.761159    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/60f37d4d-640e-4be1-9e91-937c6d91aa60-config-volume\") pod \"dns-default-lpwg5\" (UID: \"60f37d4d-640e-4be1-9e91-937c6d91aa60\") " pod="openshift-dns/dns-default-lpwg5"
Jul 06 12:47:40.761260 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:40.761190    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gj9pt\" (UniqueName: \"kubernetes.io/projected/60f37d4d-640e-4be1-9e91-937c6d91aa60-kube-api-access-gj9pt\") pod \"dns-default-lpwg5\" (UID: \"60f37d4d-640e-4be1-9e91-937c6d91aa60\") " pod="openshift-dns/dns-default-lpwg5"
Jul 06 12:47:40.761260 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:40.761253    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/60f37d4d-640e-4be1-9e91-937c6d91aa60-metrics-tls\") pod \"dns-default-lpwg5\" (UID: \"60f37d4d-640e-4be1-9e91-937c6d91aa60\") " pod="openshift-dns/dns-default-lpwg5"
Jul 06 12:47:40.761421 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:40.761279    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5199a8fa-633f-4cb1-b46d-83ab71d5f651-cert\") pod \"ingress-canary-zrttp\" (UID: \"5199a8fa-633f-4cb1-b46d-83ab71d5f651\") " pod="openshift-ingress-canary/ingress-canary-zrttp"
Jul 06 12:47:40.761421 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:40.761309    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60f37d4d-640e-4be1-9e91-937c6d91aa60-tmp-dir\") pod \"dns-default-lpwg5\" (UID: \"60f37d4d-640e-4be1-9e91-937c6d91aa60\") " pod="openshift-dns/dns-default-lpwg5"
Jul 06 12:47:40.761527 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:40.761466    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 12:47:40.761580 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:40.761530    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60f37d4d-640e-4be1-9e91-937c6d91aa60-metrics-tls podName:60f37d4d-640e-4be1-9e91-937c6d91aa60 nodeName:}" failed. No retries permitted until 2026-07-06 12:47:41.261512225 +0000 UTC m=+38.130399875 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/60f37d4d-640e-4be1-9e91-937c6d91aa60-metrics-tls") pod "dns-default-lpwg5" (UID: "60f37d4d-640e-4be1-9e91-937c6d91aa60") : secret "dns-default-metrics-tls" not found
Jul 06 12:47:40.761911 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:40.761882    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60f37d4d-640e-4be1-9e91-937c6d91aa60-tmp-dir\") pod \"dns-default-lpwg5\" (UID: \"60f37d4d-640e-4be1-9e91-937c6d91aa60\") " pod="openshift-dns/dns-default-lpwg5"
Jul 06 12:47:40.762044 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:40.762026    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/60f37d4d-640e-4be1-9e91-937c6d91aa60-config-volume\") pod \"dns-default-lpwg5\" (UID: \"60f37d4d-640e-4be1-9e91-937c6d91aa60\") " pod="openshift-dns/dns-default-lpwg5"
Jul 06 12:47:40.766155 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:40.766135    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5199a8fa-633f-4cb1-b46d-83ab71d5f651-cert\") pod \"ingress-canary-zrttp\" (UID: \"5199a8fa-633f-4cb1-b46d-83ab71d5f651\") " pod="openshift-ingress-canary/ingress-canary-zrttp"
Jul 06 12:47:40.774294 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:40.774266    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4g2z\" (UniqueName: \"kubernetes.io/projected/5199a8fa-633f-4cb1-b46d-83ab71d5f651-kube-api-access-b4g2z\") pod \"ingress-canary-zrttp\" (UID: \"5199a8fa-633f-4cb1-b46d-83ab71d5f651\") " pod="openshift-ingress-canary/ingress-canary-zrttp"
Jul 06 12:47:40.775081 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:40.775062    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gj9pt\" (UniqueName: \"kubernetes.io/projected/60f37d4d-640e-4be1-9e91-937c6d91aa60-kube-api-access-gj9pt\") pod \"dns-default-lpwg5\" (UID: \"60f37d4d-640e-4be1-9e91-937c6d91aa60\") " pod="openshift-dns/dns-default-lpwg5"
Jul 06 12:47:40.842033 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:40.842003    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zrttp"
Jul 06 12:47:40.845210 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:40.845186    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:47:41.038380 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:41.038352    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zrttp"]
Jul 06 12:47:41.041667 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:47:41.041637    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5199a8fa_633f_4cb1_b46d_83ab71d5f651.slice/crio-33a105b52005a3a89faa6a81950612a9502287ff8841d501706aa4d9e00f3a76 WatchSource:0}: Error finding container 33a105b52005a3a89faa6a81950612a9502287ff8841d501706aa4d9e00f3a76: Status 404 returned error can't find the container with id 33a105b52005a3a89faa6a81950612a9502287ff8841d501706aa4d9e00f3a76
Jul 06 12:47:41.123957 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:41.123923    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zrttp" event={"ID":"5199a8fa-633f-4cb1-b46d-83ab71d5f651","Type":"ContainerStarted","Data":"33a105b52005a3a89faa6a81950612a9502287ff8841d501706aa4d9e00f3a76"}
Jul 06 12:47:41.266009 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:41.265931    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/60f37d4d-640e-4be1-9e91-937c6d91aa60-metrics-tls\") pod \"dns-default-lpwg5\" (UID: \"60f37d4d-640e-4be1-9e91-937c6d91aa60\") " pod="openshift-dns/dns-default-lpwg5"
Jul 06 12:47:41.266153 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:41.266089    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 12:47:41.266201 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:41.266164    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60f37d4d-640e-4be1-9e91-937c6d91aa60-metrics-tls podName:60f37d4d-640e-4be1-9e91-937c6d91aa60 nodeName:}" failed. No retries permitted until 2026-07-06 12:47:42.266142224 +0000 UTC m=+39.135029868 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/60f37d4d-640e-4be1-9e91-937c6d91aa60-metrics-tls") pod "dns-default-lpwg5" (UID: "60f37d4d-640e-4be1-9e91-937c6d91aa60") : secret "dns-default-metrics-tls" not found
Jul 06 12:47:41.648489 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:41.648252    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nhdrh"
Jul 06 12:47:41.648635 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:41.648255    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vdbtk"
Jul 06 12:47:41.649005 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:41.648262    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xj4sm"
Jul 06 12:47:41.651627 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:41.651609    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 12:47:41.653004 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:41.652981    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 12:47:41.653004 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:41.652982    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dxdc8\""
Jul 06 12:47:41.653160 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:41.653006    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 12:47:41.653160 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:41.653045    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 12:47:41.653160 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:41.653136    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mmbsd\""
Jul 06 12:47:41.856769 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:41.856735    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:47:41.955152 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:41.955074    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:47:42.274154 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:42.274061    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/60f37d4d-640e-4be1-9e91-937c6d91aa60-metrics-tls\") pod \"dns-default-lpwg5\" (UID: \"60f37d4d-640e-4be1-9e91-937c6d91aa60\") " pod="openshift-dns/dns-default-lpwg5"
Jul 06 12:47:42.274284 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:42.274232    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 12:47:42.274327 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:42.274315    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60f37d4d-640e-4be1-9e91-937c6d91aa60-metrics-tls podName:60f37d4d-640e-4be1-9e91-937c6d91aa60 nodeName:}" failed. No retries permitted until 2026-07-06 12:47:44.274294566 +0000 UTC m=+41.143182224 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/60f37d4d-640e-4be1-9e91-937c6d91aa60-metrics-tls") pod "dns-default-lpwg5" (UID: "60f37d4d-640e-4be1-9e91-937c6d91aa60") : secret "dns-default-metrics-tls" not found
Jul 06 12:47:44.134179 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:44.134149    2579 generic.go:356] "Generic (PLEG): container finished" podID="2f70de53-34f6-4a59-9a48-015ddec89a47" containerID="dea151468ace8bffe031d2a3bc4e59e782f4086684d08c376e647b0a50c7b713" exitCode=0
Jul 06 12:47:44.134704 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:44.134201    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-frfnj" event={"ID":"2f70de53-34f6-4a59-9a48-015ddec89a47","Type":"ContainerDied","Data":"dea151468ace8bffe031d2a3bc4e59e782f4086684d08c376e647b0a50c7b713"}
Jul 06 12:47:44.288849 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:44.288810    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/60f37d4d-640e-4be1-9e91-937c6d91aa60-metrics-tls\") pod \"dns-default-lpwg5\" (UID: \"60f37d4d-640e-4be1-9e91-937c6d91aa60\") " pod="openshift-dns/dns-default-lpwg5"
Jul 06 12:47:44.288970 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:44.288937    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 12:47:44.289009 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:44.288993    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60f37d4d-640e-4be1-9e91-937c6d91aa60-metrics-tls podName:60f37d4d-640e-4be1-9e91-937c6d91aa60 nodeName:}" failed. No retries permitted until 2026-07-06 12:47:48.288977464 +0000 UTC m=+45.157865101 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/60f37d4d-640e-4be1-9e91-937c6d91aa60-metrics-tls") pod "dns-default-lpwg5" (UID: "60f37d4d-640e-4be1-9e91-937c6d91aa60") : secret "dns-default-metrics-tls" not found
Jul 06 12:47:44.772535 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:44.772507    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:47:45.140770 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:45.140689    2579 generic.go:356] "Generic (PLEG): container finished" podID="2f70de53-34f6-4a59-9a48-015ddec89a47" containerID="8cdec9fdf55a1e7777b01134e087e0f1347647fc731407f8de6dcf5273f66bf4" exitCode=0
Jul 06 12:47:45.140770 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:45.140732    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-frfnj" event={"ID":"2f70de53-34f6-4a59-9a48-015ddec89a47","Type":"ContainerDied","Data":"8cdec9fdf55a1e7777b01134e087e0f1347647fc731407f8de6dcf5273f66bf4"}
Jul 06 12:47:46.145903 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:46.145805    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-frfnj" event={"ID":"2f70de53-34f6-4a59-9a48-015ddec89a47","Type":"ContainerStarted","Data":"feb429eb8effe3908d4a5861f52781a537e13817906b3539e4dfe552f4ce720f"}
Jul 06 12:47:46.147016 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:46.146993    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zrttp" event={"ID":"5199a8fa-633f-4cb1-b46d-83ab71d5f651","Type":"ContainerStarted","Data":"dece54ce4580d1c4cd12f15942ccd8fb8380f358677f731139b49de246aff6b5"}
Jul 06 12:47:46.192734 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:46.192687    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-frfnj" podStartSLOduration=8.029356521 podStartE2EDuration="42.192674644s" totalImagesPullingTime="34.163318123s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 12:47:04 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:47:46.173436967 +0000 UTC m=+43.042324626" watchObservedRunningTime="2026-07-06 12:47:46.192674644 +0000 UTC m=+43.061562303"
Jul 06 12:47:46.192958 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:46.192938    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-zrttp" podStartSLOduration=1.5125136270000001 podStartE2EDuration="6.192930627s" totalImagesPullingTime="4.680417s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:47:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:47:46.192169552 +0000 UTC m=+43.061057212" watchObservedRunningTime="2026-07-06 12:47:46.192930627 +0000 UTC m=+43.061818286"
Jul 06 12:47:46.367499 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:46.367475    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:47:48.318989 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:48.318953    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/60f37d4d-640e-4be1-9e91-937c6d91aa60-metrics-tls\") pod \"dns-default-lpwg5\" (UID: \"60f37d4d-640e-4be1-9e91-937c6d91aa60\") " pod="openshift-dns/dns-default-lpwg5"
Jul 06 12:47:48.319362 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:48.319096    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 12:47:48.319362 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:48.319153    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60f37d4d-640e-4be1-9e91-937c6d91aa60-metrics-tls podName:60f37d4d-640e-4be1-9e91-937c6d91aa60 nodeName:}" failed. No retries permitted until 2026-07-06 12:47:56.319139343 +0000 UTC m=+53.188026984 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/60f37d4d-640e-4be1-9e91-937c6d91aa60-metrics-tls") pod "dns-default-lpwg5" (UID: "60f37d4d-640e-4be1-9e91-937c6d91aa60") : secret "dns-default-metrics-tls" not found
Jul 06 12:47:56.371030 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:56.370993    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/60f37d4d-640e-4be1-9e91-937c6d91aa60-metrics-tls\") pod \"dns-default-lpwg5\" (UID: \"60f37d4d-640e-4be1-9e91-937c6d91aa60\") " pod="openshift-dns/dns-default-lpwg5"
Jul 06 12:47:56.371470 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:56.371104    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 12:47:56.371470 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:47:56.371158    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60f37d4d-640e-4be1-9e91-937c6d91aa60-metrics-tls podName:60f37d4d-640e-4be1-9e91-937c6d91aa60 nodeName:}" failed. No retries permitted until 2026-07-06 12:48:12.371141406 +0000 UTC m=+69.240029047 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/60f37d4d-640e-4be1-9e91-937c6d91aa60-metrics-tls") pod "dns-default-lpwg5" (UID: "60f37d4d-640e-4be1-9e91-937c6d91aa60") : secret "dns-default-metrics-tls" not found
Jul 06 12:47:57.167692 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:57.167655    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:47:57.329314 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:47:57.329286    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:48:05.125134 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:05.125107    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mp2mx"
Jul 06 12:48:05.367335 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:05.367306    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:48:05.451593 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:05.451529    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:48:09.360408 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:09.360369    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/efc0433a-6604-414a-b029-97f8b1075928-metrics-certs\") pod \"network-metrics-daemon-nhdrh\" (UID: \"efc0433a-6604-414a-b029-97f8b1075928\") " pod="openshift-multus/network-metrics-daemon-nhdrh"
Jul 06 12:48:09.363960 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:09.363944    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 12:48:09.371532 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:48:09.371514    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 06 12:48:09.371601 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:48:09.371582    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/efc0433a-6604-414a-b029-97f8b1075928-metrics-certs podName:efc0433a-6604-414a-b029-97f8b1075928 nodeName:}" failed. No retries permitted until 2026-07-06 12:49:13.371563044 +0000 UTC m=+130.240450684 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/efc0433a-6604-414a-b029-97f8b1075928-metrics-certs") pod "network-metrics-daemon-nhdrh" (UID: "efc0433a-6604-414a-b029-97f8b1075928") : secret "metrics-daemon-secret" not found
Jul 06 12:48:09.461195 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:09.461161    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pc7x\" (UniqueName: \"kubernetes.io/projected/2e3e9cee-032c-466e-8808-9d91f3fe2fc5-kube-api-access-7pc7x\") pod \"network-check-target-xj4sm\" (UID: \"2e3e9cee-032c-466e-8808-9d91f3fe2fc5\") " pod="openshift-network-diagnostics/network-check-target-xj4sm"
Jul 06 12:48:09.461311 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:09.461242    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/063b9802-bd30-43d5-8969-819da64e14b0-original-pull-secret\") pod \"global-pull-secret-syncer-vdbtk\" (UID: \"063b9802-bd30-43d5-8969-819da64e14b0\") " pod="kube-system/global-pull-secret-syncer-vdbtk"
Jul 06 12:48:09.464462 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:09.464446    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 12:48:09.464531 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:09.464487    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 12:48:09.474897 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:09.474878    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 12:48:09.475470 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:09.475442    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/063b9802-bd30-43d5-8969-819da64e14b0-original-pull-secret\") pod \"global-pull-secret-syncer-vdbtk\" (UID: \"063b9802-bd30-43d5-8969-819da64e14b0\") " pod="kube-system/global-pull-secret-syncer-vdbtk"
Jul 06 12:48:09.484359 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:09.484335    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pc7x\" (UniqueName: \"kubernetes.io/projected/2e3e9cee-032c-466e-8808-9d91f3fe2fc5-kube-api-access-7pc7x\") pod \"network-check-target-xj4sm\" (UID: \"2e3e9cee-032c-466e-8808-9d91f3fe2fc5\") " pod="openshift-network-diagnostics/network-check-target-xj4sm"
Jul 06 12:48:09.567688 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:09.567660    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vdbtk"
Jul 06 12:48:09.575672 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:09.575658    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mmbsd\""
Jul 06 12:48:09.583193 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:09.583176    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xj4sm"
Jul 06 12:48:09.694951 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:09.694926    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vdbtk"]
Jul 06 12:48:09.698401 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:48:09.698378    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod063b9802_bd30_43d5_8969_819da64e14b0.slice/crio-cbb381512b4c39a76e194fd0e9cb038732bf259f22d23c86abbe9a86710cc94a WatchSource:0}: Error finding container cbb381512b4c39a76e194fd0e9cb038732bf259f22d23c86abbe9a86710cc94a: Status 404 returned error can't find the container with id cbb381512b4c39a76e194fd0e9cb038732bf259f22d23c86abbe9a86710cc94a
Jul 06 12:48:09.711914 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:09.711894    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xj4sm"]
Jul 06 12:48:09.715214 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:48:09.715192    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e3e9cee_032c_466e_8808_9d91f3fe2fc5.slice/crio-a68fcf369ff4568824599a344b7b93fb322e90f680b116f76d64263dbd3508a4 WatchSource:0}: Error finding container a68fcf369ff4568824599a344b7b93fb322e90f680b116f76d64263dbd3508a4: Status 404 returned error can't find the container with id a68fcf369ff4568824599a344b7b93fb322e90f680b116f76d64263dbd3508a4
Jul 06 12:48:10.175073 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:10.175038    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:48:10.202056 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:10.202023    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vdbtk" event={"ID":"063b9802-bd30-43d5-8969-819da64e14b0","Type":"ContainerStarted","Data":"cbb381512b4c39a76e194fd0e9cb038732bf259f22d23c86abbe9a86710cc94a"}
Jul 06 12:48:10.203346 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:10.203318    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xj4sm" event={"ID":"2e3e9cee-032c-466e-8808-9d91f3fe2fc5","Type":"ContainerStarted","Data":"a68fcf369ff4568824599a344b7b93fb322e90f680b116f76d64263dbd3508a4"}
Jul 06 12:48:10.249640 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:10.249612    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:48:12.380183 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:12.380149    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/60f37d4d-640e-4be1-9e91-937c6d91aa60-metrics-tls\") pod \"dns-default-lpwg5\" (UID: \"60f37d4d-640e-4be1-9e91-937c6d91aa60\") " pod="openshift-dns/dns-default-lpwg5"
Jul 06 12:48:12.380639 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:48:12.380267    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 12:48:12.380639 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:48:12.380338    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60f37d4d-640e-4be1-9e91-937c6d91aa60-metrics-tls podName:60f37d4d-640e-4be1-9e91-937c6d91aa60 nodeName:}" failed. No retries permitted until 2026-07-06 12:48:44.38031759 +0000 UTC m=+101.249205230 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/60f37d4d-640e-4be1-9e91-937c6d91aa60-metrics-tls") pod "dns-default-lpwg5" (UID: "60f37d4d-640e-4be1-9e91-937c6d91aa60") : secret "dns-default-metrics-tls" not found
Jul 06 12:48:15.214923 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:15.214892    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xj4sm" event={"ID":"2e3e9cee-032c-466e-8808-9d91f3fe2fc5","Type":"ContainerStarted","Data":"d8f4952bba5162acbca25590635068e2546a65b5c5cde62670178af869e2dce8"}
Jul 06 12:48:15.215340 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:15.214980    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-xj4sm"
Jul 06 12:48:15.216171 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:15.216149    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vdbtk" event={"ID":"063b9802-bd30-43d5-8969-819da64e14b0","Type":"ContainerStarted","Data":"e96ac7a2502beeba5f9c1816ca108232c6ea977e8b214aec013d6642709a0b2d"}
Jul 06 12:48:15.233040 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:15.232969    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-xj4sm" podStartSLOduration=66.429014385 podStartE2EDuration="1m11.232953354s" totalImagesPullingTime="4.803938969s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:47:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:48:15.232953258 +0000 UTC m=+72.101840917" watchObservedRunningTime="2026-07-06 12:48:15.232953354 +0000 UTC m=+72.101841012"
Jul 06 12:48:15.254749 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:15.254720    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-vdbtk" podStartSLOduration=66.434815977 podStartE2EDuration="1m11.254709509s" totalImagesPullingTime="4.819893532s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 12:47:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:48:15.253982528 +0000 UTC m=+72.122870185" watchObservedRunningTime="2026-07-06 12:48:15.254709509 +0000 UTC m=+72.123597199"
Jul 06 12:48:23.613044 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:23.613014    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-dh2wk"]
Jul 06 12:48:23.616025 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:23.616005    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-dh2wk"
Jul 06 12:48:23.623309 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:23.623291    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 06 12:48:23.623394 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:23.623325    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 06 12:48:23.624658 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:23.624640    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-jg66l\""
Jul 06 12:48:23.624745 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:23.624659    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 06 12:48:23.624745 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:23.624716    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 06 12:48:23.629812 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:23.629776    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-dh2wk"]
Jul 06 12:48:23.640330 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:23.640309    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6f6cd48999-mcm8v"]
Jul 06 12:48:23.642683 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:23.642665    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6f6cd48999-mcm8v"
Jul 06 12:48:23.645967 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:23.645945    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 06 12:48:23.646069 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:23.645997    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 06 12:48:23.646069 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:23.646038    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 06 12:48:23.646069 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:23.646001    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-r28b7\""
Jul 06 12:48:23.646220 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:23.646107    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 06 12:48:23.646397 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:23.646383    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 06 12:48:23.646456 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:23.646443    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 06 12:48:23.652775 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:23.652757    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79wwj\" (UniqueName: \"kubernetes.io/projected/cbacc540-bf45-4a9c-9bbf-9a8ee3ae6ab2-kube-api-access-79wwj\") pod \"kube-storage-version-migrator-operator-846bf668f7-dh2wk\" (UID: \"cbacc540-bf45-4a9c-9bbf-9a8ee3ae6ab2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-dh2wk"
Jul 06 12:48:23.652862 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:23.652798    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cbacc540-bf45-4a9c-9bbf-9a8ee3ae6ab2-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-dh2wk\" (UID: \"cbacc540-bf45-4a9c-9bbf-9a8ee3ae6ab2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-dh2wk"
Jul 06 12:48:23.652903 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:23.652859    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cbacc540-bf45-4a9c-9bbf-9a8ee3ae6ab2-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-dh2wk\" (UID: \"cbacc540-bf45-4a9c-9bbf-9a8ee3ae6ab2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-dh2wk"
Jul 06 12:48:23.659461 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:23.659441    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6f6cd48999-mcm8v"]
Jul 06 12:48:23.753067 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:23.753045    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f02f557a-91ba-46bd-b7a3-32cbe308fa02-default-certificate\") pod \"router-default-6f6cd48999-mcm8v\" (UID: \"f02f557a-91ba-46bd-b7a3-32cbe308fa02\") " pod="openshift-ingress/router-default-6f6cd48999-mcm8v"
Jul 06 12:48:23.753164 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:23.753095    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79wwj\" (UniqueName: \"kubernetes.io/projected/cbacc540-bf45-4a9c-9bbf-9a8ee3ae6ab2-kube-api-access-79wwj\") pod \"kube-storage-version-migrator-operator-846bf668f7-dh2wk\" (UID: \"cbacc540-bf45-4a9c-9bbf-9a8ee3ae6ab2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-dh2wk"
Jul 06 12:48:23.753164 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:23.753111    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f02f557a-91ba-46bd-b7a3-32cbe308fa02-stats-auth\") pod \"router-default-6f6cd48999-mcm8v\" (UID: \"f02f557a-91ba-46bd-b7a3-32cbe308fa02\") " pod="openshift-ingress/router-default-6f6cd48999-mcm8v"
Jul 06 12:48:23.753164 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:23.753146    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cbacc540-bf45-4a9c-9bbf-9a8ee3ae6ab2-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-dh2wk\" (UID: \"cbacc540-bf45-4a9c-9bbf-9a8ee3ae6ab2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-dh2wk"
Jul 06 12:48:23.753275 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:23.753257    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f02f557a-91ba-46bd-b7a3-32cbe308fa02-service-ca-bundle\") pod \"router-default-6f6cd48999-mcm8v\" (UID: \"f02f557a-91ba-46bd-b7a3-32cbe308fa02\") " pod="openshift-ingress/router-default-6f6cd48999-mcm8v"
Jul 06 12:48:23.753357 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:23.753285    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f02f557a-91ba-46bd-b7a3-32cbe308fa02-metrics-certs\") pod \"router-default-6f6cd48999-mcm8v\" (UID: \"f02f557a-91ba-46bd-b7a3-32cbe308fa02\") " pod="openshift-ingress/router-default-6f6cd48999-mcm8v"
Jul 06 12:48:23.753357 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:23.753303    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxs64\" (UniqueName: \"kubernetes.io/projected/f02f557a-91ba-46bd-b7a3-32cbe308fa02-kube-api-access-xxs64\") pod \"router-default-6f6cd48999-mcm8v\" (UID: \"f02f557a-91ba-46bd-b7a3-32cbe308fa02\") " pod="openshift-ingress/router-default-6f6cd48999-mcm8v"
Jul 06 12:48:23.753357 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:23.753332    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cbacc540-bf45-4a9c-9bbf-9a8ee3ae6ab2-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-dh2wk\" (UID: \"cbacc540-bf45-4a9c-9bbf-9a8ee3ae6ab2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-dh2wk"
Jul 06 12:48:23.753628 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:23.753610    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cbacc540-bf45-4a9c-9bbf-9a8ee3ae6ab2-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-dh2wk\" (UID: \"cbacc540-bf45-4a9c-9bbf-9a8ee3ae6ab2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-dh2wk"
Jul 06 12:48:23.755388 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:23.755365    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cbacc540-bf45-4a9c-9bbf-9a8ee3ae6ab2-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-dh2wk\" (UID: \"cbacc540-bf45-4a9c-9bbf-9a8ee3ae6ab2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-dh2wk"
Jul 06 12:48:23.772731 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:23.772710    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-79wwj\" (UniqueName: \"kubernetes.io/projected/cbacc540-bf45-4a9c-9bbf-9a8ee3ae6ab2-kube-api-access-79wwj\") pod \"kube-storage-version-migrator-operator-846bf668f7-dh2wk\" (UID: \"cbacc540-bf45-4a9c-9bbf-9a8ee3ae6ab2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-dh2wk"
Jul 06 12:48:23.819820 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:23.819795    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7khg2"]
Jul 06 12:48:23.822157 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:23.822143    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7khg2"
Jul 06 12:48:23.825223 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:23.825204    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 06 12:48:23.825433 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:23.825414    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 06 12:48:23.825501 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:23.825474    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 06 12:48:23.825621 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:23.825607    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-5qw85\""
Jul 06 12:48:23.825724 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:23.825711    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 06 12:48:23.837449 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:23.837428    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7khg2"]
Jul 06 12:48:23.853778 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:23.853758    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f02f557a-91ba-46bd-b7a3-32cbe308fa02-service-ca-bundle\") pod \"router-default-6f6cd48999-mcm8v\" (UID: \"f02f557a-91ba-46bd-b7a3-32cbe308fa02\") " pod="openshift-ingress/router-default-6f6cd48999-mcm8v"
Jul 06 12:48:23.853869 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:23.853786    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f02f557a-91ba-46bd-b7a3-32cbe308fa02-metrics-certs\") pod \"router-default-6f6cd48999-mcm8v\" (UID: \"f02f557a-91ba-46bd-b7a3-32cbe308fa02\") " pod="openshift-ingress/router-default-6f6cd48999-mcm8v"
Jul 06 12:48:23.853869 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:23.853801    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxs64\" (UniqueName: \"kubernetes.io/projected/f02f557a-91ba-46bd-b7a3-32cbe308fa02-kube-api-access-xxs64\") pod \"router-default-6f6cd48999-mcm8v\" (UID: \"f02f557a-91ba-46bd-b7a3-32cbe308fa02\") " pod="openshift-ingress/router-default-6f6cd48999-mcm8v"
Jul 06 12:48:23.853869 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:23.853821    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f02f557a-91ba-46bd-b7a3-32cbe308fa02-default-certificate\") pod \"router-default-6f6cd48999-mcm8v\" (UID: \"f02f557a-91ba-46bd-b7a3-32cbe308fa02\") " pod="openshift-ingress/router-default-6f6cd48999-mcm8v"
Jul 06 12:48:23.854009 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:23.853880    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f02f557a-91ba-46bd-b7a3-32cbe308fa02-stats-auth\") pod \"router-default-6f6cd48999-mcm8v\" (UID: \"f02f557a-91ba-46bd-b7a3-32cbe308fa02\") " pod="openshift-ingress/router-default-6f6cd48999-mcm8v"
Jul 06 12:48:23.854009 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:48:23.853907    2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 12:48:23.854009 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:48:23.853940    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f02f557a-91ba-46bd-b7a3-32cbe308fa02-service-ca-bundle podName:f02f557a-91ba-46bd-b7a3-32cbe308fa02 nodeName:}" failed. No retries permitted until 2026-07-06 12:48:24.353924677 +0000 UTC m=+81.222812314 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f02f557a-91ba-46bd-b7a3-32cbe308fa02-service-ca-bundle") pod "router-default-6f6cd48999-mcm8v" (UID: "f02f557a-91ba-46bd-b7a3-32cbe308fa02") : configmap references non-existent config key: service-ca.crt
Jul 06 12:48:23.854009 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:48:23.853958    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f02f557a-91ba-46bd-b7a3-32cbe308fa02-metrics-certs podName:f02f557a-91ba-46bd-b7a3-32cbe308fa02 nodeName:}" failed. No retries permitted until 2026-07-06 12:48:24.353948428 +0000 UTC m=+81.222836072 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f02f557a-91ba-46bd-b7a3-32cbe308fa02-metrics-certs") pod "router-default-6f6cd48999-mcm8v" (UID: "f02f557a-91ba-46bd-b7a3-32cbe308fa02") : secret "router-metrics-certs-default" not found
Jul 06 12:48:23.856074 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:23.856053    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f02f557a-91ba-46bd-b7a3-32cbe308fa02-stats-auth\") pod \"router-default-6f6cd48999-mcm8v\" (UID: \"f02f557a-91ba-46bd-b7a3-32cbe308fa02\") " pod="openshift-ingress/router-default-6f6cd48999-mcm8v"
Jul 06 12:48:23.856203 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:23.856182    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f02f557a-91ba-46bd-b7a3-32cbe308fa02-default-certificate\") pod \"router-default-6f6cd48999-mcm8v\" (UID: \"f02f557a-91ba-46bd-b7a3-32cbe308fa02\") " pod="openshift-ingress/router-default-6f6cd48999-mcm8v"
Jul 06 12:48:23.863733 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:23.863693    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxs64\" (UniqueName: \"kubernetes.io/projected/f02f557a-91ba-46bd-b7a3-32cbe308fa02-kube-api-access-xxs64\") pod \"router-default-6f6cd48999-mcm8v\" (UID: \"f02f557a-91ba-46bd-b7a3-32cbe308fa02\") " pod="openshift-ingress/router-default-6f6cd48999-mcm8v"
Jul 06 12:48:23.881651 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:23.881631    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:48:23.924067 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:23.924051    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-dh2wk"
Jul 06 12:48:23.954630 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:23.954605    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gs5kp\" (UniqueName: \"kubernetes.io/projected/9678d2c6-71a7-4a4a-8d4c-815f98fc355f-kube-api-access-gs5kp\") pod \"service-ca-operator-5d46d9ffd4-7khg2\" (UID: \"9678d2c6-71a7-4a4a-8d4c-815f98fc355f\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7khg2"
Jul 06 12:48:23.954736 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:23.954690    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9678d2c6-71a7-4a4a-8d4c-815f98fc355f-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-7khg2\" (UID: \"9678d2c6-71a7-4a4a-8d4c-815f98fc355f\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7khg2"
Jul 06 12:48:23.954777 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:23.954733    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9678d2c6-71a7-4a4a-8d4c-815f98fc355f-config\") pod \"service-ca-operator-5d46d9ffd4-7khg2\" (UID: \"9678d2c6-71a7-4a4a-8d4c-815f98fc355f\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7khg2"
Jul 06 12:48:23.965584 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:23.965558    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:48:24.043800 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:24.043774    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-dh2wk"]
Jul 06 12:48:24.046957 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:48:24.046927    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbacc540_bf45_4a9c_9bbf_9a8ee3ae6ab2.slice/crio-2b5726fdb1bd5fe6cbc36322266e0cda00a2d154af277a849419265c920ce144 WatchSource:0}: Error finding container 2b5726fdb1bd5fe6cbc36322266e0cda00a2d154af277a849419265c920ce144: Status 404 returned error can't find the container with id 2b5726fdb1bd5fe6cbc36322266e0cda00a2d154af277a849419265c920ce144
Jul 06 12:48:24.055329 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:24.055309    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gs5kp\" (UniqueName: \"kubernetes.io/projected/9678d2c6-71a7-4a4a-8d4c-815f98fc355f-kube-api-access-gs5kp\") pod \"service-ca-operator-5d46d9ffd4-7khg2\" (UID: \"9678d2c6-71a7-4a4a-8d4c-815f98fc355f\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7khg2"
Jul 06 12:48:24.055401 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:24.055343    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9678d2c6-71a7-4a4a-8d4c-815f98fc355f-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-7khg2\" (UID: \"9678d2c6-71a7-4a4a-8d4c-815f98fc355f\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7khg2"
Jul 06 12:48:24.055401 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:24.055361    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9678d2c6-71a7-4a4a-8d4c-815f98fc355f-config\") pod \"service-ca-operator-5d46d9ffd4-7khg2\" (UID: \"9678d2c6-71a7-4a4a-8d4c-815f98fc355f\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7khg2"
Jul 06 12:48:24.055798 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:24.055778    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9678d2c6-71a7-4a4a-8d4c-815f98fc355f-config\") pod \"service-ca-operator-5d46d9ffd4-7khg2\" (UID: \"9678d2c6-71a7-4a4a-8d4c-815f98fc355f\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7khg2"
Jul 06 12:48:24.057255 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:24.057239    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9678d2c6-71a7-4a4a-8d4c-815f98fc355f-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-7khg2\" (UID: \"9678d2c6-71a7-4a4a-8d4c-815f98fc355f\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7khg2"
Jul 06 12:48:24.066646 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:24.066627    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gs5kp\" (UniqueName: \"kubernetes.io/projected/9678d2c6-71a7-4a4a-8d4c-815f98fc355f-kube-api-access-gs5kp\") pod \"service-ca-operator-5d46d9ffd4-7khg2\" (UID: \"9678d2c6-71a7-4a4a-8d4c-815f98fc355f\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7khg2"
Jul 06 12:48:24.130695 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:24.130649    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7khg2"
Jul 06 12:48:24.237145 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:24.237115    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-dh2wk" event={"ID":"cbacc540-bf45-4a9c-9bbf-9a8ee3ae6ab2","Type":"ContainerStarted","Data":"2b5726fdb1bd5fe6cbc36322266e0cda00a2d154af277a849419265c920ce144"}
Jul 06 12:48:24.248265 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:24.248235    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7khg2"]
Jul 06 12:48:24.251537 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:48:24.251516    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9678d2c6_71a7_4a4a_8d4c_815f98fc355f.slice/crio-aa446749e205deaf95a113ccffa33402d12e6b4a180d1a913b319a3519b6acc6 WatchSource:0}: Error finding container aa446749e205deaf95a113ccffa33402d12e6b4a180d1a913b319a3519b6acc6: Status 404 returned error can't find the container with id aa446749e205deaf95a113ccffa33402d12e6b4a180d1a913b319a3519b6acc6
Jul 06 12:48:24.357825 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:24.357804    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f02f557a-91ba-46bd-b7a3-32cbe308fa02-service-ca-bundle\") pod \"router-default-6f6cd48999-mcm8v\" (UID: \"f02f557a-91ba-46bd-b7a3-32cbe308fa02\") " pod="openshift-ingress/router-default-6f6cd48999-mcm8v"
Jul 06 12:48:24.357923 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:24.357830    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f02f557a-91ba-46bd-b7a3-32cbe308fa02-metrics-certs\") pod \"router-default-6f6cd48999-mcm8v\" (UID: \"f02f557a-91ba-46bd-b7a3-32cbe308fa02\") " pod="openshift-ingress/router-default-6f6cd48999-mcm8v"
Jul 06 12:48:24.357969 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:48:24.357954    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f02f557a-91ba-46bd-b7a3-32cbe308fa02-service-ca-bundle podName:f02f557a-91ba-46bd-b7a3-32cbe308fa02 nodeName:}" failed. No retries permitted until 2026-07-06 12:48:25.357936377 +0000 UTC m=+82.226824013 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f02f557a-91ba-46bd-b7a3-32cbe308fa02-service-ca-bundle") pod "router-default-6f6cd48999-mcm8v" (UID: "f02f557a-91ba-46bd-b7a3-32cbe308fa02") : configmap references non-existent config key: service-ca.crt
Jul 06 12:48:24.357969 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:48:24.357965    2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 12:48:24.358046 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:48:24.358002    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f02f557a-91ba-46bd-b7a3-32cbe308fa02-metrics-certs podName:f02f557a-91ba-46bd-b7a3-32cbe308fa02 nodeName:}" failed. No retries permitted until 2026-07-06 12:48:25.357988776 +0000 UTC m=+82.226876412 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f02f557a-91ba-46bd-b7a3-32cbe308fa02-metrics-certs") pod "router-default-6f6cd48999-mcm8v" (UID: "f02f557a-91ba-46bd-b7a3-32cbe308fa02") : secret "router-metrics-certs-default" not found
Jul 06 12:48:25.241724 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:25.241684    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7khg2" event={"ID":"9678d2c6-71a7-4a4a-8d4c-815f98fc355f","Type":"ContainerStarted","Data":"aa446749e205deaf95a113ccffa33402d12e6b4a180d1a913b319a3519b6acc6"}
Jul 06 12:48:25.365441 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:25.365393    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f02f557a-91ba-46bd-b7a3-32cbe308fa02-service-ca-bundle\") pod \"router-default-6f6cd48999-mcm8v\" (UID: \"f02f557a-91ba-46bd-b7a3-32cbe308fa02\") " pod="openshift-ingress/router-default-6f6cd48999-mcm8v"
Jul 06 12:48:25.365441 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:25.365442    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f02f557a-91ba-46bd-b7a3-32cbe308fa02-metrics-certs\") pod \"router-default-6f6cd48999-mcm8v\" (UID: \"f02f557a-91ba-46bd-b7a3-32cbe308fa02\") " pod="openshift-ingress/router-default-6f6cd48999-mcm8v"
Jul 06 12:48:25.365705 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:48:25.365570    2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 12:48:25.365705 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:48:25.365595    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f02f557a-91ba-46bd-b7a3-32cbe308fa02-service-ca-bundle podName:f02f557a-91ba-46bd-b7a3-32cbe308fa02 nodeName:}" failed. No retries permitted until 2026-07-06 12:48:27.365570067 +0000 UTC m=+84.234457710 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f02f557a-91ba-46bd-b7a3-32cbe308fa02-service-ca-bundle") pod "router-default-6f6cd48999-mcm8v" (UID: "f02f557a-91ba-46bd-b7a3-32cbe308fa02") : configmap references non-existent config key: service-ca.crt
Jul 06 12:48:25.365705 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:48:25.365623    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f02f557a-91ba-46bd-b7a3-32cbe308fa02-metrics-certs podName:f02f557a-91ba-46bd-b7a3-32cbe308fa02 nodeName:}" failed. No retries permitted until 2026-07-06 12:48:27.365614543 +0000 UTC m=+84.234502179 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f02f557a-91ba-46bd-b7a3-32cbe308fa02-metrics-certs") pod "router-default-6f6cd48999-mcm8v" (UID: "f02f557a-91ba-46bd-b7a3-32cbe308fa02") : secret "router-metrics-certs-default" not found
Jul 06 12:48:27.146920 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:27.146888    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:48:27.248023 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:27.247994    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7khg2" event={"ID":"9678d2c6-71a7-4a4a-8d4c-815f98fc355f","Type":"ContainerStarted","Data":"138f603e78adcb086d5954119a024005d62e7ddcb0333bbcf90bcfdd6bd250f2"}
Jul 06 12:48:27.249439 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:27.249408    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-dh2wk" event={"ID":"cbacc540-bf45-4a9c-9bbf-9a8ee3ae6ab2","Type":"ContainerStarted","Data":"e199d008caaabe6bf2df12467ded5104cfdea4adb784ae996867f3f9cc2b0d28"}
Jul 06 12:48:27.316499 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:27.316452    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:48:27.326241 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:27.326199    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-dh2wk" podStartSLOduration=2.417973166 podStartE2EDuration="4.326186381s" totalImagesPullingTime="1.908213215s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:48:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:48:27.324906517 +0000 UTC m=+84.193794186" watchObservedRunningTime="2026-07-06 12:48:27.326186381 +0000 UTC m=+84.195074085"
Jul 06 12:48:27.326454 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:27.326435    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7khg2" podStartSLOduration=2.104901057 podStartE2EDuration="4.326429852s" totalImagesPullingTime="2.221528795s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:48:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:48:27.282318952 +0000 UTC m=+84.151206608" watchObservedRunningTime="2026-07-06 12:48:27.326429852 +0000 UTC m=+84.195317512"
Jul 06 12:48:27.382513 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:27.382477    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f02f557a-91ba-46bd-b7a3-32cbe308fa02-service-ca-bundle\") pod \"router-default-6f6cd48999-mcm8v\" (UID: \"f02f557a-91ba-46bd-b7a3-32cbe308fa02\") " pod="openshift-ingress/router-default-6f6cd48999-mcm8v"
Jul 06 12:48:27.382681 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:27.382520    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f02f557a-91ba-46bd-b7a3-32cbe308fa02-metrics-certs\") pod \"router-default-6f6cd48999-mcm8v\" (UID: \"f02f557a-91ba-46bd-b7a3-32cbe308fa02\") " pod="openshift-ingress/router-default-6f6cd48999-mcm8v"
Jul 06 12:48:27.382681 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:48:27.382655    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f02f557a-91ba-46bd-b7a3-32cbe308fa02-service-ca-bundle podName:f02f557a-91ba-46bd-b7a3-32cbe308fa02 nodeName:}" failed. No retries permitted until 2026-07-06 12:48:31.38263532 +0000 UTC m=+88.251522972 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f02f557a-91ba-46bd-b7a3-32cbe308fa02-service-ca-bundle") pod "router-default-6f6cd48999-mcm8v" (UID: "f02f557a-91ba-46bd-b7a3-32cbe308fa02") : configmap references non-existent config key: service-ca.crt
Jul 06 12:48:27.383241 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:48:27.383125    2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 12:48:27.383241 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:48:27.383176    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f02f557a-91ba-46bd-b7a3-32cbe308fa02-metrics-certs podName:f02f557a-91ba-46bd-b7a3-32cbe308fa02 nodeName:}" failed. No retries permitted until 2026-07-06 12:48:31.383159452 +0000 UTC m=+88.252047095 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f02f557a-91ba-46bd-b7a3-32cbe308fa02-metrics-certs") pod "router-default-6f6cd48999-mcm8v" (UID: "f02f557a-91ba-46bd-b7a3-32cbe308fa02") : secret "router-metrics-certs-default" not found
Jul 06 12:48:27.804056 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:27.804023    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:48:28.254006 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:28.253979    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:48:28.334637 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:28.334610    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-rbvk6"]
Jul 06 12:48:28.338909 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:28.338893    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rbvk6"
Jul 06 12:48:28.343419 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:28.343399    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-h754f\""
Jul 06 12:48:28.344023 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:28.344005    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 06 12:48:28.344121 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:28.344028    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 06 12:48:28.344121 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:28.344040    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 06 12:48:28.344121 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:28.344028    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 06 12:48:28.378006 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:28.377987    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rbvk6"]
Jul 06 12:48:28.391456 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:28.391435    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fccdb6dc-a166-4794-97dc-c533a4c56673-data-volume\") pod \"insights-runtime-extractor-rbvk6\" (UID: \"fccdb6dc-a166-4794-97dc-c533a4c56673\") " pod="openshift-insights/insights-runtime-extractor-rbvk6"
Jul 06 12:48:28.391548 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:28.391468    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fccdb6dc-a166-4794-97dc-c533a4c56673-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rbvk6\" (UID: \"fccdb6dc-a166-4794-97dc-c533a4c56673\") " pod="openshift-insights/insights-runtime-extractor-rbvk6"
Jul 06 12:48:28.391548 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:28.391487    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fccdb6dc-a166-4794-97dc-c533a4c56673-crio-socket\") pod \"insights-runtime-extractor-rbvk6\" (UID: \"fccdb6dc-a166-4794-97dc-c533a4c56673\") " pod="openshift-insights/insights-runtime-extractor-rbvk6"
Jul 06 12:48:28.391631 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:28.391589    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fccdb6dc-a166-4794-97dc-c533a4c56673-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rbvk6\" (UID: \"fccdb6dc-a166-4794-97dc-c533a4c56673\") " pod="openshift-insights/insights-runtime-extractor-rbvk6"
Jul 06 12:48:28.391631 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:28.391627    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66z6r\" (UniqueName: \"kubernetes.io/projected/fccdb6dc-a166-4794-97dc-c533a4c56673-kube-api-access-66z6r\") pod \"insights-runtime-extractor-rbvk6\" (UID: \"fccdb6dc-a166-4794-97dc-c533a4c56673\") " pod="openshift-insights/insights-runtime-extractor-rbvk6"
Jul 06 12:48:28.492348 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:28.492321    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fccdb6dc-a166-4794-97dc-c533a4c56673-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rbvk6\" (UID: \"fccdb6dc-a166-4794-97dc-c533a4c56673\") " pod="openshift-insights/insights-runtime-extractor-rbvk6"
Jul 06 12:48:28.492348 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:28.492348    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66z6r\" (UniqueName: \"kubernetes.io/projected/fccdb6dc-a166-4794-97dc-c533a4c56673-kube-api-access-66z6r\") pod \"insights-runtime-extractor-rbvk6\" (UID: \"fccdb6dc-a166-4794-97dc-c533a4c56673\") " pod="openshift-insights/insights-runtime-extractor-rbvk6"
Jul 06 12:48:28.492489 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:28.492427    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fccdb6dc-a166-4794-97dc-c533a4c56673-data-volume\") pod \"insights-runtime-extractor-rbvk6\" (UID: \"fccdb6dc-a166-4794-97dc-c533a4c56673\") " pod="openshift-insights/insights-runtime-extractor-rbvk6"
Jul 06 12:48:28.492489 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:48:28.492462    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 12:48:28.492561 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:48:28.492505    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 12:48:28.492561 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:48:28.492519    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fccdb6dc-a166-4794-97dc-c533a4c56673-insights-runtime-extractor-tls podName:fccdb6dc-a166-4794-97dc-c533a4c56673 nodeName:}" failed. No retries permitted until 2026-07-06 12:48:28.992501564 +0000 UTC m=+85.861389220 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fccdb6dc-a166-4794-97dc-c533a4c56673-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rbvk6" (UID: "fccdb6dc-a166-4794-97dc-c533a4c56673") : secret "insights-runtime-extractor-tls" not found
Jul 06 12:48:28.492561 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:48:28.492538    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fccdb6dc-a166-4794-97dc-c533a4c56673-kube-rbac-proxy-cm podName:fccdb6dc-a166-4794-97dc-c533a4c56673 nodeName:}" failed. No retries permitted until 2026-07-06 12:48:28.992528037 +0000 UTC m=+85.861415673 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fccdb6dc-a166-4794-97dc-c533a4c56673-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rbvk6" (UID: "fccdb6dc-a166-4794-97dc-c533a4c56673") : configmap "kube-rbac-proxy" not found
Jul 06 12:48:28.492561 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:28.492461    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fccdb6dc-a166-4794-97dc-c533a4c56673-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rbvk6\" (UID: \"fccdb6dc-a166-4794-97dc-c533a4c56673\") " pod="openshift-insights/insights-runtime-extractor-rbvk6"
Jul 06 12:48:28.492707 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:28.492565    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fccdb6dc-a166-4794-97dc-c533a4c56673-crio-socket\") pod \"insights-runtime-extractor-rbvk6\" (UID: \"fccdb6dc-a166-4794-97dc-c533a4c56673\") " pod="openshift-insights/insights-runtime-extractor-rbvk6"
Jul 06 12:48:28.492707 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:28.492634    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fccdb6dc-a166-4794-97dc-c533a4c56673-crio-socket\") pod \"insights-runtime-extractor-rbvk6\" (UID: \"fccdb6dc-a166-4794-97dc-c533a4c56673\") " pod="openshift-insights/insights-runtime-extractor-rbvk6"
Jul 06 12:48:28.492767 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:28.492748    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fccdb6dc-a166-4794-97dc-c533a4c56673-data-volume\") pod \"insights-runtime-extractor-rbvk6\" (UID: \"fccdb6dc-a166-4794-97dc-c533a4c56673\") " pod="openshift-insights/insights-runtime-extractor-rbvk6"
Jul 06 12:48:28.517706 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:28.517648    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-66z6r\" (UniqueName: \"kubernetes.io/projected/fccdb6dc-a166-4794-97dc-c533a4c56673-kube-api-access-66z6r\") pod \"insights-runtime-extractor-rbvk6\" (UID: \"fccdb6dc-a166-4794-97dc-c533a4c56673\") " pod="openshift-insights/insights-runtime-extractor-rbvk6"
Jul 06 12:48:28.586958 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:28.586935    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:48:28.763724 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:28.763698    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:48:28.995773 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:28.995748    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fccdb6dc-a166-4794-97dc-c533a4c56673-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rbvk6\" (UID: \"fccdb6dc-a166-4794-97dc-c533a4c56673\") " pod="openshift-insights/insights-runtime-extractor-rbvk6"
Jul 06 12:48:28.995957 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:28.995805    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fccdb6dc-a166-4794-97dc-c533a4c56673-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rbvk6\" (UID: \"fccdb6dc-a166-4794-97dc-c533a4c56673\") " pod="openshift-insights/insights-runtime-extractor-rbvk6"
Jul 06 12:48:28.995957 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:48:28.995878    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 12:48:28.995957 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:48:28.995923    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 12:48:28.995957 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:48:28.995940    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fccdb6dc-a166-4794-97dc-c533a4c56673-kube-rbac-proxy-cm podName:fccdb6dc-a166-4794-97dc-c533a4c56673 nodeName:}" failed. No retries permitted until 2026-07-06 12:48:29.99592598 +0000 UTC m=+86.864813616 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fccdb6dc-a166-4794-97dc-c533a4c56673-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rbvk6" (UID: "fccdb6dc-a166-4794-97dc-c533a4c56673") : configmap "kube-rbac-proxy" not found
Jul 06 12:48:28.996154 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:48:28.995973    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fccdb6dc-a166-4794-97dc-c533a4c56673-insights-runtime-extractor-tls podName:fccdb6dc-a166-4794-97dc-c533a4c56673 nodeName:}" failed. No retries permitted until 2026-07-06 12:48:29.995956532 +0000 UTC m=+86.864844171 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fccdb6dc-a166-4794-97dc-c533a4c56673-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rbvk6" (UID: "fccdb6dc-a166-4794-97dc-c533a4c56673") : secret "insights-runtime-extractor-tls" not found
Jul 06 12:48:29.052180 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:29.052158    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:48:29.289319 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:29.289252    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:48:29.484146 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:29.484124    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:48:30.003148 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:30.003116    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fccdb6dc-a166-4794-97dc-c533a4c56673-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rbvk6\" (UID: \"fccdb6dc-a166-4794-97dc-c533a4c56673\") " pod="openshift-insights/insights-runtime-extractor-rbvk6"
Jul 06 12:48:30.003346 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:30.003160    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fccdb6dc-a166-4794-97dc-c533a4c56673-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rbvk6\" (UID: \"fccdb6dc-a166-4794-97dc-c533a4c56673\") " pod="openshift-insights/insights-runtime-extractor-rbvk6"
Jul 06 12:48:30.003346 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:48:30.003253    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 12:48:30.003346 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:48:30.003253    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 12:48:30.003346 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:48:30.003306    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fccdb6dc-a166-4794-97dc-c533a4c56673-insights-runtime-extractor-tls podName:fccdb6dc-a166-4794-97dc-c533a4c56673 nodeName:}" failed. No retries permitted until 2026-07-06 12:48:32.003293766 +0000 UTC m=+88.872181403 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fccdb6dc-a166-4794-97dc-c533a4c56673-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rbvk6" (UID: "fccdb6dc-a166-4794-97dc-c533a4c56673") : secret "insights-runtime-extractor-tls" not found
Jul 06 12:48:30.003346 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:48:30.003318    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fccdb6dc-a166-4794-97dc-c533a4c56673-kube-rbac-proxy-cm podName:fccdb6dc-a166-4794-97dc-c533a4c56673 nodeName:}" failed. No retries permitted until 2026-07-06 12:48:32.00331281 +0000 UTC m=+88.872200446 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fccdb6dc-a166-4794-97dc-c533a4c56673-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rbvk6" (UID: "fccdb6dc-a166-4794-97dc-c533a4c56673") : configmap "kube-rbac-proxy" not found
Jul 06 12:48:30.854945 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:30.854912    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-pmthv"]
Jul 06 12:48:30.859206 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:30.859183    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-pmthv"
Jul 06 12:48:30.870825 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:30.870807    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 06 12:48:30.871035 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:30.871021    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 06 12:48:30.871834 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:30.871820    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-6nrhv\""
Jul 06 12:48:30.871952 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:30.871836    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 06 12:48:30.871952 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:30.871833    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 06 12:48:30.881521 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:30.881501    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-pmthv"]
Jul 06 12:48:30.910614 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:30.910595    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/957a5846-5736-4550-82df-c72711d05309-signing-cabundle\") pod \"service-ca-758f599c5-pmthv\" (UID: \"957a5846-5736-4550-82df-c72711d05309\") " pod="openshift-service-ca/service-ca-758f599c5-pmthv"
Jul 06 12:48:30.910711 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:30.910622    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxvlw\" (UniqueName: \"kubernetes.io/projected/957a5846-5736-4550-82df-c72711d05309-kube-api-access-lxvlw\") pod \"service-ca-758f599c5-pmthv\" (UID: \"957a5846-5736-4550-82df-c72711d05309\") " pod="openshift-service-ca/service-ca-758f599c5-pmthv"
Jul 06 12:48:30.910711 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:30.910639    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/957a5846-5736-4550-82df-c72711d05309-signing-key\") pod \"service-ca-758f599c5-pmthv\" (UID: \"957a5846-5736-4550-82df-c72711d05309\") " pod="openshift-service-ca/service-ca-758f599c5-pmthv"
Jul 06 12:48:30.936359 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:30.936340    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:48:31.011262 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:31.011238    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/957a5846-5736-4550-82df-c72711d05309-signing-cabundle\") pod \"service-ca-758f599c5-pmthv\" (UID: \"957a5846-5736-4550-82df-c72711d05309\") " pod="openshift-service-ca/service-ca-758f599c5-pmthv"
Jul 06 12:48:31.011352 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:31.011266    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxvlw\" (UniqueName: \"kubernetes.io/projected/957a5846-5736-4550-82df-c72711d05309-kube-api-access-lxvlw\") pod \"service-ca-758f599c5-pmthv\" (UID: \"957a5846-5736-4550-82df-c72711d05309\") " pod="openshift-service-ca/service-ca-758f599c5-pmthv"
Jul 06 12:48:31.011352 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:31.011285    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/957a5846-5736-4550-82df-c72711d05309-signing-key\") pod \"service-ca-758f599c5-pmthv\" (UID: \"957a5846-5736-4550-82df-c72711d05309\") " pod="openshift-service-ca/service-ca-758f599c5-pmthv"
Jul 06 12:48:31.011936 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:31.011920    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/957a5846-5736-4550-82df-c72711d05309-signing-cabundle\") pod \"service-ca-758f599c5-pmthv\" (UID: \"957a5846-5736-4550-82df-c72711d05309\") " pod="openshift-service-ca/service-ca-758f599c5-pmthv"
Jul 06 12:48:31.013622 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:31.013602    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/957a5846-5736-4550-82df-c72711d05309-signing-key\") pod \"service-ca-758f599c5-pmthv\" (UID: \"957a5846-5736-4550-82df-c72711d05309\") " pod="openshift-service-ca/service-ca-758f599c5-pmthv"
Jul 06 12:48:31.024153 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:31.024127    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxvlw\" (UniqueName: \"kubernetes.io/projected/957a5846-5736-4550-82df-c72711d05309-kube-api-access-lxvlw\") pod \"service-ca-758f599c5-pmthv\" (UID: \"957a5846-5736-4550-82df-c72711d05309\") " pod="openshift-service-ca/service-ca-758f599c5-pmthv"
Jul 06 12:48:31.079622 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:31.079597    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:48:31.147606 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:31.147560    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9jrvv_e61427e6-62cd-44b6-9f9a-5f3bd906d29a/dns-node-resolver/0.log"
Jul 06 12:48:31.167115 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:31.167099    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-pmthv"
Jul 06 12:48:31.218368 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:31.218334    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:48:31.299428 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:31.299388    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-pmthv"]
Jul 06 12:48:31.302666 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:48:31.302644    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod957a5846_5736_4550_82df_c72711d05309.slice/crio-d194d08cfe124a2b787dcc60372f6a99d8ace55b26e359c5091beb10a70a1e0b WatchSource:0}: Error finding container d194d08cfe124a2b787dcc60372f6a99d8ace55b26e359c5091beb10a70a1e0b: Status 404 returned error can't find the container with id d194d08cfe124a2b787dcc60372f6a99d8ace55b26e359c5091beb10a70a1e0b
Jul 06 12:48:31.415099 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:31.415025    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f02f557a-91ba-46bd-b7a3-32cbe308fa02-service-ca-bundle\") pod \"router-default-6f6cd48999-mcm8v\" (UID: \"f02f557a-91ba-46bd-b7a3-32cbe308fa02\") " pod="openshift-ingress/router-default-6f6cd48999-mcm8v"
Jul 06 12:48:31.415099 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:31.415064    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f02f557a-91ba-46bd-b7a3-32cbe308fa02-metrics-certs\") pod \"router-default-6f6cd48999-mcm8v\" (UID: \"f02f557a-91ba-46bd-b7a3-32cbe308fa02\") " pod="openshift-ingress/router-default-6f6cd48999-mcm8v"
Jul 06 12:48:31.415279 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:48:31.415199    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f02f557a-91ba-46bd-b7a3-32cbe308fa02-service-ca-bundle podName:f02f557a-91ba-46bd-b7a3-32cbe308fa02 nodeName:}" failed. No retries permitted until 2026-07-06 12:48:39.415179674 +0000 UTC m=+96.284067328 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f02f557a-91ba-46bd-b7a3-32cbe308fa02-service-ca-bundle") pod "router-default-6f6cd48999-mcm8v" (UID: "f02f557a-91ba-46bd-b7a3-32cbe308fa02") : configmap references non-existent config key: service-ca.crt
Jul 06 12:48:31.415279 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:48:31.415200    2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 12:48:31.415279 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:48:31.415239    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f02f557a-91ba-46bd-b7a3-32cbe308fa02-metrics-certs podName:f02f557a-91ba-46bd-b7a3-32cbe308fa02 nodeName:}" failed. No retries permitted until 2026-07-06 12:48:39.415229855 +0000 UTC m=+96.284117491 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f02f557a-91ba-46bd-b7a3-32cbe308fa02-metrics-certs") pod "router-default-6f6cd48999-mcm8v" (UID: "f02f557a-91ba-46bd-b7a3-32cbe308fa02") : secret "router-metrics-certs-default" not found
Jul 06 12:48:32.019301 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:32.019269    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fccdb6dc-a166-4794-97dc-c533a4c56673-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rbvk6\" (UID: \"fccdb6dc-a166-4794-97dc-c533a4c56673\") " pod="openshift-insights/insights-runtime-extractor-rbvk6"
Jul 06 12:48:32.019659 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:32.019376    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fccdb6dc-a166-4794-97dc-c533a4c56673-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rbvk6\" (UID: \"fccdb6dc-a166-4794-97dc-c533a4c56673\") " pod="openshift-insights/insights-runtime-extractor-rbvk6"
Jul 06 12:48:32.019659 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:48:32.019411    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 12:48:32.019659 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:48:32.019477    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 12:48:32.019659 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:48:32.019480    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fccdb6dc-a166-4794-97dc-c533a4c56673-insights-runtime-extractor-tls podName:fccdb6dc-a166-4794-97dc-c533a4c56673 nodeName:}" failed. No retries permitted until 2026-07-06 12:48:36.019464352 +0000 UTC m=+92.888351990 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fccdb6dc-a166-4794-97dc-c533a4c56673-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rbvk6" (UID: "fccdb6dc-a166-4794-97dc-c533a4c56673") : secret "insights-runtime-extractor-tls" not found
Jul 06 12:48:32.019659 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:48:32.019529    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fccdb6dc-a166-4794-97dc-c533a4c56673-kube-rbac-proxy-cm podName:fccdb6dc-a166-4794-97dc-c533a4c56673 nodeName:}" failed. No retries permitted until 2026-07-06 12:48:36.019517586 +0000 UTC m=+92.888405222 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fccdb6dc-a166-4794-97dc-c533a4c56673-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rbvk6" (UID: "fccdb6dc-a166-4794-97dc-c533a4c56673") : configmap "kube-rbac-proxy" not found
Jul 06 12:48:32.206170 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:32.206135    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:48:32.263737 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:32.263699    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-pmthv" event={"ID":"957a5846-5736-4550-82df-c72711d05309","Type":"ContainerStarted","Data":"6b0a0d5a59225815ae7f53fe6799b0a3838d8d21860af6a14e86fb87bc325f4e"}
Jul 06 12:48:32.263934 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:32.263760    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-pmthv" event={"ID":"957a5846-5736-4550-82df-c72711d05309","Type":"ContainerStarted","Data":"d194d08cfe124a2b787dcc60372f6a99d8ace55b26e359c5091beb10a70a1e0b"}
Jul 06 12:48:32.313443 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:32.313346    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-pmthv" podStartSLOduration=2.313326499 podStartE2EDuration="2.313326499s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:48:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:48:32.312148709 +0000 UTC m=+89.181036363" watchObservedRunningTime="2026-07-06 12:48:32.313326499 +0000 UTC m=+89.182214163"
Jul 06 12:48:32.341339 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:32.341316    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tr8t2_e09437b4-0f91-4b6f-a017-784f7515276b/node-ca/0.log"
Jul 06 12:48:32.341693 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:32.341668    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:48:32.651217 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:32.651143    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:48:32.819254 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:32.819198    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:48:33.146158 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:33.146128    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zrttp_5199a8fa-633f-4cb1-b46d-83ab71d5f651/serve-healthcheck-canary/0.log"
Jul 06 12:48:33.163734 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:33.163706    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:48:33.270038 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:33.270013    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:48:33.399124 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:33.399060    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:48:33.741900 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:33.741871    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-dh2wk_cbacc540-bf45-4a9c-9bbf-9a8ee3ae6ab2/kube-storage-version-migrator-operator/0.log"
Jul 06 12:48:34.405508 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:34.405477    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:48:34.767697 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:34.767670    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:48:35.024415 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:35.024345    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:48:35.161406 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:35.161382    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:48:35.254671 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:35.254647    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:48:35.347031 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:35.346967    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:48:35.954243 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:35.954217    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:48:36.049812 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:36.049788    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fccdb6dc-a166-4794-97dc-c533a4c56673-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rbvk6\" (UID: \"fccdb6dc-a166-4794-97dc-c533a4c56673\") " pod="openshift-insights/insights-runtime-extractor-rbvk6"
Jul 06 12:48:36.049920 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:36.049875    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fccdb6dc-a166-4794-97dc-c533a4c56673-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rbvk6\" (UID: \"fccdb6dc-a166-4794-97dc-c533a4c56673\") " pod="openshift-insights/insights-runtime-extractor-rbvk6"
Jul 06 12:48:36.049968 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:48:36.049931    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 12:48:36.049968 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:48:36.049937    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 12:48:36.050029 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:48:36.049980    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fccdb6dc-a166-4794-97dc-c533a4c56673-kube-rbac-proxy-cm podName:fccdb6dc-a166-4794-97dc-c533a4c56673 nodeName:}" failed. No retries permitted until 2026-07-06 12:48:44.049968571 +0000 UTC m=+100.918856207 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fccdb6dc-a166-4794-97dc-c533a4c56673-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rbvk6" (UID: "fccdb6dc-a166-4794-97dc-c533a4c56673") : configmap "kube-rbac-proxy" not found
Jul 06 12:48:36.050029 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:48:36.049993    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fccdb6dc-a166-4794-97dc-c533a4c56673-insights-runtime-extractor-tls podName:fccdb6dc-a166-4794-97dc-c533a4c56673 nodeName:}" failed. No retries permitted until 2026-07-06 12:48:44.049987376 +0000 UTC m=+100.918875012 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fccdb6dc-a166-4794-97dc-c533a4c56673-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rbvk6" (UID: "fccdb6dc-a166-4794-97dc-c533a4c56673") : secret "insights-runtime-extractor-tls" not found
Jul 06 12:48:36.156508 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:36.156483    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:48:36.343116 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:36.343089    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:48:36.560138 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:36.560112    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:48:36.944440 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:36.944411    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:48:37.045372 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:37.045343    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:48:37.147005 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:37.146980    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:48:37.749322 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:37.749294    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:48:38.177433 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:38.177358    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:48:38.364745 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:38.364714    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:48:38.539573 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:38.539547    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:48:38.739769 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:38.739743    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:48:39.170672 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:39.170638    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:48:39.471240 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:39.471175    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f02f557a-91ba-46bd-b7a3-32cbe308fa02-service-ca-bundle\") pod \"router-default-6f6cd48999-mcm8v\" (UID: \"f02f557a-91ba-46bd-b7a3-32cbe308fa02\") " pod="openshift-ingress/router-default-6f6cd48999-mcm8v"
Jul 06 12:48:39.471240 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:39.471202    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f02f557a-91ba-46bd-b7a3-32cbe308fa02-metrics-certs\") pod \"router-default-6f6cd48999-mcm8v\" (UID: \"f02f557a-91ba-46bd-b7a3-32cbe308fa02\") " pod="openshift-ingress/router-default-6f6cd48999-mcm8v"
Jul 06 12:48:39.471740 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:39.471724    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f02f557a-91ba-46bd-b7a3-32cbe308fa02-service-ca-bundle\") pod \"router-default-6f6cd48999-mcm8v\" (UID: \"f02f557a-91ba-46bd-b7a3-32cbe308fa02\") " pod="openshift-ingress/router-default-6f6cd48999-mcm8v"
Jul 06 12:48:39.473406 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:39.473387    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f02f557a-91ba-46bd-b7a3-32cbe308fa02-metrics-certs\") pod \"router-default-6f6cd48999-mcm8v\" (UID: \"f02f557a-91ba-46bd-b7a3-32cbe308fa02\") " pod="openshift-ingress/router-default-6f6cd48999-mcm8v"
Jul 06 12:48:39.551531 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:39.551508    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6f6cd48999-mcm8v"
Jul 06 12:48:39.682678 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:39.682654    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6f6cd48999-mcm8v"]
Jul 06 12:48:39.962228 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:39.962198    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:48:40.204971 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:40.204941    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:48:40.291099 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:40.291067    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6f6cd48999-mcm8v" event={"ID":"f02f557a-91ba-46bd-b7a3-32cbe308fa02","Type":"ContainerStarted","Data":"7657da660861fb9dd239823421378f31a04a5e2753772d8f24b27291175b18ca"}
Jul 06 12:48:40.291244 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:40.291139    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6f6cd48999-mcm8v" event={"ID":"f02f557a-91ba-46bd-b7a3-32cbe308fa02","Type":"ContainerStarted","Data":"d220a7860f8b447acabddfccedabaa8a37a3eb7d73d5f9119714290f2c9a9aeb"}
Jul 06 12:48:40.552298 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:40.552264    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6f6cd48999-mcm8v"
Jul 06 12:48:40.554901 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:40.554881    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6f6cd48999-mcm8v"
Jul 06 12:48:40.556815 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:40.556794    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:48:40.594612 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:40.594576    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6f6cd48999-mcm8v" podStartSLOduration=17.594564069 podStartE2EDuration="17.594564069s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:48:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:48:40.32092889 +0000 UTC m=+97.189816547" watchObservedRunningTime="2026-07-06 12:48:40.594564069 +0000 UTC m=+97.463451728"
Jul 06 12:48:40.743994 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:40.743971    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:48:40.891455 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:40.891396    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:48:41.294467 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:41.294438    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6f6cd48999-mcm8v"
Jul 06 12:48:41.295607 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:41.295585    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6f6cd48999-mcm8v"
Jul 06 12:48:41.340782 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:41.340761    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:48:41.944179 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:41.944149    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:48:42.128324 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:42.128293    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:48:42.236042 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:42.236017    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:48:42.419150 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:42.419118    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:48:42.643502 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:42.643413    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:48:42.816879 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:42.816833    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:48:43.051482 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:43.051454    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:48:43.339885 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:43.339795    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:48:43.542367 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:43.542338    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:48:44.108905 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:44.108873    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fccdb6dc-a166-4794-97dc-c533a4c56673-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rbvk6\" (UID: \"fccdb6dc-a166-4794-97dc-c533a4c56673\") " pod="openshift-insights/insights-runtime-extractor-rbvk6"
Jul 06 12:48:44.109256 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:44.108916    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fccdb6dc-a166-4794-97dc-c533a4c56673-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rbvk6\" (UID: \"fccdb6dc-a166-4794-97dc-c533a4c56673\") " pod="openshift-insights/insights-runtime-extractor-rbvk6"
Jul 06 12:48:44.109362 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:44.109342    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fccdb6dc-a166-4794-97dc-c533a4c56673-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rbvk6\" (UID: \"fccdb6dc-a166-4794-97dc-c533a4c56673\") " pod="openshift-insights/insights-runtime-extractor-rbvk6"
Jul 06 12:48:44.111084 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:44.111068    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fccdb6dc-a166-4794-97dc-c533a4c56673-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rbvk6\" (UID: \"fccdb6dc-a166-4794-97dc-c533a4c56673\") " pod="openshift-insights/insights-runtime-extractor-rbvk6"
Jul 06 12:48:44.248148 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:44.248118    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rbvk6"
Jul 06 12:48:44.374803 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:44.374743    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rbvk6"]
Jul 06 12:48:44.377916 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:48:44.377895    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfccdb6dc_a166_4794_97dc_c533a4c56673.slice/crio-4b6aba1723d85ae4a6f43756e0a36a80073e0ac8ca1f116c351e6e1bfde3947c WatchSource:0}: Error finding container 4b6aba1723d85ae4a6f43756e0a36a80073e0ac8ca1f116c351e6e1bfde3947c: Status 404 returned error can't find the container with id 4b6aba1723d85ae4a6f43756e0a36a80073e0ac8ca1f116c351e6e1bfde3947c
Jul 06 12:48:44.412004 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:44.411978    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/60f37d4d-640e-4be1-9e91-937c6d91aa60-metrics-tls\") pod \"dns-default-lpwg5\" (UID: \"60f37d4d-640e-4be1-9e91-937c6d91aa60\") " pod="openshift-dns/dns-default-lpwg5"
Jul 06 12:48:44.414060 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:44.414038    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/60f37d4d-640e-4be1-9e91-937c6d91aa60-metrics-tls\") pod \"dns-default-lpwg5\" (UID: \"60f37d4d-640e-4be1-9e91-937c6d91aa60\") " pod="openshift-dns/dns-default-lpwg5"
Jul 06 12:48:44.451014 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:44.450989    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9njlh\""
Jul 06 12:48:44.458188 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:44.458169    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lpwg5"
Jul 06 12:48:44.523791 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:44.523758    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:48:44.581562 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:44.581536    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lpwg5"]
Jul 06 12:48:44.584686 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:48:44.584662    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60f37d4d_640e_4be1_9e91_937c6d91aa60.slice/crio-948444d4f0cbcf254a3c984ddbb5f5f0add7e127021e908d9153eed121a0ae6f WatchSource:0}: Error finding container 948444d4f0cbcf254a3c984ddbb5f5f0add7e127021e908d9153eed121a0ae6f: Status 404 returned error can't find the container with id 948444d4f0cbcf254a3c984ddbb5f5f0add7e127021e908d9153eed121a0ae6f
Jul 06 12:48:44.619944 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:44.619919    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:48:45.309180 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:45.309086    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lpwg5" event={"ID":"60f37d4d-640e-4be1-9e91-937c6d91aa60","Type":"ContainerStarted","Data":"948444d4f0cbcf254a3c984ddbb5f5f0add7e127021e908d9153eed121a0ae6f"}
Jul 06 12:48:45.311555 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:45.311477    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rbvk6" event={"ID":"fccdb6dc-a166-4794-97dc-c533a4c56673","Type":"ContainerStarted","Data":"4b6aba1723d85ae4a6f43756e0a36a80073e0ac8ca1f116c351e6e1bfde3947c"}
Jul 06 12:48:46.220645 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:46.220613    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-xj4sm"
Jul 06 12:48:48.849045 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:48.849017    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:48:48.984114 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:48.984080    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:48:49.146018 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:49.145955    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:48:49.299668 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:49.299648    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:48:49.417618 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:49.417549    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:48:50.330218 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:50.330184    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lpwg5" event={"ID":"60f37d4d-640e-4be1-9e91-937c6d91aa60","Type":"ContainerStarted","Data":"844b9fa54a3ffb70430210b7fff033f5c88b67a278b6a399bb10c9e972043270"}
Jul 06 12:48:50.330630 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:50.330265    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lpwg5" event={"ID":"60f37d4d-640e-4be1-9e91-937c6d91aa60","Type":"ContainerStarted","Data":"126ff685ef4caaf70395a52dc9ca1dc6f41e35d82e8ea8dd7fb464597daf3d3e"}
Jul 06 12:48:50.330630 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:50.330316    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-lpwg5"
Jul 06 12:48:50.332216 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:50.332191    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rbvk6" event={"ID":"fccdb6dc-a166-4794-97dc-c533a4c56673","Type":"ContainerStarted","Data":"6484a603bf182aa53cb5c97898671e0bb76b2aec7aedd6e950a58d560de45089"}
Jul 06 12:48:50.332318 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:50.332234    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rbvk6" event={"ID":"fccdb6dc-a166-4794-97dc-c533a4c56673","Type":"ContainerStarted","Data":"9d854742994dcf8706f265992abaee7d1557decb093dbb8f7fa0e4f63c3ea758"}
Jul 06 12:48:50.356196 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:50.356158    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-lpwg5" podStartSLOduration=65.729901333 podStartE2EDuration="1m10.356145112s" totalImagesPullingTime="4.626243779s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:47:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:48:50.355702584 +0000 UTC m=+107.224590243" watchObservedRunningTime="2026-07-06 12:48:50.356145112 +0000 UTC m=+107.225032771"
Jul 06 12:48:50.523696 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:50.523660    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:48:50.739364 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:50.739331    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:48:50.858584 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:50.858498    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:48:51.553694 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:51.553666    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:48:53.345475 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:53.345445    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rbvk6" event={"ID":"fccdb6dc-a166-4794-97dc-c533a4c56673","Type":"ContainerStarted","Data":"aad1b229a24a7ebb085b4b7b00d280a6ab313f53d8dc4eb9661aa6cb929c5268"}
Jul 06 12:48:53.366056 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:53.366010    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-rbvk6" podStartSLOduration=17.228454193 podStartE2EDuration="25.365996302s" totalImagesPullingTime="8.137542109s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 12:48:28 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:48:53.364750052 +0000 UTC m=+110.233637711" watchObservedRunningTime="2026-07-06 12:48:53.365996302 +0000 UTC m=+110.234883960"
Jul 06 12:48:53.788304 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:53.788272    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-668bcb5c85-bqdc4"]
Jul 06 12:48:53.791523 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:53.791502    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-668bcb5c85-bqdc4"
Jul 06 12:48:53.796248 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:53.796207    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 06 12:48:53.796377 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:53.796265    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 06 12:48:53.797243 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:53.797219    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 06 12:48:53.797354 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:53.797282    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 06 12:48:53.797490 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:53.797471    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 06 12:48:53.800961 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:53.800945    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 06 12:48:53.809466 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:53.809449    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 06 12:48:53.833585 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:53.830864    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-668bcb5c85-bqdc4"]
Jul 06 12:48:53.882926 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:53.882895    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9slp\" (UniqueName: \"kubernetes.io/projected/e8e76643-451e-4d2e-a831-fb588e8719a2-kube-api-access-h9slp\") pod \"cluster-proxy-proxy-agent-668bcb5c85-bqdc4\" (UID: \"e8e76643-451e-4d2e-a831-fb588e8719a2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-668bcb5c85-bqdc4"
Jul 06 12:48:53.883059 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:53.882935    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e8e76643-451e-4d2e-a831-fb588e8719a2-ca\") pod \"cluster-proxy-proxy-agent-668bcb5c85-bqdc4\" (UID: \"e8e76643-451e-4d2e-a831-fb588e8719a2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-668bcb5c85-bqdc4"
Jul 06 12:48:53.883059 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:53.882957    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e8e76643-451e-4d2e-a831-fb588e8719a2-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-668bcb5c85-bqdc4\" (UID: \"e8e76643-451e-4d2e-a831-fb588e8719a2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-668bcb5c85-bqdc4"
Jul 06 12:48:53.883059 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:53.882978    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8e76643-451e-4d2e-a831-fb588e8719a2-additional-service-ca\") pod \"cluster-proxy-proxy-agent-668bcb5c85-bqdc4\" (UID: \"e8e76643-451e-4d2e-a831-fb588e8719a2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-668bcb5c85-bqdc4"
Jul 06 12:48:53.883162 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:53.883067    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e8e76643-451e-4d2e-a831-fb588e8719a2-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-668bcb5c85-bqdc4\" (UID: \"e8e76643-451e-4d2e-a831-fb588e8719a2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-668bcb5c85-bqdc4"
Jul 06 12:48:53.883162 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:53.883099    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e8e76643-451e-4d2e-a831-fb588e8719a2-hub\") pod \"cluster-proxy-proxy-agent-668bcb5c85-bqdc4\" (UID: \"e8e76643-451e-4d2e-a831-fb588e8719a2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-668bcb5c85-bqdc4"
Jul 06 12:48:53.911357 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:53.911331    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:48:53.983963 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:53.983935    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e8e76643-451e-4d2e-a831-fb588e8719a2-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-668bcb5c85-bqdc4\" (UID: \"e8e76643-451e-4d2e-a831-fb588e8719a2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-668bcb5c85-bqdc4"
Jul 06 12:48:53.984073 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:53.983968    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e8e76643-451e-4d2e-a831-fb588e8719a2-hub\") pod \"cluster-proxy-proxy-agent-668bcb5c85-bqdc4\" (UID: \"e8e76643-451e-4d2e-a831-fb588e8719a2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-668bcb5c85-bqdc4"
Jul 06 12:48:53.984161 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:53.984140    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9slp\" (UniqueName: \"kubernetes.io/projected/e8e76643-451e-4d2e-a831-fb588e8719a2-kube-api-access-h9slp\") pod \"cluster-proxy-proxy-agent-668bcb5c85-bqdc4\" (UID: \"e8e76643-451e-4d2e-a831-fb588e8719a2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-668bcb5c85-bqdc4"
Jul 06 12:48:53.984197 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:53.984186    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e8e76643-451e-4d2e-a831-fb588e8719a2-ca\") pod \"cluster-proxy-proxy-agent-668bcb5c85-bqdc4\" (UID: \"e8e76643-451e-4d2e-a831-fb588e8719a2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-668bcb5c85-bqdc4"
Jul 06 12:48:53.984230 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:53.984213    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e8e76643-451e-4d2e-a831-fb588e8719a2-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-668bcb5c85-bqdc4\" (UID: \"e8e76643-451e-4d2e-a831-fb588e8719a2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-668bcb5c85-bqdc4"
Jul 06 12:48:53.984269 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:53.984255    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8e76643-451e-4d2e-a831-fb588e8719a2-additional-service-ca\") pod \"cluster-proxy-proxy-agent-668bcb5c85-bqdc4\" (UID: \"e8e76643-451e-4d2e-a831-fb588e8719a2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-668bcb5c85-bqdc4"
Jul 06 12:48:53.985033 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:53.985007    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8e76643-451e-4d2e-a831-fb588e8719a2-additional-service-ca\") pod \"cluster-proxy-proxy-agent-668bcb5c85-bqdc4\" (UID: \"e8e76643-451e-4d2e-a831-fb588e8719a2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-668bcb5c85-bqdc4"
Jul 06 12:48:53.986445 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:53.986420    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e8e76643-451e-4d2e-a831-fb588e8719a2-hub\") pod \"cluster-proxy-proxy-agent-668bcb5c85-bqdc4\" (UID: \"e8e76643-451e-4d2e-a831-fb588e8719a2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-668bcb5c85-bqdc4"
Jul 06 12:48:53.986563 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:53.986542    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e8e76643-451e-4d2e-a831-fb588e8719a2-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-668bcb5c85-bqdc4\" (UID: \"e8e76643-451e-4d2e-a831-fb588e8719a2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-668bcb5c85-bqdc4"
Jul 06 12:48:53.986615 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:53.986593    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e8e76643-451e-4d2e-a831-fb588e8719a2-ca\") pod \"cluster-proxy-proxy-agent-668bcb5c85-bqdc4\" (UID: \"e8e76643-451e-4d2e-a831-fb588e8719a2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-668bcb5c85-bqdc4"
Jul 06 12:48:53.986704 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:53.986690    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e8e76643-451e-4d2e-a831-fb588e8719a2-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-668bcb5c85-bqdc4\" (UID: \"e8e76643-451e-4d2e-a831-fb588e8719a2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-668bcb5c85-bqdc4"
Jul 06 12:48:54.028206 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:54.028178    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9slp\" (UniqueName: \"kubernetes.io/projected/e8e76643-451e-4d2e-a831-fb588e8719a2-kube-api-access-h9slp\") pod \"cluster-proxy-proxy-agent-668bcb5c85-bqdc4\" (UID: \"e8e76643-451e-4d2e-a831-fb588e8719a2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-668bcb5c85-bqdc4"
Jul 06 12:48:54.091488 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:54.091432    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:48:54.107590 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:54.107569    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-668bcb5c85-bqdc4"
Jul 06 12:48:54.243214 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:54.243188    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:48:54.251382 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:54.251358    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-668bcb5c85-bqdc4"]
Jul 06 12:48:54.254484 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:48:54.254462    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode8e76643_451e_4d2e_a831_fb588e8719a2.slice/crio-aa7079953f5ce3366eb6b8dcab3023b7793af4513f30524b500ed96b20a7b705 WatchSource:0}: Error finding container aa7079953f5ce3366eb6b8dcab3023b7793af4513f30524b500ed96b20a7b705: Status 404 returned error can't find the container with id aa7079953f5ce3366eb6b8dcab3023b7793af4513f30524b500ed96b20a7b705
Jul 06 12:48:54.349558 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:54.349485    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-668bcb5c85-bqdc4" event={"ID":"e8e76643-451e-4d2e-a831-fb588e8719a2","Type":"ContainerStarted","Data":"aa7079953f5ce3366eb6b8dcab3023b7793af4513f30524b500ed96b20a7b705"}
Jul 06 12:48:56.191287 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:56.191255    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:48:56.296454 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:56.296379    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:48:58.366245 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:58.366174    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-668bcb5c85-bqdc4" event={"ID":"e8e76643-451e-4d2e-a831-fb588e8719a2","Type":"ContainerStarted","Data":"a786ce37083969b56bfb4dee77da52ebf104a4b5603593ccf7928ae7444447ec"}
Jul 06 12:48:58.366245 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:58.366214    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-668bcb5c85-bqdc4" event={"ID":"e8e76643-451e-4d2e-a831-fb588e8719a2","Type":"ContainerStarted","Data":"b8f63c16253f78fd5d4e101d1051c7ed52b90024f4d391662476008a0be77f8f"}
Jul 06 12:48:58.366245 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:58.366227    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-668bcb5c85-bqdc4" event={"ID":"e8e76643-451e-4d2e-a831-fb588e8719a2","Type":"ContainerStarted","Data":"c9b7e35bf03c5d229eed52179641813677ddddddf60b93bb8c5734eb6cfb847c"}
Jul 06 12:48:58.397381 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:58.397335    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-668bcb5c85-bqdc4" podStartSLOduration=1.5424916340000001 podStartE2EDuration="5.397318351s" totalImagesPullingTime="3.854826717s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:48:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:48:58.396955387 +0000 UTC m=+115.265843045" watchObservedRunningTime="2026-07-06 12:48:58.397318351 +0000 UTC m=+115.266206035"
Jul 06 12:48:59.473803 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:59.473753    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:48:59.627971 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:59.627942    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:48:59.728397 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:48:59.728322    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:49:00.338080 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:00.338054    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-lpwg5"
Jul 06 12:49:01.793704 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:01.793675    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:49:02.562141 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:02.562115    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:49:02.658837 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:02.658808    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:49:03.687277 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:03.687248    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:49:03.981990 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:03.981901    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:49:04.098006 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:04.097976    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-ts5xz"]
Jul 06 12:49:04.102196 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:04.102171    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ts5xz"
Jul 06 12:49:04.104613 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:04.104595    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 06 12:49:04.107343 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:04.107323    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-dp8jt\""
Jul 06 12:49:04.107483 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:04.107327    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 06 12:49:04.107718 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:04.107354    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 06 12:49:04.107798 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:04.107379    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 06 12:49:04.107881 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:04.107392    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 06 12:49:04.108293 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:04.108277    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 06 12:49:04.126978 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:04.126949    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:49:04.167582 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:04.167554    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/deb445ec-9b5e-4314-96a6-26bfcf350f23-sys\") pod \"node-exporter-ts5xz\" (UID: \"deb445ec-9b5e-4314-96a6-26bfcf350f23\") " pod="openshift-monitoring/node-exporter-ts5xz"
Jul 06 12:49:04.167582 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:04.167588    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/deb445ec-9b5e-4314-96a6-26bfcf350f23-metrics-client-ca\") pod \"node-exporter-ts5xz\" (UID: \"deb445ec-9b5e-4314-96a6-26bfcf350f23\") " pod="openshift-monitoring/node-exporter-ts5xz"
Jul 06 12:49:04.167788 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:04.167604    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blqqx\" (UniqueName: \"kubernetes.io/projected/deb445ec-9b5e-4314-96a6-26bfcf350f23-kube-api-access-blqqx\") pod \"node-exporter-ts5xz\" (UID: \"deb445ec-9b5e-4314-96a6-26bfcf350f23\") " pod="openshift-monitoring/node-exporter-ts5xz"
Jul 06 12:49:04.167788 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:04.167622    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/deb445ec-9b5e-4314-96a6-26bfcf350f23-node-exporter-tls\") pod \"node-exporter-ts5xz\" (UID: \"deb445ec-9b5e-4314-96a6-26bfcf350f23\") " pod="openshift-monitoring/node-exporter-ts5xz"
Jul 06 12:49:04.167788 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:04.167641    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/deb445ec-9b5e-4314-96a6-26bfcf350f23-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ts5xz\" (UID: \"deb445ec-9b5e-4314-96a6-26bfcf350f23\") " pod="openshift-monitoring/node-exporter-ts5xz"
Jul 06 12:49:04.167788 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:04.167710    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/deb445ec-9b5e-4314-96a6-26bfcf350f23-node-exporter-textfile\") pod \"node-exporter-ts5xz\" (UID: \"deb445ec-9b5e-4314-96a6-26bfcf350f23\") " pod="openshift-monitoring/node-exporter-ts5xz"
Jul 06 12:49:04.167788 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:04.167740    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/deb445ec-9b5e-4314-96a6-26bfcf350f23-node-exporter-wtmp\") pod \"node-exporter-ts5xz\" (UID: \"deb445ec-9b5e-4314-96a6-26bfcf350f23\") " pod="openshift-monitoring/node-exporter-ts5xz"
Jul 06 12:49:04.168009 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:04.167824    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/deb445ec-9b5e-4314-96a6-26bfcf350f23-node-exporter-accelerators-collector-config\") pod \"node-exporter-ts5xz\" (UID: \"deb445ec-9b5e-4314-96a6-26bfcf350f23\") " pod="openshift-monitoring/node-exporter-ts5xz"
Jul 06 12:49:04.168009 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:04.167905    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/deb445ec-9b5e-4314-96a6-26bfcf350f23-root\") pod \"node-exporter-ts5xz\" (UID: \"deb445ec-9b5e-4314-96a6-26bfcf350f23\") " pod="openshift-monitoring/node-exporter-ts5xz"
Jul 06 12:49:04.230366 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:04.230337    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:49:04.268335 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:04.268299    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/deb445ec-9b5e-4314-96a6-26bfcf350f23-node-exporter-wtmp\") pod \"node-exporter-ts5xz\" (UID: \"deb445ec-9b5e-4314-96a6-26bfcf350f23\") " pod="openshift-monitoring/node-exporter-ts5xz"
Jul 06 12:49:04.268526 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:04.268368    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/deb445ec-9b5e-4314-96a6-26bfcf350f23-node-exporter-accelerators-collector-config\") pod \"node-exporter-ts5xz\" (UID: \"deb445ec-9b5e-4314-96a6-26bfcf350f23\") " pod="openshift-monitoring/node-exporter-ts5xz"
Jul 06 12:49:04.268526 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:04.268410    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/deb445ec-9b5e-4314-96a6-26bfcf350f23-root\") pod \"node-exporter-ts5xz\" (UID: \"deb445ec-9b5e-4314-96a6-26bfcf350f23\") " pod="openshift-monitoring/node-exporter-ts5xz"
Jul 06 12:49:04.268526 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:04.268436    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/deb445ec-9b5e-4314-96a6-26bfcf350f23-sys\") pod \"node-exporter-ts5xz\" (UID: \"deb445ec-9b5e-4314-96a6-26bfcf350f23\") " pod="openshift-monitoring/node-exporter-ts5xz"
Jul 06 12:49:04.268526 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:04.268464    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/deb445ec-9b5e-4314-96a6-26bfcf350f23-metrics-client-ca\") pod \"node-exporter-ts5xz\" (UID: \"deb445ec-9b5e-4314-96a6-26bfcf350f23\") " pod="openshift-monitoring/node-exporter-ts5xz"
Jul 06 12:49:04.268526 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:04.268485    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blqqx\" (UniqueName: \"kubernetes.io/projected/deb445ec-9b5e-4314-96a6-26bfcf350f23-kube-api-access-blqqx\") pod \"node-exporter-ts5xz\" (UID: \"deb445ec-9b5e-4314-96a6-26bfcf350f23\") " pod="openshift-monitoring/node-exporter-ts5xz"
Jul 06 12:49:04.268526 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:04.268487    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/deb445ec-9b5e-4314-96a6-26bfcf350f23-root\") pod \"node-exporter-ts5xz\" (UID: \"deb445ec-9b5e-4314-96a6-26bfcf350f23\") " pod="openshift-monitoring/node-exporter-ts5xz"
Jul 06 12:49:04.268526 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:04.268493    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/deb445ec-9b5e-4314-96a6-26bfcf350f23-node-exporter-wtmp\") pod \"node-exporter-ts5xz\" (UID: \"deb445ec-9b5e-4314-96a6-26bfcf350f23\") " pod="openshift-monitoring/node-exporter-ts5xz"
Jul 06 12:49:04.268526 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:04.268508    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/deb445ec-9b5e-4314-96a6-26bfcf350f23-node-exporter-tls\") pod \"node-exporter-ts5xz\" (UID: \"deb445ec-9b5e-4314-96a6-26bfcf350f23\") " pod="openshift-monitoring/node-exporter-ts5xz"
Jul 06 12:49:04.268949 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:04.268547    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/deb445ec-9b5e-4314-96a6-26bfcf350f23-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ts5xz\" (UID: \"deb445ec-9b5e-4314-96a6-26bfcf350f23\") " pod="openshift-monitoring/node-exporter-ts5xz"
Jul 06 12:49:04.268949 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:04.268571    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/deb445ec-9b5e-4314-96a6-26bfcf350f23-sys\") pod \"node-exporter-ts5xz\" (UID: \"deb445ec-9b5e-4314-96a6-26bfcf350f23\") " pod="openshift-monitoring/node-exporter-ts5xz"
Jul 06 12:49:04.268949 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:04.268578    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/deb445ec-9b5e-4314-96a6-26bfcf350f23-node-exporter-textfile\") pod \"node-exporter-ts5xz\" (UID: \"deb445ec-9b5e-4314-96a6-26bfcf350f23\") " pod="openshift-monitoring/node-exporter-ts5xz"
Jul 06 12:49:04.269161 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:04.268948    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/deb445ec-9b5e-4314-96a6-26bfcf350f23-node-exporter-textfile\") pod \"node-exporter-ts5xz\" (UID: \"deb445ec-9b5e-4314-96a6-26bfcf350f23\") " pod="openshift-monitoring/node-exporter-ts5xz"
Jul 06 12:49:04.269161 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:04.269076    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/deb445ec-9b5e-4314-96a6-26bfcf350f23-node-exporter-accelerators-collector-config\") pod \"node-exporter-ts5xz\" (UID: \"deb445ec-9b5e-4314-96a6-26bfcf350f23\") " pod="openshift-monitoring/node-exporter-ts5xz"
Jul 06 12:49:04.269161 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:04.269144    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/deb445ec-9b5e-4314-96a6-26bfcf350f23-metrics-client-ca\") pod \"node-exporter-ts5xz\" (UID: \"deb445ec-9b5e-4314-96a6-26bfcf350f23\") " pod="openshift-monitoring/node-exporter-ts5xz"
Jul 06 12:49:04.270935 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:04.270907    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/deb445ec-9b5e-4314-96a6-26bfcf350f23-node-exporter-tls\") pod \"node-exporter-ts5xz\" (UID: \"deb445ec-9b5e-4314-96a6-26bfcf350f23\") " pod="openshift-monitoring/node-exporter-ts5xz"
Jul 06 12:49:04.271140 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:04.271106    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/deb445ec-9b5e-4314-96a6-26bfcf350f23-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ts5xz\" (UID: \"deb445ec-9b5e-4314-96a6-26bfcf350f23\") " pod="openshift-monitoring/node-exporter-ts5xz"
Jul 06 12:49:04.278160 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:04.278135    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-blqqx\" (UniqueName: \"kubernetes.io/projected/deb445ec-9b5e-4314-96a6-26bfcf350f23-kube-api-access-blqqx\") pod \"node-exporter-ts5xz\" (UID: \"deb445ec-9b5e-4314-96a6-26bfcf350f23\") " pod="openshift-monitoring/node-exporter-ts5xz"
Jul 06 12:49:04.332768 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:04.332735    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:49:04.412031 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:04.412002    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ts5xz"
Jul 06 12:49:04.422450 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:49:04.422426    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddeb445ec_9b5e_4314_96a6_26bfcf350f23.slice/crio-d2c5e03370c19e707a9b5ce7da75b39c453a27be0467cfb3cbc3c8de0eba53ee WatchSource:0}: Error finding container d2c5e03370c19e707a9b5ce7da75b39c453a27be0467cfb3cbc3c8de0eba53ee: Status 404 returned error can't find the container with id d2c5e03370c19e707a9b5ce7da75b39c453a27be0467cfb3cbc3c8de0eba53ee
Jul 06 12:49:04.444625 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:04.444593    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:49:04.905459 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:04.905428    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:49:05.002663 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:05.002597    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:49:05.110903 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:05.110556    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:49:05.389626 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:05.389590    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ts5xz" event={"ID":"deb445ec-9b5e-4314-96a6-26bfcf350f23","Type":"ContainerStarted","Data":"d2c5e03370c19e707a9b5ce7da75b39c453a27be0467cfb3cbc3c8de0eba53ee"}
Jul 06 12:49:05.535232 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:05.535200    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:49:06.186154 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:06.186124    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:49:06.274579 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:06.274531    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:49:06.394543 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:06.394511    2579 generic.go:356] "Generic (PLEG): container finished" podID="deb445ec-9b5e-4314-96a6-26bfcf350f23" containerID="4d2a3acd83719f24cbdceaa13cfa6a6670fd719ca2513f7f5cf8f3dd5773f787" exitCode=0
Jul 06 12:49:06.394746 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:06.394598    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ts5xz" event={"ID":"deb445ec-9b5e-4314-96a6-26bfcf350f23","Type":"ContainerDied","Data":"4d2a3acd83719f24cbdceaa13cfa6a6670fd719ca2513f7f5cf8f3dd5773f787"}
Jul 06 12:49:06.575202 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:06.575175    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:49:06.724443 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:06.724370    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:49:07.250854 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:07.250806    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-687b955f69-w7s6w"]
Jul 06 12:49:07.256658 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:07.256247    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-687b955f69-w7s6w"
Jul 06 12:49:07.267427 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:07.267408    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-95q5154nqufnr\""
Jul 06 12:49:07.267580 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:07.267562    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-xqjw7\""
Jul 06 12:49:07.267732 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:07.267712    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 06 12:49:07.274038 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:07.274021    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 06 12:49:07.274133 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:07.274041    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 06 12:49:07.274133 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:07.274050    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 06 12:49:07.274251 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:07.274129    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 06 12:49:07.288564 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:07.288543    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/8e5f9c07-39e5-4442-a5bd-c14008103484-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-687b955f69-w7s6w\" (UID: \"8e5f9c07-39e5-4442-a5bd-c14008103484\") " pod="openshift-monitoring/thanos-querier-687b955f69-w7s6w"
Jul 06 12:49:07.288677 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:07.288573    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8e5f9c07-39e5-4442-a5bd-c14008103484-secret-grpc-tls\") pod \"thanos-querier-687b955f69-w7s6w\" (UID: \"8e5f9c07-39e5-4442-a5bd-c14008103484\") " pod="openshift-monitoring/thanos-querier-687b955f69-w7s6w"
Jul 06 12:49:07.288677 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:07.288596    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/8e5f9c07-39e5-4442-a5bd-c14008103484-secret-thanos-querier-tls\") pod \"thanos-querier-687b955f69-w7s6w\" (UID: \"8e5f9c07-39e5-4442-a5bd-c14008103484\") " pod="openshift-monitoring/thanos-querier-687b955f69-w7s6w"
Jul 06 12:49:07.288677 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:07.288616    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8e5f9c07-39e5-4442-a5bd-c14008103484-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-687b955f69-w7s6w\" (UID: \"8e5f9c07-39e5-4442-a5bd-c14008103484\") " pod="openshift-monitoring/thanos-querier-687b955f69-w7s6w"
Jul 06 12:49:07.288677 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:07.288658    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8e5f9c07-39e5-4442-a5bd-c14008103484-metrics-client-ca\") pod \"thanos-querier-687b955f69-w7s6w\" (UID: \"8e5f9c07-39e5-4442-a5bd-c14008103484\") " pod="openshift-monitoring/thanos-querier-687b955f69-w7s6w"
Jul 06 12:49:07.288905 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:07.288728    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dn4dx\" (UniqueName: \"kubernetes.io/projected/8e5f9c07-39e5-4442-a5bd-c14008103484-kube-api-access-dn4dx\") pod \"thanos-querier-687b955f69-w7s6w\" (UID: \"8e5f9c07-39e5-4442-a5bd-c14008103484\") " pod="openshift-monitoring/thanos-querier-687b955f69-w7s6w"
Jul 06 12:49:07.288905 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:07.288761    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8e5f9c07-39e5-4442-a5bd-c14008103484-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-687b955f69-w7s6w\" (UID: \"8e5f9c07-39e5-4442-a5bd-c14008103484\") " pod="openshift-monitoring/thanos-querier-687b955f69-w7s6w"
Jul 06 12:49:07.288905 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:07.288779    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/8e5f9c07-39e5-4442-a5bd-c14008103484-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-687b955f69-w7s6w\" (UID: \"8e5f9c07-39e5-4442-a5bd-c14008103484\") " pod="openshift-monitoring/thanos-querier-687b955f69-w7s6w"
Jul 06 12:49:07.351335 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:07.351313    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-687b955f69-w7s6w"]
Jul 06 12:49:07.383165 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:07.383136    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:49:07.389185 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:07.389164    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8e5f9c07-39e5-4442-a5bd-c14008103484-metrics-client-ca\") pod \"thanos-querier-687b955f69-w7s6w\" (UID: \"8e5f9c07-39e5-4442-a5bd-c14008103484\") " pod="openshift-monitoring/thanos-querier-687b955f69-w7s6w"
Jul 06 12:49:07.389251 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:07.389216    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dn4dx\" (UniqueName: \"kubernetes.io/projected/8e5f9c07-39e5-4442-a5bd-c14008103484-kube-api-access-dn4dx\") pod \"thanos-querier-687b955f69-w7s6w\" (UID: \"8e5f9c07-39e5-4442-a5bd-c14008103484\") " pod="openshift-monitoring/thanos-querier-687b955f69-w7s6w"
Jul 06 12:49:07.389251 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:07.389246    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8e5f9c07-39e5-4442-a5bd-c14008103484-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-687b955f69-w7s6w\" (UID: \"8e5f9c07-39e5-4442-a5bd-c14008103484\") " pod="openshift-monitoring/thanos-querier-687b955f69-w7s6w"
Jul 06 12:49:07.389316 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:07.389266    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/8e5f9c07-39e5-4442-a5bd-c14008103484-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-687b955f69-w7s6w\" (UID: \"8e5f9c07-39e5-4442-a5bd-c14008103484\") " pod="openshift-monitoring/thanos-querier-687b955f69-w7s6w"
Jul 06 12:49:07.389316 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:07.389293    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/8e5f9c07-39e5-4442-a5bd-c14008103484-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-687b955f69-w7s6w\" (UID: \"8e5f9c07-39e5-4442-a5bd-c14008103484\") " pod="openshift-monitoring/thanos-querier-687b955f69-w7s6w"
Jul 06 12:49:07.389453 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:07.389436    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8e5f9c07-39e5-4442-a5bd-c14008103484-secret-grpc-tls\") pod \"thanos-querier-687b955f69-w7s6w\" (UID: \"8e5f9c07-39e5-4442-a5bd-c14008103484\") " pod="openshift-monitoring/thanos-querier-687b955f69-w7s6w"
Jul 06 12:49:07.389509 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:07.389491    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/8e5f9c07-39e5-4442-a5bd-c14008103484-secret-thanos-querier-tls\") pod \"thanos-querier-687b955f69-w7s6w\" (UID: \"8e5f9c07-39e5-4442-a5bd-c14008103484\") " pod="openshift-monitoring/thanos-querier-687b955f69-w7s6w"
Jul 06 12:49:07.389554 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:07.389528    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8e5f9c07-39e5-4442-a5bd-c14008103484-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-687b955f69-w7s6w\" (UID: \"8e5f9c07-39e5-4442-a5bd-c14008103484\") " pod="openshift-monitoring/thanos-querier-687b955f69-w7s6w"
Jul 06 12:49:07.390042 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:07.390017    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8e5f9c07-39e5-4442-a5bd-c14008103484-metrics-client-ca\") pod \"thanos-querier-687b955f69-w7s6w\" (UID: \"8e5f9c07-39e5-4442-a5bd-c14008103484\") " pod="openshift-monitoring/thanos-querier-687b955f69-w7s6w"
Jul 06 12:49:07.392514 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:07.392442    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/8e5f9c07-39e5-4442-a5bd-c14008103484-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-687b955f69-w7s6w\" (UID: \"8e5f9c07-39e5-4442-a5bd-c14008103484\") " pod="openshift-monitoring/thanos-querier-687b955f69-w7s6w"
Jul 06 12:49:07.392514 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:07.392469    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8e5f9c07-39e5-4442-a5bd-c14008103484-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-687b955f69-w7s6w\" (UID: \"8e5f9c07-39e5-4442-a5bd-c14008103484\") " pod="openshift-monitoring/thanos-querier-687b955f69-w7s6w"
Jul 06 12:49:07.392732 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:07.392707    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8e5f9c07-39e5-4442-a5bd-c14008103484-secret-grpc-tls\") pod \"thanos-querier-687b955f69-w7s6w\" (UID: \"8e5f9c07-39e5-4442-a5bd-c14008103484\") " pod="openshift-monitoring/thanos-querier-687b955f69-w7s6w"
Jul 06 12:49:07.392958 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:07.392936    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8e5f9c07-39e5-4442-a5bd-c14008103484-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-687b955f69-w7s6w\" (UID: \"8e5f9c07-39e5-4442-a5bd-c14008103484\") " pod="openshift-monitoring/thanos-querier-687b955f69-w7s6w"
Jul 06 12:49:07.393026 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:07.392982    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/8e5f9c07-39e5-4442-a5bd-c14008103484-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-687b955f69-w7s6w\" (UID: \"8e5f9c07-39e5-4442-a5bd-c14008103484\") " pod="openshift-monitoring/thanos-querier-687b955f69-w7s6w"
Jul 06 12:49:07.393081 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:07.393066    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/8e5f9c07-39e5-4442-a5bd-c14008103484-secret-thanos-querier-tls\") pod \"thanos-querier-687b955f69-w7s6w\" (UID: \"8e5f9c07-39e5-4442-a5bd-c14008103484\") " pod="openshift-monitoring/thanos-querier-687b955f69-w7s6w"
Jul 06 12:49:07.400835 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:07.400774    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ts5xz" event={"ID":"deb445ec-9b5e-4314-96a6-26bfcf350f23","Type":"ContainerStarted","Data":"a111b36efe4311f5a15ca3016ba75c5516b94133fe98b550b461d24c18e40a85"}
Jul 06 12:49:07.400963 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:07.400882    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ts5xz" event={"ID":"deb445ec-9b5e-4314-96a6-26bfcf350f23","Type":"ContainerStarted","Data":"1a46691f5aa4d1fd6a292c52c74da88e1ce0744904f43a44fb19dd345a729006"}
Jul 06 12:49:07.407933 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:07.407909    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dn4dx\" (UniqueName: \"kubernetes.io/projected/8e5f9c07-39e5-4442-a5bd-c14008103484-kube-api-access-dn4dx\") pod \"thanos-querier-687b955f69-w7s6w\" (UID: \"8e5f9c07-39e5-4442-a5bd-c14008103484\") " pod="openshift-monitoring/thanos-querier-687b955f69-w7s6w"
Jul 06 12:49:07.433330 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:07.433290    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-ts5xz" podStartSLOduration=2.25882535 podStartE2EDuration="3.433277665s" totalImagesPullingTime="1.111934872s" totalInitContainerRuntime="62.517443ms" isStatefulPod=true podCreationTimestamp="2026-07-06 12:49:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:49:07.432629406 +0000 UTC m=+124.301517067" watchObservedRunningTime="2026-07-06 12:49:07.433277665 +0000 UTC m=+124.302165356"
Jul 06 12:49:07.506804 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:07.506754    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:49:07.565759 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:07.565731    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-687b955f69-w7s6w"
Jul 06 12:49:07.720878 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:07.720832    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-687b955f69-w7s6w"]
Jul 06 12:49:07.726052 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:07.725614    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:49:07.727193 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:49:07.727170    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e5f9c07_39e5_4442_a5bd_c14008103484.slice/crio-3c83b253100b499ce9c39e4964c96e3f0e37fbefbc7c5dbe4cf1c1ecebeadb68 WatchSource:0}: Error finding container 3c83b253100b499ce9c39e4964c96e3f0e37fbefbc7c5dbe4cf1c1ecebeadb68: Status 404 returned error can't find the container with id 3c83b253100b499ce9c39e4964c96e3f0e37fbefbc7c5dbe4cf1c1ecebeadb68
Jul 06 12:49:07.863804 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:07.863696    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:49:08.338099 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:08.338068    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:49:08.406354 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:08.406317    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-687b955f69-w7s6w" event={"ID":"8e5f9c07-39e5-4442-a5bd-c14008103484","Type":"ContainerStarted","Data":"3c83b253100b499ce9c39e4964c96e3f0e37fbefbc7c5dbe4cf1c1ecebeadb68"}
Jul 06 12:49:08.449768 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:08.449687    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:49:08.707758 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:08.707680    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:49:08.842766 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:08.842725    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:49:08.990526 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:08.990465    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:49:09.034088 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:09.034062    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-54654d7bd5-9kn72"]
Jul 06 12:49:09.037152 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:09.037137    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54654d7bd5-9kn72"
Jul 06 12:49:09.040535 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:09.040516    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 06 12:49:09.040668 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:09.040558    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 06 12:49:09.041236 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:09.041221    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 06 12:49:09.042486 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:09.042471    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 06 12:49:09.042572 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:09.042507    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 06 12:49:09.042572 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:09.042509    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 06 12:49:09.042572 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:09.042571    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 06 12:49:09.048439 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:09.048423    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-jwqgr\""
Jul 06 12:49:09.052553 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:09.052531    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 06 12:49:09.061276 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:09.061253    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54654d7bd5-9kn72"]
Jul 06 12:49:09.102773 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:09.102746    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/17cbe79e-a1f7-43e0-a8d1-c12e3452d02c-console-oauth-config\") pod \"console-54654d7bd5-9kn72\" (UID: \"17cbe79e-a1f7-43e0-a8d1-c12e3452d02c\") " pod="openshift-console/console-54654d7bd5-9kn72"
Jul 06 12:49:09.102916 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:09.102782    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8khjc\" (UniqueName: \"kubernetes.io/projected/17cbe79e-a1f7-43e0-a8d1-c12e3452d02c-kube-api-access-8khjc\") pod \"console-54654d7bd5-9kn72\" (UID: \"17cbe79e-a1f7-43e0-a8d1-c12e3452d02c\") " pod="openshift-console/console-54654d7bd5-9kn72"
Jul 06 12:49:09.102916 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:09.102819    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17cbe79e-a1f7-43e0-a8d1-c12e3452d02c-trusted-ca-bundle\") pod \"console-54654d7bd5-9kn72\" (UID: \"17cbe79e-a1f7-43e0-a8d1-c12e3452d02c\") " pod="openshift-console/console-54654d7bd5-9kn72"
Jul 06 12:49:09.103012 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:09.102929    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/17cbe79e-a1f7-43e0-a8d1-c12e3452d02c-console-serving-cert\") pod \"console-54654d7bd5-9kn72\" (UID: \"17cbe79e-a1f7-43e0-a8d1-c12e3452d02c\") " pod="openshift-console/console-54654d7bd5-9kn72"
Jul 06 12:49:09.103012 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:09.102965    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/17cbe79e-a1f7-43e0-a8d1-c12e3452d02c-console-config\") pod \"console-54654d7bd5-9kn72\" (UID: \"17cbe79e-a1f7-43e0-a8d1-c12e3452d02c\") " pod="openshift-console/console-54654d7bd5-9kn72"
Jul 06 12:49:09.103012 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:09.102998    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/17cbe79e-a1f7-43e0-a8d1-c12e3452d02c-oauth-serving-cert\") pod \"console-54654d7bd5-9kn72\" (UID: \"17cbe79e-a1f7-43e0-a8d1-c12e3452d02c\") " pod="openshift-console/console-54654d7bd5-9kn72"
Jul 06 12:49:09.103140 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:09.103067    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/17cbe79e-a1f7-43e0-a8d1-c12e3452d02c-service-ca\") pod \"console-54654d7bd5-9kn72\" (UID: \"17cbe79e-a1f7-43e0-a8d1-c12e3452d02c\") " pod="openshift-console/console-54654d7bd5-9kn72"
Jul 06 12:49:09.203854 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:09.203808    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/17cbe79e-a1f7-43e0-a8d1-c12e3452d02c-service-ca\") pod \"console-54654d7bd5-9kn72\" (UID: \"17cbe79e-a1f7-43e0-a8d1-c12e3452d02c\") " pod="openshift-console/console-54654d7bd5-9kn72"
Jul 06 12:49:09.204019 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:09.203899    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/17cbe79e-a1f7-43e0-a8d1-c12e3452d02c-console-oauth-config\") pod \"console-54654d7bd5-9kn72\" (UID: \"17cbe79e-a1f7-43e0-a8d1-c12e3452d02c\") " pod="openshift-console/console-54654d7bd5-9kn72"
Jul 06 12:49:09.204019 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:09.203932    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8khjc\" (UniqueName: \"kubernetes.io/projected/17cbe79e-a1f7-43e0-a8d1-c12e3452d02c-kube-api-access-8khjc\") pod \"console-54654d7bd5-9kn72\" (UID: \"17cbe79e-a1f7-43e0-a8d1-c12e3452d02c\") " pod="openshift-console/console-54654d7bd5-9kn72"
Jul 06 12:49:09.204019 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:09.203967    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17cbe79e-a1f7-43e0-a8d1-c12e3452d02c-trusted-ca-bundle\") pod \"console-54654d7bd5-9kn72\" (UID: \"17cbe79e-a1f7-43e0-a8d1-c12e3452d02c\") " pod="openshift-console/console-54654d7bd5-9kn72"
Jul 06 12:49:09.204019 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:09.204016    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/17cbe79e-a1f7-43e0-a8d1-c12e3452d02c-console-serving-cert\") pod \"console-54654d7bd5-9kn72\" (UID: \"17cbe79e-a1f7-43e0-a8d1-c12e3452d02c\") " pod="openshift-console/console-54654d7bd5-9kn72"
Jul 06 12:49:09.204231 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:09.204041    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/17cbe79e-a1f7-43e0-a8d1-c12e3452d02c-console-config\") pod \"console-54654d7bd5-9kn72\" (UID: \"17cbe79e-a1f7-43e0-a8d1-c12e3452d02c\") " pod="openshift-console/console-54654d7bd5-9kn72"
Jul 06 12:49:09.204231 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:09.204070    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/17cbe79e-a1f7-43e0-a8d1-c12e3452d02c-oauth-serving-cert\") pod \"console-54654d7bd5-9kn72\" (UID: \"17cbe79e-a1f7-43e0-a8d1-c12e3452d02c\") " pod="openshift-console/console-54654d7bd5-9kn72"
Jul 06 12:49:09.204658 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:09.204610    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/17cbe79e-a1f7-43e0-a8d1-c12e3452d02c-service-ca\") pod \"console-54654d7bd5-9kn72\" (UID: \"17cbe79e-a1f7-43e0-a8d1-c12e3452d02c\") " pod="openshift-console/console-54654d7bd5-9kn72"
Jul 06 12:49:09.204771 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:09.204729    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/17cbe79e-a1f7-43e0-a8d1-c12e3452d02c-oauth-serving-cert\") pod \"console-54654d7bd5-9kn72\" (UID: \"17cbe79e-a1f7-43e0-a8d1-c12e3452d02c\") " pod="openshift-console/console-54654d7bd5-9kn72"
Jul 06 12:49:09.205079 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:09.205054    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/17cbe79e-a1f7-43e0-a8d1-c12e3452d02c-console-config\") pod \"console-54654d7bd5-9kn72\" (UID: \"17cbe79e-a1f7-43e0-a8d1-c12e3452d02c\") " pod="openshift-console/console-54654d7bd5-9kn72"
Jul 06 12:49:09.205184 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:09.205161    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17cbe79e-a1f7-43e0-a8d1-c12e3452d02c-trusted-ca-bundle\") pod \"console-54654d7bd5-9kn72\" (UID: \"17cbe79e-a1f7-43e0-a8d1-c12e3452d02c\") " pod="openshift-console/console-54654d7bd5-9kn72"
Jul 06 12:49:09.206950 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:09.206916    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/17cbe79e-a1f7-43e0-a8d1-c12e3452d02c-console-oauth-config\") pod \"console-54654d7bd5-9kn72\" (UID: \"17cbe79e-a1f7-43e0-a8d1-c12e3452d02c\") " pod="openshift-console/console-54654d7bd5-9kn72"
Jul 06 12:49:09.207034 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:09.206949    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/17cbe79e-a1f7-43e0-a8d1-c12e3452d02c-console-serving-cert\") pod \"console-54654d7bd5-9kn72\" (UID: \"17cbe79e-a1f7-43e0-a8d1-c12e3452d02c\") " pod="openshift-console/console-54654d7bd5-9kn72"
Jul 06 12:49:09.224491 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:09.224464    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8khjc\" (UniqueName: \"kubernetes.io/projected/17cbe79e-a1f7-43e0-a8d1-c12e3452d02c-kube-api-access-8khjc\") pod \"console-54654d7bd5-9kn72\" (UID: \"17cbe79e-a1f7-43e0-a8d1-c12e3452d02c\") " pod="openshift-console/console-54654d7bd5-9kn72"
Jul 06 12:49:09.346377 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:09.346294    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54654d7bd5-9kn72"
Jul 06 12:49:09.790005 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:09.789981    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54654d7bd5-9kn72"]
Jul 06 12:49:09.804997 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:49:09.804974    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17cbe79e_a1f7_43e0_a8d1_c12e3452d02c.slice/crio-189023deed19abb5119edc0e4ea11c64c9a93657df0d03f21eb7024e85de740a WatchSource:0}: Error finding container 189023deed19abb5119edc0e4ea11c64c9a93657df0d03f21eb7024e85de740a: Status 404 returned error can't find the container with id 189023deed19abb5119edc0e4ea11c64c9a93657df0d03f21eb7024e85de740a
Jul 06 12:49:09.820926 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:09.820905    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:49:09.967854 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:09.967757    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:49:10.415904 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:10.415872    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-687b955f69-w7s6w" event={"ID":"8e5f9c07-39e5-4442-a5bd-c14008103484","Type":"ContainerStarted","Data":"99bb5673103ea203bdba67c1b327b6ed63faf45e0bbebc0a7a8aa2e4ff92cd85"}
Jul 06 12:49:10.416331 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:10.415955    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-687b955f69-w7s6w" event={"ID":"8e5f9c07-39e5-4442-a5bd-c14008103484","Type":"ContainerStarted","Data":"3956e51f6b68c4e2a1d50fa15d6ff69da548548c62945b2a8a11b1b4ab50bcfe"}
Jul 06 12:49:10.416331 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:10.415999    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-687b955f69-w7s6w" event={"ID":"8e5f9c07-39e5-4442-a5bd-c14008103484","Type":"ContainerStarted","Data":"1725e783ef807dbbd44c80ebace8f97565d935f7f562bef2c5ad7824dcf30d33"}
Jul 06 12:49:10.417194 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:10.417166    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54654d7bd5-9kn72" event={"ID":"17cbe79e-a1f7-43e0-a8d1-c12e3452d02c","Type":"ContainerStarted","Data":"189023deed19abb5119edc0e4ea11c64c9a93657df0d03f21eb7024e85de740a"}
Jul 06 12:49:10.915374 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:10.915349    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:49:11.424276 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:11.424239    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-687b955f69-w7s6w" event={"ID":"8e5f9c07-39e5-4442-a5bd-c14008103484","Type":"ContainerStarted","Data":"10ed35c5e458929cec0273d248b634a45b51d50f4c5ad0341b9bf1ae5fd67217"}
Jul 06 12:49:11.424739 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:11.424306    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-687b955f69-w7s6w" event={"ID":"8e5f9c07-39e5-4442-a5bd-c14008103484","Type":"ContainerStarted","Data":"5f74a4dfb8e16336e3b2e68767766f8c8a7156b3529c0c5e878e35278ee04c2c"}
Jul 06 12:49:11.424739 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:11.424342    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-687b955f69-w7s6w" event={"ID":"8e5f9c07-39e5-4442-a5bd-c14008103484","Type":"ContainerStarted","Data":"728297366e102308d9a0911e9d3b8eb3c6e4bf541f97b8e00aa56c2508c5b0be"}
Jul 06 12:49:11.424739 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:11.424509    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-687b955f69-w7s6w"
Jul 06 12:49:11.517098 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:11.517036    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-687b955f69-w7s6w" podStartSLOduration=1.665849953 podStartE2EDuration="4.517014956s" totalImagesPullingTime="2.851165003s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:49:07 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:49:11.515313638 +0000 UTC m=+128.384201297" watchObservedRunningTime="2026-07-06 12:49:11.517014956 +0000 UTC m=+128.385902616"
Jul 06 12:49:11.869991 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:11.869909    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:49:12.056101 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:12.056070    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:49:13.433163 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:13.433130    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54654d7bd5-9kn72" event={"ID":"17cbe79e-a1f7-43e0-a8d1-c12e3452d02c","Type":"ContainerStarted","Data":"a2c90448f97732b4a0a3f13f73441903d8f59b01253d85cdd79d577f1861c160"}
Jul 06 12:49:13.438617 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:13.438596    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/efc0433a-6604-414a-b029-97f8b1075928-metrics-certs\") pod \"network-metrics-daemon-nhdrh\" (UID: \"efc0433a-6604-414a-b029-97f8b1075928\") " pod="openshift-multus/network-metrics-daemon-nhdrh"
Jul 06 12:49:13.440706 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:13.440680    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/efc0433a-6604-414a-b029-97f8b1075928-metrics-certs\") pod \"network-metrics-daemon-nhdrh\" (UID: \"efc0433a-6604-414a-b029-97f8b1075928\") " pod="openshift-multus/network-metrics-daemon-nhdrh"
Jul 06 12:49:13.463617 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:13.463594    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dxdc8\""
Jul 06 12:49:13.470815 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:13.470797    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nhdrh"
Jul 06 12:49:13.614366 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:13.614313    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-54654d7bd5-9kn72" podStartSLOduration=1.6309017190000001 podStartE2EDuration="4.614294424s" totalImagesPullingTime="2.983392705s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:49:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:49:13.473518473 +0000 UTC m=+130.342406132" watchObservedRunningTime="2026-07-06 12:49:13.614294424 +0000 UTC m=+130.483182084"
Jul 06 12:49:13.614717 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:13.614701    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nhdrh"]
Jul 06 12:49:13.618513 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:49:13.618478    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefc0433a_6604_414a_b029_97f8b1075928.slice/crio-2f9c591021db74d27cf62fe99d9205905a2306ca36eb2e273cb0251e50618f48 WatchSource:0}: Error finding container 2f9c591021db74d27cf62fe99d9205905a2306ca36eb2e273cb0251e50618f48: Status 404 returned error can't find the container with id 2f9c591021db74d27cf62fe99d9205905a2306ca36eb2e273cb0251e50618f48
Jul 06 12:49:14.439293 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:14.439257    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nhdrh" event={"ID":"efc0433a-6604-414a-b029-97f8b1075928","Type":"ContainerStarted","Data":"2f9c591021db74d27cf62fe99d9205905a2306ca36eb2e273cb0251e50618f48"}
Jul 06 12:49:15.444120 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:15.444090    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nhdrh" event={"ID":"efc0433a-6604-414a-b029-97f8b1075928","Type":"ContainerStarted","Data":"49dd4dcb9414db984d32cb65abc4d8b3c4e77c5068643a921227249371b111a9"}
Jul 06 12:49:15.444470 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:15.444139    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nhdrh" event={"ID":"efc0433a-6604-414a-b029-97f8b1075928","Type":"ContainerStarted","Data":"04ac511ad1a5c6c56c14981b84b1eb29aa053c9a0d2b21e50d83efd0fff94236"}
Jul 06 12:49:15.481393 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:15.481336    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-nhdrh" podStartSLOduration=130.32970988 podStartE2EDuration="2m11.48131481s" totalImagesPullingTime="1.15160493s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:47:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:49:15.48058553 +0000 UTC m=+132.349473252" watchObservedRunningTime="2026-07-06 12:49:15.48131481 +0000 UTC m=+132.350202471"
Jul 06 12:49:15.689859 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:15.689814    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:49:15.985306 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:15.985278    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:49:16.555217 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:16.555190    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:49:16.794172 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:16.794142    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:49:17.434434 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:17.434405    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-687b955f69-w7s6w"
Jul 06 12:49:17.888772 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:17.888745    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:49:18.068834 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:18.068806    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:49:18.601171 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:18.601140    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:49:18.943749 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:18.943673    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:49:19.347414 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:19.347376    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-54654d7bd5-9kn72"
Jul 06 12:49:19.347566 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:19.347502    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-54654d7bd5-9kn72"
Jul 06 12:49:19.352126 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:19.352108    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-54654d7bd5-9kn72"
Jul 06 12:49:19.463062 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:19.463038    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-54654d7bd5-9kn72"
Jul 06 12:49:19.908113 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:19.908075    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:49:20.131966 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:20.131932    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:49:20.356387 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:20.356360    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:49:23.067565 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:23.067537    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:49:23.166140 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:23.166107    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:49:29.556077 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:29.556045    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:49:29.668081 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:29.668043    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:49:32.505881 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:32.505826    2579 generic.go:356] "Generic (PLEG): container finished" podID="cbacc540-bf45-4a9c-9bbf-9a8ee3ae6ab2" containerID="e199d008caaabe6bf2df12467ded5104cfdea4adb784ae996867f3f9cc2b0d28" exitCode=0
Jul 06 12:49:32.506263 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:32.505899    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-dh2wk" event={"ID":"cbacc540-bf45-4a9c-9bbf-9a8ee3ae6ab2","Type":"ContainerDied","Data":"e199d008caaabe6bf2df12467ded5104cfdea4adb784ae996867f3f9cc2b0d28"}
Jul 06 12:49:32.506263 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:32.506240    2579 scope.go:117] "RemoveContainer" containerID="e199d008caaabe6bf2df12467ded5104cfdea4adb784ae996867f3f9cc2b0d28"
Jul 06 12:49:33.512148 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:33.512114    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-dh2wk" event={"ID":"cbacc540-bf45-4a9c-9bbf-9a8ee3ae6ab2","Type":"ContainerStarted","Data":"1868f468717040eea4ad9c6c95338f1f17f43b6236700cdebaac3645c9b51c41"}
Jul 06 12:49:36.923731 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:36.923704    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:49:37.189187 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:37.189106    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:49:37.300948 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:37.300917    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:49:42.444918 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:42.444886    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:49:43.224135 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:43.224094    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:49:48.465669 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:48.465627    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:49:48.565007 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:49:48.564932    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:50:01.504090 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:50:01.503999    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:50:01.637589 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:50:01.637561    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:50:02.430060 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:50:02.430023    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:50:03.188644 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:50:03.188609    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:50:03.617897 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:50:03.617832    2579 generic.go:356] "Generic (PLEG): container finished" podID="9678d2c6-71a7-4a4a-8d4c-815f98fc355f" containerID="138f603e78adcb086d5954119a024005d62e7ddcb0333bbcf90bcfdd6bd250f2" exitCode=0
Jul 06 12:50:03.618050 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:50:03.617906    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7khg2" event={"ID":"9678d2c6-71a7-4a4a-8d4c-815f98fc355f","Type":"ContainerDied","Data":"138f603e78adcb086d5954119a024005d62e7ddcb0333bbcf90bcfdd6bd250f2"}
Jul 06 12:50:03.618201 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:50:03.618186    2579 scope.go:117] "RemoveContainer" containerID="138f603e78adcb086d5954119a024005d62e7ddcb0333bbcf90bcfdd6bd250f2"
Jul 06 12:50:04.623232 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:50:04.623195    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7khg2" event={"ID":"9678d2c6-71a7-4a4a-8d4c-815f98fc355f","Type":"ContainerStarted","Data":"fb51b2b93dcbd74de52c6379f8789e4f2fe143709f8a4e93498c72adc476afe6"}
Jul 06 12:50:23.718868 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:50:23.718812    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:50:23.918376 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:50:23.918349    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:50:33.282477 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:50:33.282446    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-95b495c67-ftvsb"]
Jul 06 12:50:33.285552 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:50:33.285533    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-95b495c67-ftvsb"
Jul 06 12:50:33.296822 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:50:33.296803    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-95b495c67-ftvsb"]
Jul 06 12:50:33.348783 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:50:33.348755    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:50:33.410395 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:50:33.410372    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wcqn\" (UniqueName: \"kubernetes.io/projected/8ac136b9-c8e2-4495-a474-09a3effbe112-kube-api-access-7wcqn\") pod \"console-95b495c67-ftvsb\" (UID: \"8ac136b9-c8e2-4495-a474-09a3effbe112\") " pod="openshift-console/console-95b495c67-ftvsb"
Jul 06 12:50:33.410499 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:50:33.410413    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ac136b9-c8e2-4495-a474-09a3effbe112-trusted-ca-bundle\") pod \"console-95b495c67-ftvsb\" (UID: \"8ac136b9-c8e2-4495-a474-09a3effbe112\") " pod="openshift-console/console-95b495c67-ftvsb"
Jul 06 12:50:33.410499 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:50:33.410436    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8ac136b9-c8e2-4495-a474-09a3effbe112-service-ca\") pod \"console-95b495c67-ftvsb\" (UID: \"8ac136b9-c8e2-4495-a474-09a3effbe112\") " pod="openshift-console/console-95b495c67-ftvsb"
Jul 06 12:50:33.410499 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:50:33.410466    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8ac136b9-c8e2-4495-a474-09a3effbe112-console-oauth-config\") pod \"console-95b495c67-ftvsb\" (UID: \"8ac136b9-c8e2-4495-a474-09a3effbe112\") " pod="openshift-console/console-95b495c67-ftvsb"
Jul 06 12:50:33.410499 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:50:33.410492    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8ac136b9-c8e2-4495-a474-09a3effbe112-console-serving-cert\") pod \"console-95b495c67-ftvsb\" (UID: \"8ac136b9-c8e2-4495-a474-09a3effbe112\") " pod="openshift-console/console-95b495c67-ftvsb"
Jul 06 12:50:33.410652 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:50:33.410511    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8ac136b9-c8e2-4495-a474-09a3effbe112-oauth-serving-cert\") pod \"console-95b495c67-ftvsb\" (UID: \"8ac136b9-c8e2-4495-a474-09a3effbe112\") " pod="openshift-console/console-95b495c67-ftvsb"
Jul 06 12:50:33.410652 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:50:33.410534    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8ac136b9-c8e2-4495-a474-09a3effbe112-console-config\") pod \"console-95b495c67-ftvsb\" (UID: \"8ac136b9-c8e2-4495-a474-09a3effbe112\") " pod="openshift-console/console-95b495c67-ftvsb"
Jul 06 12:50:33.417676 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:50:33.417653    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:50:33.511304 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:50:33.511285    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ac136b9-c8e2-4495-a474-09a3effbe112-trusted-ca-bundle\") pod \"console-95b495c67-ftvsb\" (UID: \"8ac136b9-c8e2-4495-a474-09a3effbe112\") " pod="openshift-console/console-95b495c67-ftvsb"
Jul 06 12:50:33.511385 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:50:33.511314    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8ac136b9-c8e2-4495-a474-09a3effbe112-service-ca\") pod \"console-95b495c67-ftvsb\" (UID: \"8ac136b9-c8e2-4495-a474-09a3effbe112\") " pod="openshift-console/console-95b495c67-ftvsb"
Jul 06 12:50:33.511385 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:50:33.511334    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8ac136b9-c8e2-4495-a474-09a3effbe112-console-oauth-config\") pod \"console-95b495c67-ftvsb\" (UID: \"8ac136b9-c8e2-4495-a474-09a3effbe112\") " pod="openshift-console/console-95b495c67-ftvsb"
Jul 06 12:50:33.511385 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:50:33.511357    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8ac136b9-c8e2-4495-a474-09a3effbe112-console-serving-cert\") pod \"console-95b495c67-ftvsb\" (UID: \"8ac136b9-c8e2-4495-a474-09a3effbe112\") " pod="openshift-console/console-95b495c67-ftvsb"
Jul 06 12:50:33.511551 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:50:33.511386    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8ac136b9-c8e2-4495-a474-09a3effbe112-oauth-serving-cert\") pod \"console-95b495c67-ftvsb\" (UID: \"8ac136b9-c8e2-4495-a474-09a3effbe112\") " pod="openshift-console/console-95b495c67-ftvsb"
Jul 06 12:50:33.511551 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:50:33.511442    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8ac136b9-c8e2-4495-a474-09a3effbe112-console-config\") pod \"console-95b495c67-ftvsb\" (UID: \"8ac136b9-c8e2-4495-a474-09a3effbe112\") " pod="openshift-console/console-95b495c67-ftvsb"
Jul 06 12:50:33.511551 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:50:33.511485    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wcqn\" (UniqueName: \"kubernetes.io/projected/8ac136b9-c8e2-4495-a474-09a3effbe112-kube-api-access-7wcqn\") pod \"console-95b495c67-ftvsb\" (UID: \"8ac136b9-c8e2-4495-a474-09a3effbe112\") " pod="openshift-console/console-95b495c67-ftvsb"
Jul 06 12:50:33.512146 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:50:33.512124    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8ac136b9-c8e2-4495-a474-09a3effbe112-service-ca\") pod \"console-95b495c67-ftvsb\" (UID: \"8ac136b9-c8e2-4495-a474-09a3effbe112\") " pod="openshift-console/console-95b495c67-ftvsb"
Jul 06 12:50:33.512239 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:50:33.512184    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8ac136b9-c8e2-4495-a474-09a3effbe112-oauth-serving-cert\") pod \"console-95b495c67-ftvsb\" (UID: \"8ac136b9-c8e2-4495-a474-09a3effbe112\") " pod="openshift-console/console-95b495c67-ftvsb"
Jul 06 12:50:33.512239 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:50:33.512205    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8ac136b9-c8e2-4495-a474-09a3effbe112-console-config\") pod \"console-95b495c67-ftvsb\" (UID: \"8ac136b9-c8e2-4495-a474-09a3effbe112\") " pod="openshift-console/console-95b495c67-ftvsb"
Jul 06 12:50:33.512370 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:50:33.512309    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ac136b9-c8e2-4495-a474-09a3effbe112-trusted-ca-bundle\") pod \"console-95b495c67-ftvsb\" (UID: \"8ac136b9-c8e2-4495-a474-09a3effbe112\") " pod="openshift-console/console-95b495c67-ftvsb"
Jul 06 12:50:33.513806 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:50:33.513778    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8ac136b9-c8e2-4495-a474-09a3effbe112-console-oauth-config\") pod \"console-95b495c67-ftvsb\" (UID: \"8ac136b9-c8e2-4495-a474-09a3effbe112\") " pod="openshift-console/console-95b495c67-ftvsb"
Jul 06 12:50:33.513911 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:50:33.513897    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8ac136b9-c8e2-4495-a474-09a3effbe112-console-serving-cert\") pod \"console-95b495c67-ftvsb\" (UID: \"8ac136b9-c8e2-4495-a474-09a3effbe112\") " pod="openshift-console/console-95b495c67-ftvsb"
Jul 06 12:50:33.520426 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:50:33.520405    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wcqn\" (UniqueName: \"kubernetes.io/projected/8ac136b9-c8e2-4495-a474-09a3effbe112-kube-api-access-7wcqn\") pod \"console-95b495c67-ftvsb\" (UID: \"8ac136b9-c8e2-4495-a474-09a3effbe112\") " pod="openshift-console/console-95b495c67-ftvsb"
Jul 06 12:50:33.594336 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:50:33.594285    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-95b495c67-ftvsb"
Jul 06 12:50:33.729053 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:50:33.729022    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-95b495c67-ftvsb"]
Jul 06 12:50:33.731879 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:50:33.731833    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ac136b9_c8e2_4495_a474_09a3effbe112.slice/crio-226a9920b6166e05aaf3b75d80fc994972e4b3b7db1798df584e8b70714864af WatchSource:0}: Error finding container 226a9920b6166e05aaf3b75d80fc994972e4b3b7db1798df584e8b70714864af: Status 404 returned error can't find the container with id 226a9920b6166e05aaf3b75d80fc994972e4b3b7db1798df584e8b70714864af
Jul 06 12:50:34.723966 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:50:34.723936    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-95b495c67-ftvsb" event={"ID":"8ac136b9-c8e2-4495-a474-09a3effbe112","Type":"ContainerStarted","Data":"1a7fa5e1cd8cd22ebadb431300aea5bc6f64d1f6f8e0a2dc83726c1b14037445"}
Jul 06 12:50:34.724310 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:50:34.723981    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-95b495c67-ftvsb" event={"ID":"8ac136b9-c8e2-4495-a474-09a3effbe112","Type":"ContainerStarted","Data":"226a9920b6166e05aaf3b75d80fc994972e4b3b7db1798df584e8b70714864af"}
Jul 06 12:50:34.745232 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:50:34.745190    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-95b495c67-ftvsb" podStartSLOduration=1.745176072 podStartE2EDuration="1.745176072s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:50:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:50:34.743219215 +0000 UTC m=+211.612106889" watchObservedRunningTime="2026-07-06 12:50:34.745176072 +0000 UTC m=+211.614063730"
Jul 06 12:50:43.594579 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:50:43.594541    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-95b495c67-ftvsb"
Jul 06 12:50:43.595023 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:50:43.594600    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-95b495c67-ftvsb"
Jul 06 12:50:43.599089 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:50:43.599066    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-95b495c67-ftvsb"
Jul 06 12:50:43.756106 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:50:43.756079    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-95b495c67-ftvsb"
Jul 06 12:50:43.817165 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:50:43.817137    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54654d7bd5-9kn72"]
Jul 06 12:50:43.951052 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:50:43.950951    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:50:44.048196 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:50:44.048166    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:50:44.148365 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:50:44.148341    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:51:08.843880 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:51:08.843830    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-54654d7bd5-9kn72" podUID="17cbe79e-a1f7-43e0-a8d1-c12e3452d02c" containerName="console" containerID="cri-o://a2c90448f97732b4a0a3f13f73441903d8f59b01253d85cdd79d577f1861c160" gracePeriod=15
Jul 06 12:51:09.085774 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:51:09.085752    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54654d7bd5-9kn72"
Jul 06 12:51:09.163586 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:51:09.163521    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17cbe79e-a1f7-43e0-a8d1-c12e3452d02c-trusted-ca-bundle\") pod \"17cbe79e-a1f7-43e0-a8d1-c12e3452d02c\" (UID: \"17cbe79e-a1f7-43e0-a8d1-c12e3452d02c\") "
Jul 06 12:51:09.163586 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:51:09.163555    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8khjc\" (UniqueName: \"kubernetes.io/projected/17cbe79e-a1f7-43e0-a8d1-c12e3452d02c-kube-api-access-8khjc\") pod \"17cbe79e-a1f7-43e0-a8d1-c12e3452d02c\" (UID: \"17cbe79e-a1f7-43e0-a8d1-c12e3452d02c\") "
Jul 06 12:51:09.163774 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:51:09.163598    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/17cbe79e-a1f7-43e0-a8d1-c12e3452d02c-oauth-serving-cert\") pod \"17cbe79e-a1f7-43e0-a8d1-c12e3452d02c\" (UID: \"17cbe79e-a1f7-43e0-a8d1-c12e3452d02c\") "
Jul 06 12:51:09.163774 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:51:09.163718    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/17cbe79e-a1f7-43e0-a8d1-c12e3452d02c-console-oauth-config\") pod \"17cbe79e-a1f7-43e0-a8d1-c12e3452d02c\" (UID: \"17cbe79e-a1f7-43e0-a8d1-c12e3452d02c\") "
Jul 06 12:51:09.163774 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:51:09.163753    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/17cbe79e-a1f7-43e0-a8d1-c12e3452d02c-console-serving-cert\") pod \"17cbe79e-a1f7-43e0-a8d1-c12e3452d02c\" (UID: \"17cbe79e-a1f7-43e0-a8d1-c12e3452d02c\") "
Jul 06 12:51:09.163965 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:51:09.163779    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/17cbe79e-a1f7-43e0-a8d1-c12e3452d02c-service-ca\") pod \"17cbe79e-a1f7-43e0-a8d1-c12e3452d02c\" (UID: \"17cbe79e-a1f7-43e0-a8d1-c12e3452d02c\") "
Jul 06 12:51:09.163965 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:51:09.163799    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/17cbe79e-a1f7-43e0-a8d1-c12e3452d02c-console-config\") pod \"17cbe79e-a1f7-43e0-a8d1-c12e3452d02c\" (UID: \"17cbe79e-a1f7-43e0-a8d1-c12e3452d02c\") "
Jul 06 12:51:09.163965 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:51:09.163942    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17cbe79e-a1f7-43e0-a8d1-c12e3452d02c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "17cbe79e-a1f7-43e0-a8d1-c12e3452d02c" (UID: "17cbe79e-a1f7-43e0-a8d1-c12e3452d02c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 12:51:09.163965 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:51:09.163957    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17cbe79e-a1f7-43e0-a8d1-c12e3452d02c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "17cbe79e-a1f7-43e0-a8d1-c12e3452d02c" (UID: "17cbe79e-a1f7-43e0-a8d1-c12e3452d02c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 12:51:09.164177 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:51:09.164156    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17cbe79e-a1f7-43e0-a8d1-c12e3452d02c-service-ca" (OuterVolumeSpecName: "service-ca") pod "17cbe79e-a1f7-43e0-a8d1-c12e3452d02c" (UID: "17cbe79e-a1f7-43e0-a8d1-c12e3452d02c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 12:51:09.164247 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:51:09.164225    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17cbe79e-a1f7-43e0-a8d1-c12e3452d02c-console-config" (OuterVolumeSpecName: "console-config") pod "17cbe79e-a1f7-43e0-a8d1-c12e3452d02c" (UID: "17cbe79e-a1f7-43e0-a8d1-c12e3452d02c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 12:51:09.164301 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:51:09.164243    2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17cbe79e-a1f7-43e0-a8d1-c12e3452d02c-trusted-ca-bundle\") on node \"ip-10-0-129-126.ec2.internal\" DevicePath \"\""
Jul 06 12:51:09.164301 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:51:09.164263    2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/17cbe79e-a1f7-43e0-a8d1-c12e3452d02c-oauth-serving-cert\") on node \"ip-10-0-129-126.ec2.internal\" DevicePath \"\""
Jul 06 12:51:09.165805 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:51:09.165772    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/17cbe79e-a1f7-43e0-a8d1-c12e3452d02c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "17cbe79e-a1f7-43e0-a8d1-c12e3452d02c" (UID: "17cbe79e-a1f7-43e0-a8d1-c12e3452d02c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 12:51:09.165945 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:51:09.165832    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/17cbe79e-a1f7-43e0-a8d1-c12e3452d02c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "17cbe79e-a1f7-43e0-a8d1-c12e3452d02c" (UID: "17cbe79e-a1f7-43e0-a8d1-c12e3452d02c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 12:51:09.165945 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:51:09.165865    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17cbe79e-a1f7-43e0-a8d1-c12e3452d02c-kube-api-access-8khjc" (OuterVolumeSpecName: "kube-api-access-8khjc") pod "17cbe79e-a1f7-43e0-a8d1-c12e3452d02c" (UID: "17cbe79e-a1f7-43e0-a8d1-c12e3452d02c"). InnerVolumeSpecName "kube-api-access-8khjc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 12:51:09.264920 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:51:09.264893    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8khjc\" (UniqueName: \"kubernetes.io/projected/17cbe79e-a1f7-43e0-a8d1-c12e3452d02c-kube-api-access-8khjc\") on node \"ip-10-0-129-126.ec2.internal\" DevicePath \"\""
Jul 06 12:51:09.264920 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:51:09.264915    2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/17cbe79e-a1f7-43e0-a8d1-c12e3452d02c-console-oauth-config\") on node \"ip-10-0-129-126.ec2.internal\" DevicePath \"\""
Jul 06 12:51:09.265052 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:51:09.264929    2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/17cbe79e-a1f7-43e0-a8d1-c12e3452d02c-console-serving-cert\") on node \"ip-10-0-129-126.ec2.internal\" DevicePath \"\""
Jul 06 12:51:09.265052 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:51:09.264942    2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/17cbe79e-a1f7-43e0-a8d1-c12e3452d02c-service-ca\") on node \"ip-10-0-129-126.ec2.internal\" DevicePath \"\""
Jul 06 12:51:09.265052 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:51:09.264954    2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/17cbe79e-a1f7-43e0-a8d1-c12e3452d02c-console-config\") on node \"ip-10-0-129-126.ec2.internal\" DevicePath \"\""
Jul 06 12:51:09.619010 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:51:09.618961    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:51:09.837555 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:51:09.837526    2579 generic.go:356] "Generic (PLEG): container finished" podID="17cbe79e-a1f7-43e0-a8d1-c12e3452d02c" containerID="a2c90448f97732b4a0a3f13f73441903d8f59b01253d85cdd79d577f1861c160" exitCode=0
Jul 06 12:51:09.837671 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:51:09.837571    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54654d7bd5-9kn72"
Jul 06 12:51:09.837671 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:51:09.837611    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54654d7bd5-9kn72" event={"ID":"17cbe79e-a1f7-43e0-a8d1-c12e3452d02c","Type":"ContainerDied","Data":"a2c90448f97732b4a0a3f13f73441903d8f59b01253d85cdd79d577f1861c160"}
Jul 06 12:51:09.837671 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:51:09.837658    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54654d7bd5-9kn72" event={"ID":"17cbe79e-a1f7-43e0-a8d1-c12e3452d02c","Type":"ContainerDied","Data":"189023deed19abb5119edc0e4ea11c64c9a93657df0d03f21eb7024e85de740a"}
Jul 06 12:51:09.837769 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:51:09.837690    2579 scope.go:117] "RemoveContainer" containerID="a2c90448f97732b4a0a3f13f73441903d8f59b01253d85cdd79d577f1861c160"
Jul 06 12:51:09.845649 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:51:09.845543    2579 scope.go:117] "RemoveContainer" containerID="a2c90448f97732b4a0a3f13f73441903d8f59b01253d85cdd79d577f1861c160"
Jul 06 12:51:09.845997 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:51:09.845789    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2c90448f97732b4a0a3f13f73441903d8f59b01253d85cdd79d577f1861c160\": container with ID starting with a2c90448f97732b4a0a3f13f73441903d8f59b01253d85cdd79d577f1861c160 not found: ID does not exist" containerID="a2c90448f97732b4a0a3f13f73441903d8f59b01253d85cdd79d577f1861c160"
Jul 06 12:51:09.845997 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:51:09.845817    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2c90448f97732b4a0a3f13f73441903d8f59b01253d85cdd79d577f1861c160"} err="failed to get container status \"a2c90448f97732b4a0a3f13f73441903d8f59b01253d85cdd79d577f1861c160\": rpc error: code = NotFound desc = could not find container \"a2c90448f97732b4a0a3f13f73441903d8f59b01253d85cdd79d577f1861c160\": container with ID starting with a2c90448f97732b4a0a3f13f73441903d8f59b01253d85cdd79d577f1861c160 not found: ID does not exist"
Jul 06 12:51:09.857040 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:51:09.857003    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54654d7bd5-9kn72"]
Jul 06 12:51:09.861652 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:51:09.861631    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-54654d7bd5-9kn72"]
Jul 06 12:51:11.653140 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:51:11.653111    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17cbe79e-a1f7-43e0-a8d1-c12e3452d02c" path="/var/lib/kubelet/pods/17cbe79e-a1f7-43e0-a8d1-c12e3452d02c/volumes"
Jul 06 12:51:18.978592 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:51:18.978558    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:51:19.042404 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:51:19.042374    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:51:39.026002 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:51:39.025921    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:51:39.085132 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:51:39.085105    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:51:39.929711 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:51:39.929682    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5cc7b77756-wj4xs"]
Jul 06 12:51:39.929979 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:51:39.929965    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17cbe79e-a1f7-43e0-a8d1-c12e3452d02c" containerName="console"
Jul 06 12:51:39.930027 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:51:39.929981    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="17cbe79e-a1f7-43e0-a8d1-c12e3452d02c" containerName="console"
Jul 06 12:51:39.930027 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:51:39.930025    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="17cbe79e-a1f7-43e0-a8d1-c12e3452d02c" containerName="console"
Jul 06 12:51:39.932949 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:51:39.932928    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cc7b77756-wj4xs"
Jul 06 12:51:39.956591 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:51:39.956563    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cc7b77756-wj4xs"]
Jul 06 12:51:40.002407 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:51:40.002378    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:51:40.071078 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:51:40.071054    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:51:40.072109 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:51:40.072088    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/58618491-2188-4287-8f70-2ad257d024e5-console-oauth-config\") pod \"console-5cc7b77756-wj4xs\" (UID: \"58618491-2188-4287-8f70-2ad257d024e5\") " pod="openshift-console/console-5cc7b77756-wj4xs"
Jul 06 12:51:40.072163 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:51:40.072127    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/58618491-2188-4287-8f70-2ad257d024e5-console-serving-cert\") pod \"console-5cc7b77756-wj4xs\" (UID: \"58618491-2188-4287-8f70-2ad257d024e5\") " pod="openshift-console/console-5cc7b77756-wj4xs"
Jul 06 12:51:40.072163 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:51:40.072155    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/58618491-2188-4287-8f70-2ad257d024e5-service-ca\") pod \"console-5cc7b77756-wj4xs\" (UID: \"58618491-2188-4287-8f70-2ad257d024e5\") " pod="openshift-console/console-5cc7b77756-wj4xs"
Jul 06 12:51:40.072225 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:51:40.072179    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z54gc\" (UniqueName: \"kubernetes.io/projected/58618491-2188-4287-8f70-2ad257d024e5-kube-api-access-z54gc\") pod \"console-5cc7b77756-wj4xs\" (UID: \"58618491-2188-4287-8f70-2ad257d024e5\") " pod="openshift-console/console-5cc7b77756-wj4xs"
Jul 06 12:51:40.072225 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:51:40.072197    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/58618491-2188-4287-8f70-2ad257d024e5-console-config\") pod \"console-5cc7b77756-wj4xs\" (UID: \"58618491-2188-4287-8f70-2ad257d024e5\") " pod="openshift-console/console-5cc7b77756-wj4xs"
Jul 06 12:51:40.072225 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:51:40.072220    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/58618491-2188-4287-8f70-2ad257d024e5-oauth-serving-cert\") pod \"console-5cc7b77756-wj4xs\" (UID: \"58618491-2188-4287-8f70-2ad257d024e5\") " pod="openshift-console/console-5cc7b77756-wj4xs"
Jul 06 12:51:40.072363 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:51:40.072325    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58618491-2188-4287-8f70-2ad257d024e5-trusted-ca-bundle\") pod \"console-5cc7b77756-wj4xs\" (UID: \"58618491-2188-4287-8f70-2ad257d024e5\") " pod="openshift-console/console-5cc7b77756-wj4xs"
Jul 06 12:51:40.172871 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:51:40.172826    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58618491-2188-4287-8f70-2ad257d024e5-trusted-ca-bundle\") pod \"console-5cc7b77756-wj4xs\" (UID: \"58618491-2188-4287-8f70-2ad257d024e5\") " pod="openshift-console/console-5cc7b77756-wj4xs"
Jul 06 12:51:40.172992 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:51:40.172891    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/58618491-2188-4287-8f70-2ad257d024e5-console-oauth-config\") pod \"console-5cc7b77756-wj4xs\" (UID: \"58618491-2188-4287-8f70-2ad257d024e5\") " pod="openshift-console/console-5cc7b77756-wj4xs"
Jul 06 12:51:40.172992 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:51:40.172929    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/58618491-2188-4287-8f70-2ad257d024e5-console-serving-cert\") pod \"console-5cc7b77756-wj4xs\" (UID: \"58618491-2188-4287-8f70-2ad257d024e5\") " pod="openshift-console/console-5cc7b77756-wj4xs"
Jul 06 12:51:40.172992 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:51:40.172961    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/58618491-2188-4287-8f70-2ad257d024e5-service-ca\") pod \"console-5cc7b77756-wj4xs\" (UID: \"58618491-2188-4287-8f70-2ad257d024e5\") " pod="openshift-console/console-5cc7b77756-wj4xs"
Jul 06 12:51:40.173143 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:51:40.173078    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z54gc\" (UniqueName: \"kubernetes.io/projected/58618491-2188-4287-8f70-2ad257d024e5-kube-api-access-z54gc\") pod \"console-5cc7b77756-wj4xs\" (UID: \"58618491-2188-4287-8f70-2ad257d024e5\") " pod="openshift-console/console-5cc7b77756-wj4xs"
Jul 06 12:51:40.173143 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:51:40.173124    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/58618491-2188-4287-8f70-2ad257d024e5-console-config\") pod \"console-5cc7b77756-wj4xs\" (UID: \"58618491-2188-4287-8f70-2ad257d024e5\") " pod="openshift-console/console-5cc7b77756-wj4xs"
Jul 06 12:51:40.173243 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:51:40.173170    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/58618491-2188-4287-8f70-2ad257d024e5-oauth-serving-cert\") pod \"console-5cc7b77756-wj4xs\" (UID: \"58618491-2188-4287-8f70-2ad257d024e5\") " pod="openshift-console/console-5cc7b77756-wj4xs"
Jul 06 12:51:40.173702 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:51:40.173677    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/58618491-2188-4287-8f70-2ad257d024e5-service-ca\") pod \"console-5cc7b77756-wj4xs\" (UID: \"58618491-2188-4287-8f70-2ad257d024e5\") " pod="openshift-console/console-5cc7b77756-wj4xs"
Jul 06 12:51:40.173789 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:51:40.173765    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/58618491-2188-4287-8f70-2ad257d024e5-oauth-serving-cert\") pod \"console-5cc7b77756-wj4xs\" (UID: \"58618491-2188-4287-8f70-2ad257d024e5\") " pod="openshift-console/console-5cc7b77756-wj4xs"
Jul 06 12:51:40.173889 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:51:40.173864    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/58618491-2188-4287-8f70-2ad257d024e5-console-config\") pod \"console-5cc7b77756-wj4xs\" (UID: \"58618491-2188-4287-8f70-2ad257d024e5\") " pod="openshift-console/console-5cc7b77756-wj4xs"
Jul 06 12:51:40.174015 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:51:40.173999    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58618491-2188-4287-8f70-2ad257d024e5-trusted-ca-bundle\") pod \"console-5cc7b77756-wj4xs\" (UID: \"58618491-2188-4287-8f70-2ad257d024e5\") " pod="openshift-console/console-5cc7b77756-wj4xs"
Jul 06 12:51:40.175883 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:51:40.175867    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/58618491-2188-4287-8f70-2ad257d024e5-console-oauth-config\") pod \"console-5cc7b77756-wj4xs\" (UID: \"58618491-2188-4287-8f70-2ad257d024e5\") " pod="openshift-console/console-5cc7b77756-wj4xs"
Jul 06 12:51:40.176081 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:51:40.176062    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/58618491-2188-4287-8f70-2ad257d024e5-console-serving-cert\") pod \"console-5cc7b77756-wj4xs\" (UID: \"58618491-2188-4287-8f70-2ad257d024e5\") " pod="openshift-console/console-5cc7b77756-wj4xs"
Jul 06 12:51:40.182037 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:51:40.181978    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z54gc\" (UniqueName: \"kubernetes.io/projected/58618491-2188-4287-8f70-2ad257d024e5-kube-api-access-z54gc\") pod \"console-5cc7b77756-wj4xs\" (UID: \"58618491-2188-4287-8f70-2ad257d024e5\") " pod="openshift-console/console-5cc7b77756-wj4xs"
Jul 06 12:51:40.242498 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:51:40.242472    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cc7b77756-wj4xs"
Jul 06 12:51:40.367031 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:51:40.367001    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cc7b77756-wj4xs"]
Jul 06 12:51:40.370469 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:51:40.370441    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58618491_2188_4287_8f70_2ad257d024e5.slice/crio-20ec7119e2ee57be7904a2f8bbf55722df66365dae7a2be8d49217f2d3ea2954 WatchSource:0}: Error finding container 20ec7119e2ee57be7904a2f8bbf55722df66365dae7a2be8d49217f2d3ea2954: Status 404 returned error can't find the container with id 20ec7119e2ee57be7904a2f8bbf55722df66365dae7a2be8d49217f2d3ea2954
Jul 06 12:51:40.944827 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:51:40.944792    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cc7b77756-wj4xs" event={"ID":"58618491-2188-4287-8f70-2ad257d024e5","Type":"ContainerStarted","Data":"14e3c0ad4c29376dd13c32b17d691c02d6853f91aa82a9265a5ce13b905c9cb5"}
Jul 06 12:51:40.945013 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:51:40.944863    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cc7b77756-wj4xs" event={"ID":"58618491-2188-4287-8f70-2ad257d024e5","Type":"ContainerStarted","Data":"20ec7119e2ee57be7904a2f8bbf55722df66365dae7a2be8d49217f2d3ea2954"}
Jul 06 12:51:40.964371 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:51:40.964318    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5cc7b77756-wj4xs" podStartSLOduration=1.964304393 podStartE2EDuration="1.964304393s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:51:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:51:40.96357402 +0000 UTC m=+277.832461678" watchObservedRunningTime="2026-07-06 12:51:40.964304393 +0000 UTC m=+277.833192051"
Jul 06 12:51:50.242919 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:51:50.242885    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5cc7b77756-wj4xs"
Jul 06 12:51:50.243460 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:51:50.242945    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5cc7b77756-wj4xs"
Jul 06 12:51:50.247575 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:51:50.247556    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5cc7b77756-wj4xs"
Jul 06 12:51:50.985091 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:51:50.985060    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5cc7b77756-wj4xs"
Jul 06 12:51:51.038380 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:51:51.038347    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:51:51.046957 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:51:51.046929    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-95b495c67-ftvsb"]
Jul 06 12:51:51.138953 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:51:51.138922    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:51:51.238921 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:51:51.238830    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:51:51.310615 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:51:51.310592    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:51:57.781893 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:51:57.781827    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:51:59.552339 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:51:59.552306    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:51:59.685013 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:51:59.684982    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:52:03.568581 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:52:03.568556    2579 kubelet.go:1648] "Image garbage collection succeeded"
Jul 06 12:52:16.066882 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:52:16.066830    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-95b495c67-ftvsb" podUID="8ac136b9-c8e2-4495-a474-09a3effbe112" containerName="console" containerID="cri-o://1a7fa5e1cd8cd22ebadb431300aea5bc6f64d1f6f8e0a2dc83726c1b14037445" gracePeriod=15
Jul 06 12:52:16.299309 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:52:16.299287    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-95b495c67-ftvsb"
Jul 06 12:52:16.416417 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:52:16.416351    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8ac136b9-c8e2-4495-a474-09a3effbe112-console-config\") pod \"8ac136b9-c8e2-4495-a474-09a3effbe112\" (UID: \"8ac136b9-c8e2-4495-a474-09a3effbe112\") "
Jul 06 12:52:16.416417 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:52:16.416403    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ac136b9-c8e2-4495-a474-09a3effbe112-trusted-ca-bundle\") pod \"8ac136b9-c8e2-4495-a474-09a3effbe112\" (UID: \"8ac136b9-c8e2-4495-a474-09a3effbe112\") "
Jul 06 12:52:16.416591 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:52:16.416432    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8ac136b9-c8e2-4495-a474-09a3effbe112-service-ca\") pod \"8ac136b9-c8e2-4495-a474-09a3effbe112\" (UID: \"8ac136b9-c8e2-4495-a474-09a3effbe112\") "
Jul 06 12:52:16.416591 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:52:16.416554    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8ac136b9-c8e2-4495-a474-09a3effbe112-oauth-serving-cert\") pod \"8ac136b9-c8e2-4495-a474-09a3effbe112\" (UID: \"8ac136b9-c8e2-4495-a474-09a3effbe112\") "
Jul 06 12:52:16.416673 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:52:16.416638    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8ac136b9-c8e2-4495-a474-09a3effbe112-console-oauth-config\") pod \"8ac136b9-c8e2-4495-a474-09a3effbe112\" (UID: \"8ac136b9-c8e2-4495-a474-09a3effbe112\") "
Jul 06 12:52:16.416673 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:52:16.416664    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7wcqn\" (UniqueName: \"kubernetes.io/projected/8ac136b9-c8e2-4495-a474-09a3effbe112-kube-api-access-7wcqn\") pod \"8ac136b9-c8e2-4495-a474-09a3effbe112\" (UID: \"8ac136b9-c8e2-4495-a474-09a3effbe112\") "
Jul 06 12:52:16.416774 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:52:16.416692    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8ac136b9-c8e2-4495-a474-09a3effbe112-console-serving-cert\") pod \"8ac136b9-c8e2-4495-a474-09a3effbe112\" (UID: \"8ac136b9-c8e2-4495-a474-09a3effbe112\") "
Jul 06 12:52:16.416827 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:52:16.416764    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ac136b9-c8e2-4495-a474-09a3effbe112-console-config" (OuterVolumeSpecName: "console-config") pod "8ac136b9-c8e2-4495-a474-09a3effbe112" (UID: "8ac136b9-c8e2-4495-a474-09a3effbe112"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 12:52:16.416916 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:52:16.416890    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ac136b9-c8e2-4495-a474-09a3effbe112-service-ca" (OuterVolumeSpecName: "service-ca") pod "8ac136b9-c8e2-4495-a474-09a3effbe112" (UID: "8ac136b9-c8e2-4495-a474-09a3effbe112"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 12:52:16.416916 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:52:16.416896    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ac136b9-c8e2-4495-a474-09a3effbe112-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8ac136b9-c8e2-4495-a474-09a3effbe112" (UID: "8ac136b9-c8e2-4495-a474-09a3effbe112"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 12:52:16.417022 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:52:16.416954    2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8ac136b9-c8e2-4495-a474-09a3effbe112-console-config\") on node \"ip-10-0-129-126.ec2.internal\" DevicePath \"\""
Jul 06 12:52:16.417022 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:52:16.416970    2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ac136b9-c8e2-4495-a474-09a3effbe112-trusted-ca-bundle\") on node \"ip-10-0-129-126.ec2.internal\" DevicePath \"\""
Jul 06 12:52:16.417022 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:52:16.416975    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ac136b9-c8e2-4495-a474-09a3effbe112-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8ac136b9-c8e2-4495-a474-09a3effbe112" (UID: "8ac136b9-c8e2-4495-a474-09a3effbe112"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 12:52:16.417022 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:52:16.416984    2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8ac136b9-c8e2-4495-a474-09a3effbe112-service-ca\") on node \"ip-10-0-129-126.ec2.internal\" DevicePath \"\""
Jul 06 12:52:16.418639 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:52:16.418616    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ac136b9-c8e2-4495-a474-09a3effbe112-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8ac136b9-c8e2-4495-a474-09a3effbe112" (UID: "8ac136b9-c8e2-4495-a474-09a3effbe112"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 12:52:16.418639 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:52:16.418626    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ac136b9-c8e2-4495-a474-09a3effbe112-kube-api-access-7wcqn" (OuterVolumeSpecName: "kube-api-access-7wcqn") pod "8ac136b9-c8e2-4495-a474-09a3effbe112" (UID: "8ac136b9-c8e2-4495-a474-09a3effbe112"). InnerVolumeSpecName "kube-api-access-7wcqn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 12:52:16.418767 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:52:16.418707    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ac136b9-c8e2-4495-a474-09a3effbe112-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8ac136b9-c8e2-4495-a474-09a3effbe112" (UID: "8ac136b9-c8e2-4495-a474-09a3effbe112"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 12:52:16.517509 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:52:16.517484    2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8ac136b9-c8e2-4495-a474-09a3effbe112-oauth-serving-cert\") on node \"ip-10-0-129-126.ec2.internal\" DevicePath \"\""
Jul 06 12:52:16.517509 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:52:16.517506    2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8ac136b9-c8e2-4495-a474-09a3effbe112-console-oauth-config\") on node \"ip-10-0-129-126.ec2.internal\" DevicePath \"\""
Jul 06 12:52:16.517646 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:52:16.517519    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7wcqn\" (UniqueName: \"kubernetes.io/projected/8ac136b9-c8e2-4495-a474-09a3effbe112-kube-api-access-7wcqn\") on node \"ip-10-0-129-126.ec2.internal\" DevicePath \"\""
Jul 06 12:52:16.517646 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:52:16.517531    2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8ac136b9-c8e2-4495-a474-09a3effbe112-console-serving-cert\") on node \"ip-10-0-129-126.ec2.internal\" DevicePath \"\""
Jul 06 12:52:17.071391 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:52:17.071362    2579 generic.go:356] "Generic (PLEG): container finished" podID="8ac136b9-c8e2-4495-a474-09a3effbe112" containerID="1a7fa5e1cd8cd22ebadb431300aea5bc6f64d1f6f8e0a2dc83726c1b14037445" exitCode=0
Jul 06 12:52:17.071767 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:52:17.071398    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-95b495c67-ftvsb" event={"ID":"8ac136b9-c8e2-4495-a474-09a3effbe112","Type":"ContainerDied","Data":"1a7fa5e1cd8cd22ebadb431300aea5bc6f64d1f6f8e0a2dc83726c1b14037445"}
Jul 06 12:52:17.071767 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:52:17.071405    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-95b495c67-ftvsb"
Jul 06 12:52:17.071767 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:52:17.071433    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-95b495c67-ftvsb" event={"ID":"8ac136b9-c8e2-4495-a474-09a3effbe112","Type":"ContainerDied","Data":"226a9920b6166e05aaf3b75d80fc994972e4b3b7db1798df584e8b70714864af"}
Jul 06 12:52:17.071767 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:52:17.071451    2579 scope.go:117] "RemoveContainer" containerID="1a7fa5e1cd8cd22ebadb431300aea5bc6f64d1f6f8e0a2dc83726c1b14037445"
Jul 06 12:52:17.079832 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:52:17.079817    2579 scope.go:117] "RemoveContainer" containerID="1a7fa5e1cd8cd22ebadb431300aea5bc6f64d1f6f8e0a2dc83726c1b14037445"
Jul 06 12:52:17.080080 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:52:17.080060    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a7fa5e1cd8cd22ebadb431300aea5bc6f64d1f6f8e0a2dc83726c1b14037445\": container with ID starting with 1a7fa5e1cd8cd22ebadb431300aea5bc6f64d1f6f8e0a2dc83726c1b14037445 not found: ID does not exist" containerID="1a7fa5e1cd8cd22ebadb431300aea5bc6f64d1f6f8e0a2dc83726c1b14037445"
Jul 06 12:52:17.080123 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:52:17.080087    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a7fa5e1cd8cd22ebadb431300aea5bc6f64d1f6f8e0a2dc83726c1b14037445"} err="failed to get container status \"1a7fa5e1cd8cd22ebadb431300aea5bc6f64d1f6f8e0a2dc83726c1b14037445\": rpc error: code = NotFound desc = could not find container \"1a7fa5e1cd8cd22ebadb431300aea5bc6f64d1f6f8e0a2dc83726c1b14037445\": container with ID starting with 1a7fa5e1cd8cd22ebadb431300aea5bc6f64d1f6f8e0a2dc83726c1b14037445 not found: ID does not exist"
Jul 06 12:52:17.093981 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:52:17.093961    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-95b495c67-ftvsb"]
Jul 06 12:52:17.099645 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:52:17.099627    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-95b495c67-ftvsb"]
Jul 06 12:52:17.653587 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:52:17.653554    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ac136b9-c8e2-4495-a474-09a3effbe112" path="/var/lib/kubelet/pods/8ac136b9-c8e2-4495-a474-09a3effbe112/volumes"
Jul 06 12:53:03.228721 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:53:03.228650    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:53:04.689931 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:53:04.689897    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:54:04.033768 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:54:04.033733    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:54:41.462502 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:54:41.462424    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:54:42.337033 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:54:42.337003    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:54:43.439420 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:54:43.439393    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qkwp6"]
Jul 06 12:54:43.439797 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:54:43.439645    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ac136b9-c8e2-4495-a474-09a3effbe112" containerName="console"
Jul 06 12:54:43.439797 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:54:43.439655    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ac136b9-c8e2-4495-a474-09a3effbe112" containerName="console"
Jul 06 12:54:43.439797 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:54:43.439707    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ac136b9-c8e2-4495-a474-09a3effbe112" containerName="console"
Jul 06 12:54:43.442451 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:54:43.442435    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qkwp6"
Jul 06 12:54:43.445464 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:54:43.445439    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 06 12:54:43.445949 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:54:43.445934    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-gsmll\""
Jul 06 12:54:43.446140 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:54:43.446123    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 06 12:54:43.456089 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:54:43.456063    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qkwp6"]
Jul 06 12:54:43.547682 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:54:43.547663    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/120e593f-4ac9-4092-b28f-9ca42d6498b6-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-qkwp6\" (UID: \"120e593f-4ac9-4092-b28f-9ca42d6498b6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qkwp6"
Jul 06 12:54:43.547778 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:54:43.547694    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmqxd\" (UniqueName: \"kubernetes.io/projected/120e593f-4ac9-4092-b28f-9ca42d6498b6-kube-api-access-xmqxd\") pod \"cert-manager-operator-controller-manager-55c444bf86-qkwp6\" (UID: \"120e593f-4ac9-4092-b28f-9ca42d6498b6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qkwp6"
Jul 06 12:54:43.649007 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:54:43.648971    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/120e593f-4ac9-4092-b28f-9ca42d6498b6-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-qkwp6\" (UID: \"120e593f-4ac9-4092-b28f-9ca42d6498b6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qkwp6"
Jul 06 12:54:43.649136 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:54:43.649024    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmqxd\" (UniqueName: \"kubernetes.io/projected/120e593f-4ac9-4092-b28f-9ca42d6498b6-kube-api-access-xmqxd\") pod \"cert-manager-operator-controller-manager-55c444bf86-qkwp6\" (UID: \"120e593f-4ac9-4092-b28f-9ca42d6498b6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qkwp6"
Jul 06 12:54:43.649356 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:54:43.649339    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/120e593f-4ac9-4092-b28f-9ca42d6498b6-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-qkwp6\" (UID: \"120e593f-4ac9-4092-b28f-9ca42d6498b6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qkwp6"
Jul 06 12:54:43.657391 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:54:43.657371    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmqxd\" (UniqueName: \"kubernetes.io/projected/120e593f-4ac9-4092-b28f-9ca42d6498b6-kube-api-access-xmqxd\") pod \"cert-manager-operator-controller-manager-55c444bf86-qkwp6\" (UID: \"120e593f-4ac9-4092-b28f-9ca42d6498b6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qkwp6"
Jul 06 12:54:43.751308 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:54:43.751283    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qkwp6"
Jul 06 12:54:43.885497 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:54:43.885396    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qkwp6"]
Jul 06 12:54:43.888376 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:54:43.888353    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod120e593f_4ac9_4092_b28f_9ca42d6498b6.slice/crio-8b0940659fd490be8e37546280ec3def61880c0da6212aaa7dcdc94dc40bfd64 WatchSource:0}: Error finding container 8b0940659fd490be8e37546280ec3def61880c0da6212aaa7dcdc94dc40bfd64: Status 404 returned error can't find the container with id 8b0940659fd490be8e37546280ec3def61880c0da6212aaa7dcdc94dc40bfd64
Jul 06 12:54:43.891173 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:54:43.891156    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 12:54:44.573690 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:54:44.573657    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qkwp6" event={"ID":"120e593f-4ac9-4092-b28f-9ca42d6498b6","Type":"ContainerStarted","Data":"8b0940659fd490be8e37546280ec3def61880c0da6212aaa7dcdc94dc40bfd64"}
Jul 06 12:54:45.088393 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:54:45.088360    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:54:45.189577 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:54:45.189548    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:54:49.893155 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:54:49.893119    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:54:49.993483 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:54:49.993456    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:54:52.605544 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:54:52.605466    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qkwp6" event={"ID":"120e593f-4ac9-4092-b28f-9ca42d6498b6","Type":"ContainerStarted","Data":"cf8cd32f722a2b432838d842950970ce089f180c1f86823d21de1564b62d943c"}
Jul 06 12:54:52.631614 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:54:52.631560    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qkwp6" podStartSLOduration=1.256213769 podStartE2EDuration="9.631541321s" totalImagesPullingTime="8.375327552s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:54:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:54:52.63070731 +0000 UTC m=+469.499594969" watchObservedRunningTime="2026-07-06 12:54:52.631541321 +0000 UTC m=+469.500428982"
Jul 06 12:54:53.122681 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:54:53.122655    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:54:53.443662 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:54:53.443588    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:54:55.254902 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:54:55.254863    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:54:55.866259 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:54:55.866233    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:54:58.922966 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:54:58.922929    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:54:58.992185 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:54:58.992157    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:55:03.097207 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:03.097181    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:55:03.816298 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:03.816271    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:55:03.913413 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:03.913380    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:55:05.189182 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:05.189150    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-b6tsr"]
Jul 06 12:55:05.192267 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:05.192252    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-b6tsr"
Jul 06 12:55:05.195583 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:05.195560    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 06 12:55:05.195710 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:05.195587    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-mgph6\""
Jul 06 12:55:05.196389 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:05.196372    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 06 12:55:05.204493 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:05.204471    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-b6tsr"]
Jul 06 12:55:05.296109 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:05.296081    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkt2h\" (UniqueName: \"kubernetes.io/projected/9954de1a-be36-47a9-b20f-8578f669e67f-kube-api-access-hkt2h\") pod \"openshift-lws-operator-fd8ccff4c-b6tsr\" (UID: \"9954de1a-be36-47a9-b20f-8578f669e67f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-b6tsr"
Jul 06 12:55:05.296234 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:05.296129    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9954de1a-be36-47a9-b20f-8578f669e67f-tmp\") pod \"openshift-lws-operator-fd8ccff4c-b6tsr\" (UID: \"9954de1a-be36-47a9-b20f-8578f669e67f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-b6tsr"
Jul 06 12:55:05.397178 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:05.397153    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkt2h\" (UniqueName: \"kubernetes.io/projected/9954de1a-be36-47a9-b20f-8578f669e67f-kube-api-access-hkt2h\") pod \"openshift-lws-operator-fd8ccff4c-b6tsr\" (UID: \"9954de1a-be36-47a9-b20f-8578f669e67f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-b6tsr"
Jul 06 12:55:05.397285 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:05.397197    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9954de1a-be36-47a9-b20f-8578f669e67f-tmp\") pod \"openshift-lws-operator-fd8ccff4c-b6tsr\" (UID: \"9954de1a-be36-47a9-b20f-8578f669e67f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-b6tsr"
Jul 06 12:55:05.397514 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:05.397499    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9954de1a-be36-47a9-b20f-8578f669e67f-tmp\") pod \"openshift-lws-operator-fd8ccff4c-b6tsr\" (UID: \"9954de1a-be36-47a9-b20f-8578f669e67f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-b6tsr"
Jul 06 12:55:05.405702 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:05.405676    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkt2h\" (UniqueName: \"kubernetes.io/projected/9954de1a-be36-47a9-b20f-8578f669e67f-kube-api-access-hkt2h\") pod \"openshift-lws-operator-fd8ccff4c-b6tsr\" (UID: \"9954de1a-be36-47a9-b20f-8578f669e67f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-b6tsr"
Jul 06 12:55:05.501312 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:05.501294    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-b6tsr"
Jul 06 12:55:05.627928 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:05.627791    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-b6tsr"]
Jul 06 12:55:05.630354 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:55:05.630327    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9954de1a_be36_47a9_b20f_8578f669e67f.slice/crio-f545882e2ea65d9b267fa7897c0e8b3765e0fc895863a079da49c70a7005fc58 WatchSource:0}: Error finding container f545882e2ea65d9b267fa7897c0e8b3765e0fc895863a079da49c70a7005fc58: Status 404 returned error can't find the container with id f545882e2ea65d9b267fa7897c0e8b3765e0fc895863a079da49c70a7005fc58
Jul 06 12:55:05.653123 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:05.653097    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-b6tsr" event={"ID":"9954de1a-be36-47a9-b20f-8578f669e67f","Type":"ContainerStarted","Data":"f545882e2ea65d9b267fa7897c0e8b3765e0fc895863a079da49c70a7005fc58"}
Jul 06 12:55:07.324084 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:07.324050    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:55:07.450955 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:07.450928    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:55:08.665910 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:08.665876    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-b6tsr" event={"ID":"9954de1a-be36-47a9-b20f-8578f669e67f","Type":"ContainerStarted","Data":"6b584893198e39eb74aaa6a37fa563100ba0c5ca29d24c409c554a17938c1920"}
Jul 06 12:55:08.689713 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:08.689664    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-b6tsr" podStartSLOduration=1.169389834 podStartE2EDuration="3.689650658s" totalImagesPullingTime="2.520260824s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:55:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:55:08.689451029 +0000 UTC m=+485.558338688" watchObservedRunningTime="2026-07-06 12:55:08.689650658 +0000 UTC m=+485.558538318"
Jul 06 12:55:09.527417 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:09.527385    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:55:09.652696 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:09.652669    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:55:09.759148 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:09.759124    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:55:11.642068 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:11.642037    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:55:23.035243 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:23.035208    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:55:23.133478 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:23.133449    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:55:23.686562 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:23.686533    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:55:24.278091 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:24.278067    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:55:24.407701 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:24.407672    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:55:24.469852 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:24.469814    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-58899bc45d-r6sjq"]
Jul 06 12:55:24.473214 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:24.473199    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-58899bc45d-r6sjq"
Jul 06 12:55:24.486759 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:24.486734    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 06 12:55:24.486917 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:24.486899    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 06 12:55:24.486976 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:24.486954    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 06 12:55:24.487018 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:24.486899    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-t7n7s\""
Jul 06 12:55:24.487018 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:24.487005    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 06 12:55:24.495567 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:24.495547    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-58899bc45d-r6sjq"]
Jul 06 12:55:24.534591 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:24.534531    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fa145923-ad7b-482e-a25f-0e53adc41e73-manifests\") pod \"opendatahub-operator-controller-manager-58899bc45d-r6sjq\" (UID: \"fa145923-ad7b-482e-a25f-0e53adc41e73\") " pod="opendatahub/opendatahub-operator-controller-manager-58899bc45d-r6sjq"
Jul 06 12:55:24.534677 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:24.534602    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-469wq\" (UniqueName: \"kubernetes.io/projected/fa145923-ad7b-482e-a25f-0e53adc41e73-kube-api-access-469wq\") pod \"opendatahub-operator-controller-manager-58899bc45d-r6sjq\" (UID: \"fa145923-ad7b-482e-a25f-0e53adc41e73\") " pod="opendatahub/opendatahub-operator-controller-manager-58899bc45d-r6sjq"
Jul 06 12:55:24.534677 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:24.534649    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fa145923-ad7b-482e-a25f-0e53adc41e73-apiservice-cert\") pod \"opendatahub-operator-controller-manager-58899bc45d-r6sjq\" (UID: \"fa145923-ad7b-482e-a25f-0e53adc41e73\") " pod="opendatahub/opendatahub-operator-controller-manager-58899bc45d-r6sjq"
Jul 06 12:55:24.534769 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:24.534680    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fa145923-ad7b-482e-a25f-0e53adc41e73-webhook-cert\") pod \"opendatahub-operator-controller-manager-58899bc45d-r6sjq\" (UID: \"fa145923-ad7b-482e-a25f-0e53adc41e73\") " pod="opendatahub/opendatahub-operator-controller-manager-58899bc45d-r6sjq"
Jul 06 12:55:24.534769 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:24.534704    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa145923-ad7b-482e-a25f-0e53adc41e73-tmp\") pod \"opendatahub-operator-controller-manager-58899bc45d-r6sjq\" (UID: \"fa145923-ad7b-482e-a25f-0e53adc41e73\") " pod="opendatahub/opendatahub-operator-controller-manager-58899bc45d-r6sjq"
Jul 06 12:55:24.635810 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:24.635781    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fa145923-ad7b-482e-a25f-0e53adc41e73-apiservice-cert\") pod \"opendatahub-operator-controller-manager-58899bc45d-r6sjq\" (UID: \"fa145923-ad7b-482e-a25f-0e53adc41e73\") " pod="opendatahub/opendatahub-operator-controller-manager-58899bc45d-r6sjq"
Jul 06 12:55:24.635938 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:24.635814    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fa145923-ad7b-482e-a25f-0e53adc41e73-webhook-cert\") pod \"opendatahub-operator-controller-manager-58899bc45d-r6sjq\" (UID: \"fa145923-ad7b-482e-a25f-0e53adc41e73\") " pod="opendatahub/opendatahub-operator-controller-manager-58899bc45d-r6sjq"
Jul 06 12:55:24.635938 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:24.635831    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa145923-ad7b-482e-a25f-0e53adc41e73-tmp\") pod \"opendatahub-operator-controller-manager-58899bc45d-r6sjq\" (UID: \"fa145923-ad7b-482e-a25f-0e53adc41e73\") " pod="opendatahub/opendatahub-operator-controller-manager-58899bc45d-r6sjq"
Jul 06 12:55:24.636010 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:24.635957    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fa145923-ad7b-482e-a25f-0e53adc41e73-manifests\") pod \"opendatahub-operator-controller-manager-58899bc45d-r6sjq\" (UID: \"fa145923-ad7b-482e-a25f-0e53adc41e73\") " pod="opendatahub/opendatahub-operator-controller-manager-58899bc45d-r6sjq"
Jul 06 12:55:24.636061 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:24.636025    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-469wq\" (UniqueName: \"kubernetes.io/projected/fa145923-ad7b-482e-a25f-0e53adc41e73-kube-api-access-469wq\") pod \"opendatahub-operator-controller-manager-58899bc45d-r6sjq\" (UID: \"fa145923-ad7b-482e-a25f-0e53adc41e73\") " pod="opendatahub/opendatahub-operator-controller-manager-58899bc45d-r6sjq"
Jul 06 12:55:24.636388 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:24.636362    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fa145923-ad7b-482e-a25f-0e53adc41e73-manifests\") pod \"opendatahub-operator-controller-manager-58899bc45d-r6sjq\" (UID: \"fa145923-ad7b-482e-a25f-0e53adc41e73\") " pod="opendatahub/opendatahub-operator-controller-manager-58899bc45d-r6sjq"
Jul 06 12:55:24.638029 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:24.638009    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa145923-ad7b-482e-a25f-0e53adc41e73-tmp\") pod \"opendatahub-operator-controller-manager-58899bc45d-r6sjq\" (UID: \"fa145923-ad7b-482e-a25f-0e53adc41e73\") " pod="opendatahub/opendatahub-operator-controller-manager-58899bc45d-r6sjq"
Jul 06 12:55:24.638181 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:24.638164    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fa145923-ad7b-482e-a25f-0e53adc41e73-webhook-cert\") pod \"opendatahub-operator-controller-manager-58899bc45d-r6sjq\" (UID: \"fa145923-ad7b-482e-a25f-0e53adc41e73\") " pod="opendatahub/opendatahub-operator-controller-manager-58899bc45d-r6sjq"
Jul 06 12:55:24.638495 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:24.638479    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fa145923-ad7b-482e-a25f-0e53adc41e73-apiservice-cert\") pod \"opendatahub-operator-controller-manager-58899bc45d-r6sjq\" (UID: \"fa145923-ad7b-482e-a25f-0e53adc41e73\") " pod="opendatahub/opendatahub-operator-controller-manager-58899bc45d-r6sjq"
Jul 06 12:55:24.648063 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:24.648035    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-469wq\" (UniqueName: \"kubernetes.io/projected/fa145923-ad7b-482e-a25f-0e53adc41e73-kube-api-access-469wq\") pod \"opendatahub-operator-controller-manager-58899bc45d-r6sjq\" (UID: \"fa145923-ad7b-482e-a25f-0e53adc41e73\") " pod="opendatahub/opendatahub-operator-controller-manager-58899bc45d-r6sjq"
Jul 06 12:55:24.675031 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:24.675007    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:55:24.782966 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:24.782938    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-58899bc45d-r6sjq"
Jul 06 12:55:24.807119 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:24.807098    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:55:24.938212 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:24.938103    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-58899bc45d-r6sjq"]
Jul 06 12:55:24.940506 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:24.940482    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:55:24.940614 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:55:24.940532    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa145923_ad7b_482e_a25f_0e53adc41e73.slice/crio-c86670ce71ce85ba40a692832e8d14dcbe4818769cf45e3c92564d4049b0e03a WatchSource:0}: Error finding container c86670ce71ce85ba40a692832e8d14dcbe4818769cf45e3c92564d4049b0e03a: Status 404 returned error can't find the container with id c86670ce71ce85ba40a692832e8d14dcbe4818769cf45e3c92564d4049b0e03a
Jul 06 12:55:25.036948 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:25.036893    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:55:25.145255 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:25.145227    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:55:25.249642 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:25.249616    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:55:25.731126 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:25.731052    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58899bc45d-r6sjq" event={"ID":"fa145923-ad7b-482e-a25f-0e53adc41e73","Type":"ContainerStarted","Data":"c86670ce71ce85ba40a692832e8d14dcbe4818769cf45e3c92564d4049b0e03a"}
Jul 06 12:55:28.745252 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:28.745222    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58899bc45d-r6sjq" event={"ID":"fa145923-ad7b-482e-a25f-0e53adc41e73","Type":"ContainerStarted","Data":"a4e025bd10779cc1ecb09081b6fb7ff53708eef4bde8c6d2eb2f08bf82b7f2be"}
Jul 06 12:55:29.749798 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:29.749757    2579 generic.go:356] "Generic (PLEG): container finished" podID="fa145923-ad7b-482e-a25f-0e53adc41e73" containerID="a4e025bd10779cc1ecb09081b6fb7ff53708eef4bde8c6d2eb2f08bf82b7f2be" exitCode=0
Jul 06 12:55:29.750186 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:29.749801    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58899bc45d-r6sjq" event={"ID":"fa145923-ad7b-482e-a25f-0e53adc41e73","Type":"ContainerDied","Data":"a4e025bd10779cc1ecb09081b6fb7ff53708eef4bde8c6d2eb2f08bf82b7f2be"}
Jul 06 12:55:30.755952 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:30.755921    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58899bc45d-r6sjq" event={"ID":"fa145923-ad7b-482e-a25f-0e53adc41e73","Type":"ContainerStarted","Data":"1b35f3ba96783f701595ac818c1fff8831052b35279423a7a1cbcd62331cdd16"}
Jul 06 12:55:30.756316 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:30.756065    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-58899bc45d-r6sjq"
Jul 06 12:55:30.847900 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:30.847855    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-58899bc45d-r6sjq" podStartSLOduration=2.469120699 podStartE2EDuration="6.847824411s" totalImagesPullingTime="3.295087408s" totalInitContainerRuntime="1.083616304s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:55:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:55:30.846896494 +0000 UTC m=+507.715784153" watchObservedRunningTime="2026-07-06 12:55:30.847824411 +0000 UTC m=+507.716712069"
Jul 06 12:55:35.008716 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:35.008683    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-cbf9b65d4-ksg42"]
Jul 06 12:55:35.017228 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:35.017201    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cbf9b65d4-ksg42"
Jul 06 12:55:35.026885 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:35.026861    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cbf9b65d4-ksg42"]
Jul 06 12:55:35.070167 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:35.070142    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:55:35.111525 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:35.111502    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c9d59a1d-6a1f-4081-a7e7-0e2542faa3d5-console-oauth-config\") pod \"console-cbf9b65d4-ksg42\" (UID: \"c9d59a1d-6a1f-4081-a7e7-0e2542faa3d5\") " pod="openshift-console/console-cbf9b65d4-ksg42"
Jul 06 12:55:35.111630 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:35.111532    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9d59a1d-6a1f-4081-a7e7-0e2542faa3d5-trusted-ca-bundle\") pod \"console-cbf9b65d4-ksg42\" (UID: \"c9d59a1d-6a1f-4081-a7e7-0e2542faa3d5\") " pod="openshift-console/console-cbf9b65d4-ksg42"
Jul 06 12:55:35.111630 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:35.111557    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c9d59a1d-6a1f-4081-a7e7-0e2542faa3d5-console-serving-cert\") pod \"console-cbf9b65d4-ksg42\" (UID: \"c9d59a1d-6a1f-4081-a7e7-0e2542faa3d5\") " pod="openshift-console/console-cbf9b65d4-ksg42"
Jul 06 12:55:35.111630 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:35.111584    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c9d59a1d-6a1f-4081-a7e7-0e2542faa3d5-console-config\") pod \"console-cbf9b65d4-ksg42\" (UID: \"c9d59a1d-6a1f-4081-a7e7-0e2542faa3d5\") " pod="openshift-console/console-cbf9b65d4-ksg42"
Jul 06 12:55:35.111630 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:35.111613    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c9d59a1d-6a1f-4081-a7e7-0e2542faa3d5-service-ca\") pod \"console-cbf9b65d4-ksg42\" (UID: \"c9d59a1d-6a1f-4081-a7e7-0e2542faa3d5\") " pod="openshift-console/console-cbf9b65d4-ksg42"
Jul 06 12:55:35.111795 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:35.111635    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbfkk\" (UniqueName: \"kubernetes.io/projected/c9d59a1d-6a1f-4081-a7e7-0e2542faa3d5-kube-api-access-kbfkk\") pod \"console-cbf9b65d4-ksg42\" (UID: \"c9d59a1d-6a1f-4081-a7e7-0e2542faa3d5\") " pod="openshift-console/console-cbf9b65d4-ksg42"
Jul 06 12:55:35.111795 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:35.111655    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c9d59a1d-6a1f-4081-a7e7-0e2542faa3d5-oauth-serving-cert\") pod \"console-cbf9b65d4-ksg42\" (UID: \"c9d59a1d-6a1f-4081-a7e7-0e2542faa3d5\") " pod="openshift-console/console-cbf9b65d4-ksg42"
Jul 06 12:55:35.170776 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:35.170745    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:55:35.212981 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:35.212954    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c9d59a1d-6a1f-4081-a7e7-0e2542faa3d5-console-oauth-config\") pod \"console-cbf9b65d4-ksg42\" (UID: \"c9d59a1d-6a1f-4081-a7e7-0e2542faa3d5\") " pod="openshift-console/console-cbf9b65d4-ksg42"
Jul 06 12:55:35.213100 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:35.212993    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9d59a1d-6a1f-4081-a7e7-0e2542faa3d5-trusted-ca-bundle\") pod \"console-cbf9b65d4-ksg42\" (UID: \"c9d59a1d-6a1f-4081-a7e7-0e2542faa3d5\") " pod="openshift-console/console-cbf9b65d4-ksg42"
Jul 06 12:55:35.213100 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:35.213034    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c9d59a1d-6a1f-4081-a7e7-0e2542faa3d5-console-serving-cert\") pod \"console-cbf9b65d4-ksg42\" (UID: \"c9d59a1d-6a1f-4081-a7e7-0e2542faa3d5\") " pod="openshift-console/console-cbf9b65d4-ksg42"
Jul 06 12:55:35.213100 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:35.213065    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c9d59a1d-6a1f-4081-a7e7-0e2542faa3d5-console-config\") pod \"console-cbf9b65d4-ksg42\" (UID: \"c9d59a1d-6a1f-4081-a7e7-0e2542faa3d5\") " pod="openshift-console/console-cbf9b65d4-ksg42"
Jul 06 12:55:35.213100 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:35.213090    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c9d59a1d-6a1f-4081-a7e7-0e2542faa3d5-service-ca\") pod \"console-cbf9b65d4-ksg42\" (UID: \"c9d59a1d-6a1f-4081-a7e7-0e2542faa3d5\") " pod="openshift-console/console-cbf9b65d4-ksg42"
Jul 06 12:55:35.213296 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:35.213220    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbfkk\" (UniqueName: \"kubernetes.io/projected/c9d59a1d-6a1f-4081-a7e7-0e2542faa3d5-kube-api-access-kbfkk\") pod \"console-cbf9b65d4-ksg42\" (UID: \"c9d59a1d-6a1f-4081-a7e7-0e2542faa3d5\") " pod="openshift-console/console-cbf9b65d4-ksg42"
Jul 06 12:55:35.213296 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:35.213260    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c9d59a1d-6a1f-4081-a7e7-0e2542faa3d5-oauth-serving-cert\") pod \"console-cbf9b65d4-ksg42\" (UID: \"c9d59a1d-6a1f-4081-a7e7-0e2542faa3d5\") " pod="openshift-console/console-cbf9b65d4-ksg42"
Jul 06 12:55:35.214127 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:35.214098    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c9d59a1d-6a1f-4081-a7e7-0e2542faa3d5-console-config\") pod \"console-cbf9b65d4-ksg42\" (UID: \"c9d59a1d-6a1f-4081-a7e7-0e2542faa3d5\") " pod="openshift-console/console-cbf9b65d4-ksg42"
Jul 06 12:55:35.214222 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:35.214114    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c9d59a1d-6a1f-4081-a7e7-0e2542faa3d5-service-ca\") pod \"console-cbf9b65d4-ksg42\" (UID: \"c9d59a1d-6a1f-4081-a7e7-0e2542faa3d5\") " pod="openshift-console/console-cbf9b65d4-ksg42"
Jul 06 12:55:35.214222 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:35.214176    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c9d59a1d-6a1f-4081-a7e7-0e2542faa3d5-oauth-serving-cert\") pod \"console-cbf9b65d4-ksg42\" (UID: \"c9d59a1d-6a1f-4081-a7e7-0e2542faa3d5\") " pod="openshift-console/console-cbf9b65d4-ksg42"
Jul 06 12:55:35.214314 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:35.214295    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9d59a1d-6a1f-4081-a7e7-0e2542faa3d5-trusted-ca-bundle\") pod \"console-cbf9b65d4-ksg42\" (UID: \"c9d59a1d-6a1f-4081-a7e7-0e2542faa3d5\") " pod="openshift-console/console-cbf9b65d4-ksg42"
Jul 06 12:55:35.215481 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:35.215457    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c9d59a1d-6a1f-4081-a7e7-0e2542faa3d5-console-serving-cert\") pod \"console-cbf9b65d4-ksg42\" (UID: \"c9d59a1d-6a1f-4081-a7e7-0e2542faa3d5\") " pod="openshift-console/console-cbf9b65d4-ksg42"
Jul 06 12:55:35.215644 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:35.215623    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c9d59a1d-6a1f-4081-a7e7-0e2542faa3d5-console-oauth-config\") pod \"console-cbf9b65d4-ksg42\" (UID: \"c9d59a1d-6a1f-4081-a7e7-0e2542faa3d5\") " pod="openshift-console/console-cbf9b65d4-ksg42"
Jul 06 12:55:35.222429 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:35.222403    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbfkk\" (UniqueName: \"kubernetes.io/projected/c9d59a1d-6a1f-4081-a7e7-0e2542faa3d5-kube-api-access-kbfkk\") pod \"console-cbf9b65d4-ksg42\" (UID: \"c9d59a1d-6a1f-4081-a7e7-0e2542faa3d5\") " pod="openshift-console/console-cbf9b65d4-ksg42"
Jul 06 12:55:35.326493 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:35.326433    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cbf9b65d4-ksg42"
Jul 06 12:55:35.452678 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:35.452570    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cbf9b65d4-ksg42"]
Jul 06 12:55:35.455306 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:55:35.455271    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9d59a1d_6a1f_4081_a7e7_0e2542faa3d5.slice/crio-1105f83235a5ca1be581636961b892d7ea9ba971b025cf7ba27f8bd2cad91f8c WatchSource:0}: Error finding container 1105f83235a5ca1be581636961b892d7ea9ba971b025cf7ba27f8bd2cad91f8c: Status 404 returned error can't find the container with id 1105f83235a5ca1be581636961b892d7ea9ba971b025cf7ba27f8bd2cad91f8c
Jul 06 12:55:35.776333 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:35.776299    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cbf9b65d4-ksg42" event={"ID":"c9d59a1d-6a1f-4081-a7e7-0e2542faa3d5","Type":"ContainerStarted","Data":"4b13fe44d2fac0fa6c646418bc2da77bdbeffc0789943db211c7795577eb3279"}
Jul 06 12:55:35.776507 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:35.776350    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cbf9b65d4-ksg42" event={"ID":"c9d59a1d-6a1f-4081-a7e7-0e2542faa3d5","Type":"ContainerStarted","Data":"1105f83235a5ca1be581636961b892d7ea9ba971b025cf7ba27f8bd2cad91f8c"}
Jul 06 12:55:35.816446 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:35.816402    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-cbf9b65d4-ksg42" podStartSLOduration=1.816388548 podStartE2EDuration="1.816388548s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:55:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:55:35.815066968 +0000 UTC m=+512.683954626" watchObservedRunningTime="2026-07-06 12:55:35.816388548 +0000 UTC m=+512.685276207"
Jul 06 12:55:35.925483 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:35.925447    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:55:36.035454 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:36.035352    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:55:41.762995 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:41.762962    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-58899bc45d-r6sjq"
Jul 06 12:55:43.828569 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:43.828539    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:55:44.052126 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:44.052093    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:55:45.150012 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:45.149979    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-l4qtb"]
Jul 06 12:55:45.155757 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:45.155734    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-l4qtb"
Jul 06 12:55:45.163202 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:45.163178    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 06 12:55:45.163313 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:45.163245    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-tnjmp\""
Jul 06 12:55:45.170656 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:45.170634    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-l4qtb"]
Jul 06 12:55:45.259718 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:45.259675    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:55:45.292563 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:45.292536    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-br9jm\" (UniqueName: \"kubernetes.io/projected/2e3527e5-6dfb-4574-aec3-b5354ba977ea-kube-api-access-br9jm\") pod \"odh-model-controller-7998c67dc4-l4qtb\" (UID: \"2e3527e5-6dfb-4574-aec3-b5354ba977ea\") " pod="opendatahub/odh-model-controller-7998c67dc4-l4qtb"
Jul 06 12:55:45.292735 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:45.292669    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2e3527e5-6dfb-4574-aec3-b5354ba977ea-cert\") pod \"odh-model-controller-7998c67dc4-l4qtb\" (UID: \"2e3527e5-6dfb-4574-aec3-b5354ba977ea\") " pod="opendatahub/odh-model-controller-7998c67dc4-l4qtb"
Jul 06 12:55:45.327012 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:45.326985    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-cbf9b65d4-ksg42"
Jul 06 12:55:45.327139 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:45.327031    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-cbf9b65d4-ksg42"
Jul 06 12:55:45.331686 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:45.331666    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-cbf9b65d4-ksg42"
Jul 06 12:55:45.393406 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:45.393381    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-br9jm\" (UniqueName: \"kubernetes.io/projected/2e3527e5-6dfb-4574-aec3-b5354ba977ea-kube-api-access-br9jm\") pod \"odh-model-controller-7998c67dc4-l4qtb\" (UID: \"2e3527e5-6dfb-4574-aec3-b5354ba977ea\") " pod="opendatahub/odh-model-controller-7998c67dc4-l4qtb"
Jul 06 12:55:45.393530 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:45.393428    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2e3527e5-6dfb-4574-aec3-b5354ba977ea-cert\") pod \"odh-model-controller-7998c67dc4-l4qtb\" (UID: \"2e3527e5-6dfb-4574-aec3-b5354ba977ea\") " pod="opendatahub/odh-model-controller-7998c67dc4-l4qtb"
Jul 06 12:55:45.395720 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:45.395700    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2e3527e5-6dfb-4574-aec3-b5354ba977ea-cert\") pod \"odh-model-controller-7998c67dc4-l4qtb\" (UID: \"2e3527e5-6dfb-4574-aec3-b5354ba977ea\") " pod="opendatahub/odh-model-controller-7998c67dc4-l4qtb"
Jul 06 12:55:45.417133 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:45.417069    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-br9jm\" (UniqueName: \"kubernetes.io/projected/2e3527e5-6dfb-4574-aec3-b5354ba977ea-kube-api-access-br9jm\") pod \"odh-model-controller-7998c67dc4-l4qtb\" (UID: \"2e3527e5-6dfb-4574-aec3-b5354ba977ea\") " pod="opendatahub/odh-model-controller-7998c67dc4-l4qtb"
Jul 06 12:55:45.465720 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:45.465698    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-l4qtb"
Jul 06 12:55:45.471707 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:45.471688    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:55:45.623053 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:45.623023    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-l4qtb"]
Jul 06 12:55:45.625909 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:55:45.625882    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e3527e5_6dfb_4574_aec3_b5354ba977ea.slice/crio-ac99e16cc24baf02c25a4f080e83a3ae86b56552aa2c83fdb98bdfc24a5e95ef WatchSource:0}: Error finding container ac99e16cc24baf02c25a4f080e83a3ae86b56552aa2c83fdb98bdfc24a5e95ef: Status 404 returned error can't find the container with id ac99e16cc24baf02c25a4f080e83a3ae86b56552aa2c83fdb98bdfc24a5e95ef
Jul 06 12:55:45.645752 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:45.645720    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:55:45.816995 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:45.816956    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-l4qtb" event={"ID":"2e3527e5-6dfb-4574-aec3-b5354ba977ea","Type":"ContainerStarted","Data":"ac99e16cc24baf02c25a4f080e83a3ae86b56552aa2c83fdb98bdfc24a5e95ef"}
Jul 06 12:55:45.820751 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:45.820728    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-cbf9b65d4-ksg42"
Jul 06 12:55:45.929026 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:45.928992    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cc7b77756-wj4xs"]
Jul 06 12:55:46.405299 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:46.405264    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:55:46.527783 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:46.527319    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-c7mnf"]
Jul 06 12:55:46.535823 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:46.535795    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-c7mnf"
Jul 06 12:55:46.549424 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:46.549401    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 06 12:55:46.563274 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:46.563241    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-c7mnf"]
Jul 06 12:55:46.696144 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:46.696064    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:55:46.706260 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:46.706228    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ed99c8a-1fb0-4b7b-af9b-248922de4b33-tls-certs\") pod \"model-serving-api-54d89bd5fc-c7mnf\" (UID: \"3ed99c8a-1fb0-4b7b-af9b-248922de4b33\") " pod="opendatahub/model-serving-api-54d89bd5fc-c7mnf"
Jul 06 12:55:46.706406 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:46.706300    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-px2jc\" (UniqueName: \"kubernetes.io/projected/3ed99c8a-1fb0-4b7b-af9b-248922de4b33-kube-api-access-px2jc\") pod \"model-serving-api-54d89bd5fc-c7mnf\" (UID: \"3ed99c8a-1fb0-4b7b-af9b-248922de4b33\") " pod="opendatahub/model-serving-api-54d89bd5fc-c7mnf"
Jul 06 12:55:46.807473 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:46.807438    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ed99c8a-1fb0-4b7b-af9b-248922de4b33-tls-certs\") pod \"model-serving-api-54d89bd5fc-c7mnf\" (UID: \"3ed99c8a-1fb0-4b7b-af9b-248922de4b33\") " pod="opendatahub/model-serving-api-54d89bd5fc-c7mnf"
Jul 06 12:55:46.807666 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:46.807500    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-px2jc\" (UniqueName: \"kubernetes.io/projected/3ed99c8a-1fb0-4b7b-af9b-248922de4b33-kube-api-access-px2jc\") pod \"model-serving-api-54d89bd5fc-c7mnf\" (UID: \"3ed99c8a-1fb0-4b7b-af9b-248922de4b33\") " pod="opendatahub/model-serving-api-54d89bd5fc-c7mnf"
Jul 06 12:55:46.810798 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:46.810761    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ed99c8a-1fb0-4b7b-af9b-248922de4b33-tls-certs\") pod \"model-serving-api-54d89bd5fc-c7mnf\" (UID: \"3ed99c8a-1fb0-4b7b-af9b-248922de4b33\") " pod="opendatahub/model-serving-api-54d89bd5fc-c7mnf"
Jul 06 12:55:46.813969 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:46.813944    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:55:46.821906 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:46.821882    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-px2jc\" (UniqueName: \"kubernetes.io/projected/3ed99c8a-1fb0-4b7b-af9b-248922de4b33-kube-api-access-px2jc\") pod \"model-serving-api-54d89bd5fc-c7mnf\" (UID: \"3ed99c8a-1fb0-4b7b-af9b-248922de4b33\") " pod="opendatahub/model-serving-api-54d89bd5fc-c7mnf"
Jul 06 12:55:46.850161 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:46.850130    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-c7mnf"
Jul 06 12:55:47.036293 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:47.036163    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-c7mnf"]
Jul 06 12:55:47.038503 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:55:47.038475    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ed99c8a_1fb0_4b7b_af9b_248922de4b33.slice/crio-5e161322d73c4ed4e6ff5f023b489af1cce12b018b2fbff8aea231fe5af9a4dc WatchSource:0}: Error finding container 5e161322d73c4ed4e6ff5f023b489af1cce12b018b2fbff8aea231fe5af9a4dc: Status 404 returned error can't find the container with id 5e161322d73c4ed4e6ff5f023b489af1cce12b018b2fbff8aea231fe5af9a4dc
Jul 06 12:55:47.828016 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:47.827975    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-c7mnf" event={"ID":"3ed99c8a-1fb0-4b7b-af9b-248922de4b33","Type":"ContainerStarted","Data":"5e161322d73c4ed4e6ff5f023b489af1cce12b018b2fbff8aea231fe5af9a4dc"}
Jul 06 12:55:48.835089 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:48.835049    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-l4qtb" event={"ID":"2e3527e5-6dfb-4574-aec3-b5354ba977ea","Type":"ContainerStarted","Data":"79e92f914bb2d94d87d595053151014d5e7368cf5e00958537c9dfeed164412f"}
Jul 06 12:55:48.835526 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:48.835193    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-l4qtb"
Jul 06 12:55:48.861737 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:48.861634    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-l4qtb" podStartSLOduration=1.15100473 podStartE2EDuration="3.861609539s" totalImagesPullingTime="2.710604809s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:55:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:55:48.86090059 +0000 UTC m=+525.729788250" watchObservedRunningTime="2026-07-06 12:55:48.861609539 +0000 UTC m=+525.730497201"
Jul 06 12:55:49.841697 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:49.841610    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-c7mnf" event={"ID":"3ed99c8a-1fb0-4b7b-af9b-248922de4b33","Type":"ContainerStarted","Data":"eb0beb229401edbc63f67696c99b389a4adc22b64ce6711023686dbb6f9b132a"}
Jul 06 12:55:49.842118 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:49.841765    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-c7mnf"
Jul 06 12:55:51.595397 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:51.595359    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:55:51.791977 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:51.791936    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:55:51.936312 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:51.936225    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:55:52.151617 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:52.151586    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:55:55.355477 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:55.355445    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:55:55.519012 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:55.518958    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-c7mnf" podStartSLOduration=6.992758266 podStartE2EDuration="9.518939703s" totalImagesPullingTime="2.526181437s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:55:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:55:49.866921199 +0000 UTC m=+526.735808859" watchObservedRunningTime="2026-07-06 12:55:55.518939703 +0000 UTC m=+532.387827361"
Jul 06 12:55:55.519797 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:55.519779    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7965d5bf57-r4f7h"]
Jul 06 12:55:55.523189 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:55.523173    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7965d5bf57-r4f7h"
Jul 06 12:55:55.530879 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:55.530857    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 06 12:55:55.539678 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:55.539659    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-jnnjr\""
Jul 06 12:55:55.540215 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:55.540201    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 06 12:55:55.550316 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:55.550286    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7965d5bf57-r4f7h"]
Jul 06 12:55:55.586369 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:55.586320    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5l9r\" (UniqueName: \"kubernetes.io/projected/1aa09740-bc40-481c-893c-a1f3ffcfb032-kube-api-access-v5l9r\") pod \"kube-auth-proxy-7965d5bf57-r4f7h\" (UID: \"1aa09740-bc40-481c-893c-a1f3ffcfb032\") " pod="openshift-ingress/kube-auth-proxy-7965d5bf57-r4f7h"
Jul 06 12:55:55.586369 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:55.586366    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1aa09740-bc40-481c-893c-a1f3ffcfb032-tmp\") pod \"kube-auth-proxy-7965d5bf57-r4f7h\" (UID: \"1aa09740-bc40-481c-893c-a1f3ffcfb032\") " pod="openshift-ingress/kube-auth-proxy-7965d5bf57-r4f7h"
Jul 06 12:55:55.586577 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:55.586397    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1aa09740-bc40-481c-893c-a1f3ffcfb032-tls-certs\") pod \"kube-auth-proxy-7965d5bf57-r4f7h\" (UID: \"1aa09740-bc40-481c-893c-a1f3ffcfb032\") " pod="openshift-ingress/kube-auth-proxy-7965d5bf57-r4f7h"
Jul 06 12:55:55.687032 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:55.686936    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1aa09740-bc40-481c-893c-a1f3ffcfb032-tls-certs\") pod \"kube-auth-proxy-7965d5bf57-r4f7h\" (UID: \"1aa09740-bc40-481c-893c-a1f3ffcfb032\") " pod="openshift-ingress/kube-auth-proxy-7965d5bf57-r4f7h"
Jul 06 12:55:55.687195 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:55.687067    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5l9r\" (UniqueName: \"kubernetes.io/projected/1aa09740-bc40-481c-893c-a1f3ffcfb032-kube-api-access-v5l9r\") pod \"kube-auth-proxy-7965d5bf57-r4f7h\" (UID: \"1aa09740-bc40-481c-893c-a1f3ffcfb032\") " pod="openshift-ingress/kube-auth-proxy-7965d5bf57-r4f7h"
Jul 06 12:55:55.687195 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:55.687099    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1aa09740-bc40-481c-893c-a1f3ffcfb032-tmp\") pod \"kube-auth-proxy-7965d5bf57-r4f7h\" (UID: \"1aa09740-bc40-481c-893c-a1f3ffcfb032\") " pod="openshift-ingress/kube-auth-proxy-7965d5bf57-r4f7h"
Jul 06 12:55:55.687558 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:55.687533    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:55:55.689427 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:55.689406    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1aa09740-bc40-481c-893c-a1f3ffcfb032-tmp\") pod \"kube-auth-proxy-7965d5bf57-r4f7h\" (UID: \"1aa09740-bc40-481c-893c-a1f3ffcfb032\") " pod="openshift-ingress/kube-auth-proxy-7965d5bf57-r4f7h"
Jul 06 12:55:55.689554 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:55.689536    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1aa09740-bc40-481c-893c-a1f3ffcfb032-tls-certs\") pod \"kube-auth-proxy-7965d5bf57-r4f7h\" (UID: \"1aa09740-bc40-481c-893c-a1f3ffcfb032\") " pod="openshift-ingress/kube-auth-proxy-7965d5bf57-r4f7h"
Jul 06 12:55:55.741556 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:55.741530    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5l9r\" (UniqueName: \"kubernetes.io/projected/1aa09740-bc40-481c-893c-a1f3ffcfb032-kube-api-access-v5l9r\") pod \"kube-auth-proxy-7965d5bf57-r4f7h\" (UID: \"1aa09740-bc40-481c-893c-a1f3ffcfb032\") " pod="openshift-ingress/kube-auth-proxy-7965d5bf57-r4f7h"
Jul 06 12:55:55.832200 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:55.832160    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7965d5bf57-r4f7h"
Jul 06 12:55:55.984122 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:55.984097    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7965d5bf57-r4f7h"]
Jul 06 12:55:55.985971 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:55:55.985944    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1aa09740_bc40_481c_893c_a1f3ffcfb032.slice/crio-b0f2e59e78ee1b8db8aff87070a4d6903e4886d1bf11c0951a9375b2486db845 WatchSource:0}: Error finding container b0f2e59e78ee1b8db8aff87070a4d6903e4886d1bf11c0951a9375b2486db845: Status 404 returned error can't find the container with id b0f2e59e78ee1b8db8aff87070a4d6903e4886d1bf11c0951a9375b2486db845
Jul 06 12:55:56.510978 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:56.510949    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:55:56.725114 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:56.725081    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-cl2vw"]
Jul 06 12:55:56.728485 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:56.728460    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-cl2vw"
Jul 06 12:55:56.733970 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:56.733944    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-kgxg2"]
Jul 06 12:55:56.735492 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:56.735474    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 06 12:55:56.735774 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:56.735742    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-dpcwx\""
Jul 06 12:55:56.737153 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:56.737134    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kgxg2"
Jul 06 12:55:56.748310 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:56.748166    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-qvggw\""
Jul 06 12:55:56.753890 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:56.753872    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 06 12:55:56.760858 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:56.760818    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-cl2vw"]
Jul 06 12:55:56.794978 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:56.794887    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wbbk\" (UniqueName: \"kubernetes.io/projected/71ebda6a-b1a3-4d26-8144-cf24d181a39a-kube-api-access-2wbbk\") pod \"kserve-controller-manager-d6f4b65b8-cl2vw\" (UID: \"71ebda6a-b1a3-4d26-8144-cf24d181a39a\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-cl2vw"
Jul 06 12:55:56.795132 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:56.794978    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2bcf3806-940a-4baa-a64d-3871334847b3-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-kgxg2\" (UID: \"2bcf3806-940a-4baa-a64d-3871334847b3\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kgxg2"
Jul 06 12:55:56.795132 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:56.795004    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/71ebda6a-b1a3-4d26-8144-cf24d181a39a-cert\") pod \"kserve-controller-manager-d6f4b65b8-cl2vw\" (UID: \"71ebda6a-b1a3-4d26-8144-cf24d181a39a\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-cl2vw"
Jul 06 12:55:56.795132 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:56.795039    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsg6h\" (UniqueName: \"kubernetes.io/projected/2bcf3806-940a-4baa-a64d-3871334847b3-kube-api-access-dsg6h\") pod \"llmisvc-controller-manager-777c6bd7d5-kgxg2\" (UID: \"2bcf3806-940a-4baa-a64d-3871334847b3\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kgxg2"
Jul 06 12:55:56.799229 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:56.799202    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-kgxg2"]
Jul 06 12:55:56.864573 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:56.864542    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:55:56.874230 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:56.874200    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7965d5bf57-r4f7h" event={"ID":"1aa09740-bc40-481c-893c-a1f3ffcfb032","Type":"ContainerStarted","Data":"b0f2e59e78ee1b8db8aff87070a4d6903e4886d1bf11c0951a9375b2486db845"}
Jul 06 12:55:56.896024 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:56.895872    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2bcf3806-940a-4baa-a64d-3871334847b3-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-kgxg2\" (UID: \"2bcf3806-940a-4baa-a64d-3871334847b3\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kgxg2"
Jul 06 12:55:56.896024 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:56.895923    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/71ebda6a-b1a3-4d26-8144-cf24d181a39a-cert\") pod \"kserve-controller-manager-d6f4b65b8-cl2vw\" (UID: \"71ebda6a-b1a3-4d26-8144-cf24d181a39a\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-cl2vw"
Jul 06 12:55:56.896024 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:56.895962    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dsg6h\" (UniqueName: \"kubernetes.io/projected/2bcf3806-940a-4baa-a64d-3871334847b3-kube-api-access-dsg6h\") pod \"llmisvc-controller-manager-777c6bd7d5-kgxg2\" (UID: \"2bcf3806-940a-4baa-a64d-3871334847b3\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kgxg2"
Jul 06 12:55:56.896024 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:56.896014    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wbbk\" (UniqueName: \"kubernetes.io/projected/71ebda6a-b1a3-4d26-8144-cf24d181a39a-kube-api-access-2wbbk\") pod \"kserve-controller-manager-d6f4b65b8-cl2vw\" (UID: \"71ebda6a-b1a3-4d26-8144-cf24d181a39a\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-cl2vw"
Jul 06 12:55:56.898948 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:56.898923    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/71ebda6a-b1a3-4d26-8144-cf24d181a39a-cert\") pod \"kserve-controller-manager-d6f4b65b8-cl2vw\" (UID: \"71ebda6a-b1a3-4d26-8144-cf24d181a39a\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-cl2vw"
Jul 06 12:55:56.899240 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:56.899215    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2bcf3806-940a-4baa-a64d-3871334847b3-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-kgxg2\" (UID: \"2bcf3806-940a-4baa-a64d-3871334847b3\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kgxg2"
Jul 06 12:55:56.990109 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:56.990079    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wbbk\" (UniqueName: \"kubernetes.io/projected/71ebda6a-b1a3-4d26-8144-cf24d181a39a-kube-api-access-2wbbk\") pod \"kserve-controller-manager-d6f4b65b8-cl2vw\" (UID: \"71ebda6a-b1a3-4d26-8144-cf24d181a39a\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-cl2vw"
Jul 06 12:55:56.993564 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:56.993537    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsg6h\" (UniqueName: \"kubernetes.io/projected/2bcf3806-940a-4baa-a64d-3871334847b3-kube-api-access-dsg6h\") pod \"llmisvc-controller-manager-777c6bd7d5-kgxg2\" (UID: \"2bcf3806-940a-4baa-a64d-3871334847b3\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kgxg2"
Jul 06 12:55:57.053264 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:57.052914    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kgxg2"
Jul 06 12:55:57.053264 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:57.053030    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-cl2vw"
Jul 06 12:55:57.115420 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:57.115354    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:55:57.284004 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:57.283908    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-kgxg2"]
Jul 06 12:55:57.285919 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:57.285894    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-cl2vw"]
Jul 06 12:55:57.288014 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:55:57.287985    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71ebda6a_b1a3_4d26_8144_cf24d181a39a.slice/crio-3086e7061e7bb01475ddce4ded1c92e88f341e1a6df0324450090ab3e5ff9e70 WatchSource:0}: Error finding container 3086e7061e7bb01475ddce4ded1c92e88f341e1a6df0324450090ab3e5ff9e70: Status 404 returned error can't find the container with id 3086e7061e7bb01475ddce4ded1c92e88f341e1a6df0324450090ab3e5ff9e70
Jul 06 12:55:57.288836 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:55:57.288711    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2bcf3806_940a_4baa_a64d_3871334847b3.slice/crio-d5b57fdfbf08ec8e9a96c36dab8af552c8d1a68be6e5bc732dbc9eda82d33248 WatchSource:0}: Error finding container d5b57fdfbf08ec8e9a96c36dab8af552c8d1a68be6e5bc732dbc9eda82d33248: Status 404 returned error can't find the container with id d5b57fdfbf08ec8e9a96c36dab8af552c8d1a68be6e5bc732dbc9eda82d33248
Jul 06 12:55:57.316033 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:57.315959    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:55:57.483265 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:57.483230    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:55:57.880727 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:57.880690    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-cl2vw" event={"ID":"71ebda6a-b1a3-4d26-8144-cf24d181a39a","Type":"ContainerStarted","Data":"3086e7061e7bb01475ddce4ded1c92e88f341e1a6df0324450090ab3e5ff9e70"}
Jul 06 12:55:57.881925 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:57.881900    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kgxg2" event={"ID":"2bcf3806-940a-4baa-a64d-3871334847b3","Type":"ContainerStarted","Data":"d5b57fdfbf08ec8e9a96c36dab8af552c8d1a68be6e5bc732dbc9eda82d33248"}
Jul 06 12:55:58.889807 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:58.889753    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7965d5bf57-r4f7h" event={"ID":"1aa09740-bc40-481c-893c-a1f3ffcfb032","Type":"ContainerStarted","Data":"3f79eb0871309b19bb959774156c4b8f8a7392ad7a93d73b483525949e271b8b"}
Jul 06 12:55:58.982860 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:58.982791    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7965d5bf57-r4f7h" podStartSLOduration=1.274906809 podStartE2EDuration="3.982767094s" totalImagesPullingTime="2.707860285s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:55:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:55:58.981502841 +0000 UTC m=+535.850390502" watchObservedRunningTime="2026-07-06 12:55:58.982767094 +0000 UTC m=+535.851654755"
Jul 06 12:55:59.844770 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:55:59.844739    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-l4qtb"
Jul 06 12:56:00.852160 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:00.852113    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-c7mnf"
Jul 06 12:56:00.902294 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:00.902254    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-cl2vw" event={"ID":"71ebda6a-b1a3-4d26-8144-cf24d181a39a","Type":"ContainerStarted","Data":"f3e83cab3a4237af2cc3c1ed99c9a40c649588cd80d2a251ac2919e72781b405"}
Jul 06 12:56:00.902483 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:00.902392    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-cl2vw"
Jul 06 12:56:00.995470 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:00.995414    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-cl2vw" podStartSLOduration=2.302893659 podStartE2EDuration="4.995395987s" totalImagesPullingTime="2.692502328s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:55:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:56:00.99444157 +0000 UTC m=+537.863329230" watchObservedRunningTime="2026-07-06 12:56:00.995395987 +0000 UTC m=+537.864283646"
Jul 06 12:56:01.380446 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:01.380415    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:56:01.464150 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:01.464067    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zjfgf"]
Jul 06 12:56:01.467460 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:01.467438    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zjfgf"
Jul 06 12:56:01.484445 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:01.484414    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zjfgf"]
Jul 06 12:56:01.490571 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:01.490553    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 06 12:56:01.490662 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:01.490631    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 06 12:56:01.490832 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:01.490817    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 06 12:56:01.490916 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:01.490903    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 06 12:56:01.490977 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:01.490933    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-bcz6r\""
Jul 06 12:56:01.539518 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:01.539481    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b91b1a5e-3b53-49e7-9b5f-e2a17387d8dc-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-zjfgf\" (UID: \"b91b1a5e-3b53-49e7-9b5f-e2a17387d8dc\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zjfgf"
Jul 06 12:56:01.539701 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:01.539525    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b91b1a5e-3b53-49e7-9b5f-e2a17387d8dc-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-zjfgf\" (UID: \"b91b1a5e-3b53-49e7-9b5f-e2a17387d8dc\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zjfgf"
Jul 06 12:56:01.539701 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:01.539565    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b91b1a5e-3b53-49e7-9b5f-e2a17387d8dc-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-zjfgf\" (UID: \"b91b1a5e-3b53-49e7-9b5f-e2a17387d8dc\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zjfgf"
Jul 06 12:56:01.539701 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:01.539634    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b91b1a5e-3b53-49e7-9b5f-e2a17387d8dc-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-zjfgf\" (UID: \"b91b1a5e-3b53-49e7-9b5f-e2a17387d8dc\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zjfgf"
Jul 06 12:56:01.539701 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:01.539672    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b91b1a5e-3b53-49e7-9b5f-e2a17387d8dc-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-zjfgf\" (UID: \"b91b1a5e-3b53-49e7-9b5f-e2a17387d8dc\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zjfgf"
Jul 06 12:56:01.539701 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:01.539696    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b91b1a5e-3b53-49e7-9b5f-e2a17387d8dc-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-zjfgf\" (UID: \"b91b1a5e-3b53-49e7-9b5f-e2a17387d8dc\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zjfgf"
Jul 06 12:56:01.539920 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:01.539734    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmzzg\" (UniqueName: \"kubernetes.io/projected/b91b1a5e-3b53-49e7-9b5f-e2a17387d8dc-kube-api-access-rmzzg\") pod \"istiod-openshift-gateway-94bb8fbfd-zjfgf\" (UID: \"b91b1a5e-3b53-49e7-9b5f-e2a17387d8dc\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zjfgf"
Jul 06 12:56:01.641038 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:01.640995    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b91b1a5e-3b53-49e7-9b5f-e2a17387d8dc-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-zjfgf\" (UID: \"b91b1a5e-3b53-49e7-9b5f-e2a17387d8dc\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zjfgf"
Jul 06 12:56:01.641223 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:01.641067    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b91b1a5e-3b53-49e7-9b5f-e2a17387d8dc-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-zjfgf\" (UID: \"b91b1a5e-3b53-49e7-9b5f-e2a17387d8dc\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zjfgf"
Jul 06 12:56:01.641223 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:01.641106    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b91b1a5e-3b53-49e7-9b5f-e2a17387d8dc-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-zjfgf\" (UID: \"b91b1a5e-3b53-49e7-9b5f-e2a17387d8dc\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zjfgf"
Jul 06 12:56:01.641223 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:01.641131    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b91b1a5e-3b53-49e7-9b5f-e2a17387d8dc-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-zjfgf\" (UID: \"b91b1a5e-3b53-49e7-9b5f-e2a17387d8dc\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zjfgf"
Jul 06 12:56:01.641223 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:01.641166    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmzzg\" (UniqueName: \"kubernetes.io/projected/b91b1a5e-3b53-49e7-9b5f-e2a17387d8dc-kube-api-access-rmzzg\") pod \"istiod-openshift-gateway-94bb8fbfd-zjfgf\" (UID: \"b91b1a5e-3b53-49e7-9b5f-e2a17387d8dc\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zjfgf"
Jul 06 12:56:01.641223 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:01.641196    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b91b1a5e-3b53-49e7-9b5f-e2a17387d8dc-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-zjfgf\" (UID: \"b91b1a5e-3b53-49e7-9b5f-e2a17387d8dc\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zjfgf"
Jul 06 12:56:01.641462 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:01.641226    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b91b1a5e-3b53-49e7-9b5f-e2a17387d8dc-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-zjfgf\" (UID: \"b91b1a5e-3b53-49e7-9b5f-e2a17387d8dc\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zjfgf"
Jul 06 12:56:01.642008 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:01.641981    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b91b1a5e-3b53-49e7-9b5f-e2a17387d8dc-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-zjfgf\" (UID: \"b91b1a5e-3b53-49e7-9b5f-e2a17387d8dc\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zjfgf"
Jul 06 12:56:01.643376 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:01.643358    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b91b1a5e-3b53-49e7-9b5f-e2a17387d8dc-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-zjfgf\" (UID: \"b91b1a5e-3b53-49e7-9b5f-e2a17387d8dc\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zjfgf"
Jul 06 12:56:01.643570 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:01.643548    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b91b1a5e-3b53-49e7-9b5f-e2a17387d8dc-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-zjfgf\" (UID: \"b91b1a5e-3b53-49e7-9b5f-e2a17387d8dc\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zjfgf"
Jul 06 12:56:01.643764 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:01.643744    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b91b1a5e-3b53-49e7-9b5f-e2a17387d8dc-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-zjfgf\" (UID: \"b91b1a5e-3b53-49e7-9b5f-e2a17387d8dc\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zjfgf"
Jul 06 12:56:01.643861 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:01.643798    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b91b1a5e-3b53-49e7-9b5f-e2a17387d8dc-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-zjfgf\" (UID: \"b91b1a5e-3b53-49e7-9b5f-e2a17387d8dc\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zjfgf"
Jul 06 12:56:01.658917 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:01.658896    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b91b1a5e-3b53-49e7-9b5f-e2a17387d8dc-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-zjfgf\" (UID: \"b91b1a5e-3b53-49e7-9b5f-e2a17387d8dc\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zjfgf"
Jul 06 12:56:01.686085 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:01.686056    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmzzg\" (UniqueName: \"kubernetes.io/projected/b91b1a5e-3b53-49e7-9b5f-e2a17387d8dc-kube-api-access-rmzzg\") pod \"istiod-openshift-gateway-94bb8fbfd-zjfgf\" (UID: \"b91b1a5e-3b53-49e7-9b5f-e2a17387d8dc\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zjfgf"
Jul 06 12:56:01.743195 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:01.743165    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:56:01.776009 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:01.775975    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zjfgf"
Jul 06 12:56:01.908277 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:01.908248    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kgxg2" event={"ID":"2bcf3806-940a-4baa-a64d-3871334847b3","Type":"ContainerStarted","Data":"eac287b5493fd970d17f767761744e7531d96a6d4bc551b00e95f6f3b4910748"}
Jul 06 12:56:01.935214 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:01.935178    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zjfgf"]
Jul 06 12:56:01.938329 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:56:01.938298    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb91b1a5e_3b53_49e7_9b5f_e2a17387d8dc.slice/crio-0cbcf26790ab91b5f2b9640e10f03db79b579f1c695c72243da7950cc3cd091c WatchSource:0}: Error finding container 0cbcf26790ab91b5f2b9640e10f03db79b579f1c695c72243da7950cc3cd091c: Status 404 returned error can't find the container with id 0cbcf26790ab91b5f2b9640e10f03db79b579f1c695c72243da7950cc3cd091c
Jul 06 12:56:01.960339 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:01.960292    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kgxg2" podStartSLOduration=2.197345138 podStartE2EDuration="5.960278146s" totalImagesPullingTime="3.762933008s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:55:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:56:01.959301174 +0000 UTC m=+538.828188837" watchObservedRunningTime="2026-07-06 12:56:01.960278146 +0000 UTC m=+538.829165805"
Jul 06 12:56:02.916386 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:02.916151    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zjfgf" event={"ID":"b91b1a5e-3b53-49e7-9b5f-e2a17387d8dc","Type":"ContainerStarted","Data":"0cbcf26790ab91b5f2b9640e10f03db79b579f1c695c72243da7950cc3cd091c"}
Jul 06 12:56:02.916386 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:02.916294    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kgxg2"
Jul 06 12:56:04.612883 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:04.612829    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 12:56:04.613129 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:04.612932    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 12:56:04.927706 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:04.927619    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zjfgf" event={"ID":"b91b1a5e-3b53-49e7-9b5f-e2a17387d8dc","Type":"ContainerStarted","Data":"dc082ceb8434a59ef5471b1f3bd6f5eb76560faadbd24762c11a0eb4b56aa98f"}
Jul 06 12:56:04.927874 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:04.927743    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zjfgf"
Jul 06 12:56:04.973186 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:04.973136    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zjfgf" podStartSLOduration=1.300969156 podStartE2EDuration="3.973123136s" totalImagesPullingTime="2.67215398s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:56:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:56:04.971586417 +0000 UTC m=+541.840474067" watchObservedRunningTime="2026-07-06 12:56:04.973123136 +0000 UTC m=+541.842010795"
Jul 06 12:56:05.164378 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:05.164346    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:56:05.563338 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:05.563304    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:56:05.785492 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:05.785460    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:56:05.933955 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:05.933867    2579 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-zjfgf container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 06 12:56:05.933955 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:05.933928    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zjfgf" podUID="b91b1a5e-3b53-49e7-9b5f-e2a17387d8dc" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 12:56:08.768048 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:08.767994    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:56:08.932943 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:08.932912    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-zjfgf"
Jul 06 12:56:09.023446 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:09.023369    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:56:10.629768 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:10.629734    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:56:10.948886 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:10.948770    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5cc7b77756-wj4xs" podUID="58618491-2188-4287-8f70-2ad257d024e5" containerName="console" containerID="cri-o://14e3c0ad4c29376dd13c32b17d691c02d6853f91aa82a9265a5ce13b905c9cb5" gracePeriod=15
Jul 06 12:56:10.979860 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:10.979818    2579 patch_prober.go:28] interesting pod/console-5cc7b77756-wj4xs container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused" start-of-body=
Jul 06 12:56:10.979963 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:10.979882    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-5cc7b77756-wj4xs" podUID="58618491-2188-4287-8f70-2ad257d024e5" containerName="console" probeResult="failure" output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused"
Jul 06 12:56:11.183716 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:11.183692    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cc7b77756-wj4xs"
Jul 06 12:56:11.225652 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:11.225587    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z54gc\" (UniqueName: \"kubernetes.io/projected/58618491-2188-4287-8f70-2ad257d024e5-kube-api-access-z54gc\") pod \"58618491-2188-4287-8f70-2ad257d024e5\" (UID: \"58618491-2188-4287-8f70-2ad257d024e5\") "
Jul 06 12:56:11.225652 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:11.225650    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/58618491-2188-4287-8f70-2ad257d024e5-service-ca\") pod \"58618491-2188-4287-8f70-2ad257d024e5\" (UID: \"58618491-2188-4287-8f70-2ad257d024e5\") "
Jul 06 12:56:11.225885 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:11.225671    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/58618491-2188-4287-8f70-2ad257d024e5-console-config\") pod \"58618491-2188-4287-8f70-2ad257d024e5\" (UID: \"58618491-2188-4287-8f70-2ad257d024e5\") "
Jul 06 12:56:11.225885 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:11.225774    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/58618491-2188-4287-8f70-2ad257d024e5-console-oauth-config\") pod \"58618491-2188-4287-8f70-2ad257d024e5\" (UID: \"58618491-2188-4287-8f70-2ad257d024e5\") "
Jul 06 12:56:11.225885 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:11.225814    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/58618491-2188-4287-8f70-2ad257d024e5-console-serving-cert\") pod \"58618491-2188-4287-8f70-2ad257d024e5\" (UID: \"58618491-2188-4287-8f70-2ad257d024e5\") "
Jul 06 12:56:11.225885 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:11.225881    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/58618491-2188-4287-8f70-2ad257d024e5-oauth-serving-cert\") pod \"58618491-2188-4287-8f70-2ad257d024e5\" (UID: \"58618491-2188-4287-8f70-2ad257d024e5\") "
Jul 06 12:56:11.226090 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:11.225909    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58618491-2188-4287-8f70-2ad257d024e5-trusted-ca-bundle\") pod \"58618491-2188-4287-8f70-2ad257d024e5\" (UID: \"58618491-2188-4287-8f70-2ad257d024e5\") "
Jul 06 12:56:11.226090 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:11.226068    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58618491-2188-4287-8f70-2ad257d024e5-console-config" (OuterVolumeSpecName: "console-config") pod "58618491-2188-4287-8f70-2ad257d024e5" (UID: "58618491-2188-4287-8f70-2ad257d024e5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 12:56:11.226193 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:11.226095    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58618491-2188-4287-8f70-2ad257d024e5-service-ca" (OuterVolumeSpecName: "service-ca") pod "58618491-2188-4287-8f70-2ad257d024e5" (UID: "58618491-2188-4287-8f70-2ad257d024e5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 12:56:11.226250 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:11.226219    2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/58618491-2188-4287-8f70-2ad257d024e5-service-ca\") on node \"ip-10-0-129-126.ec2.internal\" DevicePath \"\""
Jul 06 12:56:11.226250 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:11.226236    2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/58618491-2188-4287-8f70-2ad257d024e5-console-config\") on node \"ip-10-0-129-126.ec2.internal\" DevicePath \"\""
Jul 06 12:56:11.226365 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:11.226342    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58618491-2188-4287-8f70-2ad257d024e5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "58618491-2188-4287-8f70-2ad257d024e5" (UID: "58618491-2188-4287-8f70-2ad257d024e5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 12:56:11.226428 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:11.226408    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58618491-2188-4287-8f70-2ad257d024e5-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "58618491-2188-4287-8f70-2ad257d024e5" (UID: "58618491-2188-4287-8f70-2ad257d024e5"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 12:56:11.228116 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:11.228091    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58618491-2188-4287-8f70-2ad257d024e5-kube-api-access-z54gc" (OuterVolumeSpecName: "kube-api-access-z54gc") pod "58618491-2188-4287-8f70-2ad257d024e5" (UID: "58618491-2188-4287-8f70-2ad257d024e5"). InnerVolumeSpecName "kube-api-access-z54gc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 12:56:11.228344 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:11.228321    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58618491-2188-4287-8f70-2ad257d024e5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "58618491-2188-4287-8f70-2ad257d024e5" (UID: "58618491-2188-4287-8f70-2ad257d024e5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 12:56:11.228415 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:11.228393    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58618491-2188-4287-8f70-2ad257d024e5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "58618491-2188-4287-8f70-2ad257d024e5" (UID: "58618491-2188-4287-8f70-2ad257d024e5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 12:56:11.327296 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:11.327265    2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/58618491-2188-4287-8f70-2ad257d024e5-console-oauth-config\") on node \"ip-10-0-129-126.ec2.internal\" DevicePath \"\""
Jul 06 12:56:11.327296 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:11.327287    2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/58618491-2188-4287-8f70-2ad257d024e5-console-serving-cert\") on node \"ip-10-0-129-126.ec2.internal\" DevicePath \"\""
Jul 06 12:56:11.327296 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:11.327297    2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/58618491-2188-4287-8f70-2ad257d024e5-oauth-serving-cert\") on node \"ip-10-0-129-126.ec2.internal\" DevicePath \"\""
Jul 06 12:56:11.327296 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:11.327305    2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58618491-2188-4287-8f70-2ad257d024e5-trusted-ca-bundle\") on node \"ip-10-0-129-126.ec2.internal\" DevicePath \"\""
Jul 06 12:56:11.327527 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:11.327313    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z54gc\" (UniqueName: \"kubernetes.io/projected/58618491-2188-4287-8f70-2ad257d024e5-kube-api-access-z54gc\") on node \"ip-10-0-129-126.ec2.internal\" DevicePath \"\""
Jul 06 12:56:11.960414 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:11.960324    2579 generic.go:356] "Generic (PLEG): container finished" podID="58618491-2188-4287-8f70-2ad257d024e5" containerID="14e3c0ad4c29376dd13c32b17d691c02d6853f91aa82a9265a5ce13b905c9cb5" exitCode=0
Jul 06 12:56:11.960414 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:11.960364    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cc7b77756-wj4xs"
Jul 06 12:56:11.960889 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:11.960413    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cc7b77756-wj4xs" event={"ID":"58618491-2188-4287-8f70-2ad257d024e5","Type":"ContainerDied","Data":"14e3c0ad4c29376dd13c32b17d691c02d6853f91aa82a9265a5ce13b905c9cb5"}
Jul 06 12:56:11.960889 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:11.960464    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cc7b77756-wj4xs" event={"ID":"58618491-2188-4287-8f70-2ad257d024e5","Type":"ContainerDied","Data":"20ec7119e2ee57be7904a2f8bbf55722df66365dae7a2be8d49217f2d3ea2954"}
Jul 06 12:56:11.960889 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:11.960489    2579 scope.go:117] "RemoveContainer" containerID="14e3c0ad4c29376dd13c32b17d691c02d6853f91aa82a9265a5ce13b905c9cb5"
Jul 06 12:56:11.969196 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:11.969142    2579 scope.go:117] "RemoveContainer" containerID="14e3c0ad4c29376dd13c32b17d691c02d6853f91aa82a9265a5ce13b905c9cb5"
Jul 06 12:56:11.969532 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:56:11.969449    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14e3c0ad4c29376dd13c32b17d691c02d6853f91aa82a9265a5ce13b905c9cb5\": container with ID starting with 14e3c0ad4c29376dd13c32b17d691c02d6853f91aa82a9265a5ce13b905c9cb5 not found: ID does not exist" containerID="14e3c0ad4c29376dd13c32b17d691c02d6853f91aa82a9265a5ce13b905c9cb5"
Jul 06 12:56:11.969532 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:11.969504    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14e3c0ad4c29376dd13c32b17d691c02d6853f91aa82a9265a5ce13b905c9cb5"} err="failed to get container status \"14e3c0ad4c29376dd13c32b17d691c02d6853f91aa82a9265a5ce13b905c9cb5\": rpc error: code = NotFound desc = could not find container \"14e3c0ad4c29376dd13c32b17d691c02d6853f91aa82a9265a5ce13b905c9cb5\": container with ID starting with 14e3c0ad4c29376dd13c32b17d691c02d6853f91aa82a9265a5ce13b905c9cb5 not found: ID does not exist"
Jul 06 12:56:11.982925 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:11.982905    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cc7b77756-wj4xs"]
Jul 06 12:56:11.987267 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:11.987246    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5cc7b77756-wj4xs"]
Jul 06 12:56:13.654742 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:13.654710    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58618491-2188-4287-8f70-2ad257d024e5" path="/var/lib/kubelet/pods/58618491-2188-4287-8f70-2ad257d024e5/volumes"
Jul 06 12:56:31.913712 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:31.913649    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-cl2vw"
Jul 06 12:56:33.923318 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:33.923283    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kgxg2"
Jul 06 12:56:45.693700 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:45.693669    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:56:45.851019 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:45.850973    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:56:45.990992 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:45.990952    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:56:46.714857 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:46.714822    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:56:46.853443 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:56:46.853359    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:57:12.754122 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:57:12.754092    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:57:16.973652 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:57:16.973622    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:57:19.490010 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:57:19.489974    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:57:19.762913 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:57:19.762810    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:57:20.148045 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:57:20.147948    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:57:20.276244 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:57:20.276201    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:57:20.742176 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:57:20.742137    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:57:24.252145 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:57:24.252115    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:57:24.510827 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:57:24.510735    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:57:24.646101 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:57:24.646071    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:57:24.866906 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:57:24.866810    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:57:27.258497 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:57:27.258419    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:57:29.011115 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:57:29.011083    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:57:29.171546 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:57:29.171507    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:57:32.459032 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:57:32.458993    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:57:32.567662 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:57:32.567624    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:57:32.665952 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:57:32.665916    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:57:36.162585 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:57:36.162559    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:57:36.268078 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:57:36.268049    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:57:44.451254 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:57:44.451211    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wsx2t"]
Jul 06 12:57:44.451808 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:57:44.451687    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58618491-2188-4287-8f70-2ad257d024e5" containerName="console"
Jul 06 12:57:44.451808 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:57:44.451704    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="58618491-2188-4287-8f70-2ad257d024e5" containerName="console"
Jul 06 12:57:44.451808 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:57:44.451795    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="58618491-2188-4287-8f70-2ad257d024e5" containerName="console"
Jul 06 12:57:44.454703 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:57:44.454674    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wsx2t"
Jul 06 12:57:44.458153 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:57:44.458131    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-6mvwm\""
Jul 06 12:57:44.458610 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:57:44.458589    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 06 12:57:44.460246 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:57:44.460224    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 06 12:57:44.494044 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:57:44.494015    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wsx2t"]
Jul 06 12:57:44.502481 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:57:44.502453    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wv9xd\" (UniqueName: \"kubernetes.io/projected/88b34d0b-7bba-42b0-9770-4809734f08a6-kube-api-access-wv9xd\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wsx2t\" (UID: \"88b34d0b-7bba-42b0-9770-4809734f08a6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wsx2t"
Jul 06 12:57:44.502603 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:57:44.502513    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/88b34d0b-7bba-42b0-9770-4809734f08a6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wsx2t\" (UID: \"88b34d0b-7bba-42b0-9770-4809734f08a6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wsx2t"
Jul 06 12:57:44.603589 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:57:44.603554    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/88b34d0b-7bba-42b0-9770-4809734f08a6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wsx2t\" (UID: \"88b34d0b-7bba-42b0-9770-4809734f08a6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wsx2t"
Jul 06 12:57:44.603769 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:57:44.603636    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wv9xd\" (UniqueName: \"kubernetes.io/projected/88b34d0b-7bba-42b0-9770-4809734f08a6-kube-api-access-wv9xd\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wsx2t\" (UID: \"88b34d0b-7bba-42b0-9770-4809734f08a6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wsx2t"
Jul 06 12:57:44.604016 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:57:44.603993    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/88b34d0b-7bba-42b0-9770-4809734f08a6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wsx2t\" (UID: \"88b34d0b-7bba-42b0-9770-4809734f08a6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wsx2t"
Jul 06 12:57:44.616735 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:57:44.616708    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wv9xd\" (UniqueName: \"kubernetes.io/projected/88b34d0b-7bba-42b0-9770-4809734f08a6-kube-api-access-wv9xd\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wsx2t\" (UID: \"88b34d0b-7bba-42b0-9770-4809734f08a6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wsx2t"
Jul 06 12:57:44.774893 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:57:44.774857    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wsx2t"
Jul 06 12:57:44.950184 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:57:44.950152    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wsx2t"]
Jul 06 12:57:44.953661 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:57:44.953631    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88b34d0b_7bba_42b0_9770_4809734f08a6.slice/crio-1131f70544c98ba162210566f77fdadcaaac0b7f2bfc78e784e9abeb6b63a02e WatchSource:0}: Error finding container 1131f70544c98ba162210566f77fdadcaaac0b7f2bfc78e784e9abeb6b63a02e: Status 404 returned error can't find the container with id 1131f70544c98ba162210566f77fdadcaaac0b7f2bfc78e784e9abeb6b63a02e
Jul 06 12:57:45.368002 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:57:45.367969    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wsx2t" event={"ID":"88b34d0b-7bba-42b0-9770-4809734f08a6","Type":"ContainerStarted","Data":"1131f70544c98ba162210566f77fdadcaaac0b7f2bfc78e784e9abeb6b63a02e"}
Jul 06 12:57:45.903283 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:57:45.903254    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:57:46.069824 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:57:46.069759    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:57:46.466818 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:57:46.466787    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:57:46.742131 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:57:46.742090    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:57:48.835075 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:57:48.835039    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:57:48.943313 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:57:48.943228    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:57:50.394105 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:57:50.394069    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wsx2t" event={"ID":"88b34d0b-7bba-42b0-9770-4809734f08a6","Type":"ContainerStarted","Data":"00636c97afdfa90236479ab70c8fedb3fada155917a241c15afab995bc2eb0a8"}
Jul 06 12:57:50.394597 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:57:50.394197    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wsx2t"
Jul 06 12:57:50.435356 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:57:50.435286    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wsx2t" podStartSLOduration=1.429091219 podStartE2EDuration="6.435267638s" totalImagesPullingTime="5.006176419s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:57:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:57:50.43361818 +0000 UTC m=+647.302505855" watchObservedRunningTime="2026-07-06 12:57:50.435267638 +0000 UTC m=+647.304155298"
Jul 06 12:57:50.743874 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:57:50.743818    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:57:51.909904 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:57:51.909868    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:57:52.118579 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:57:52.118547    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:57:55.170400 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:57:55.170366    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:57:55.301363 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:57:55.301329    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:57:58.388718 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:57:58.388680    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:57:58.496528 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:57:58.496498    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:58:01.131258 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:01.131217    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:58:01.401175 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:01.401095    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wsx2t"
Jul 06 12:58:07.182950 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:07.182918    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:58:07.409253 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:07.409215    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wsx2t"]
Jul 06 12:58:07.409522 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:07.409497    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wsx2t" podUID="88b34d0b-7bba-42b0-9770-4809734f08a6" containerName="manager" containerID="cri-o://00636c97afdfa90236479ab70c8fedb3fada155917a241c15afab995bc2eb0a8" gracePeriod=10
Jul 06 12:58:07.663881 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:07.663834    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wsx2t"
Jul 06 12:58:07.802676 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:07.802636    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/88b34d0b-7bba-42b0-9770-4809734f08a6-extensions-socket-volume\") pod \"88b34d0b-7bba-42b0-9770-4809734f08a6\" (UID: \"88b34d0b-7bba-42b0-9770-4809734f08a6\") "
Jul 06 12:58:07.802907 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:07.802745    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wv9xd\" (UniqueName: \"kubernetes.io/projected/88b34d0b-7bba-42b0-9770-4809734f08a6-kube-api-access-wv9xd\") pod \"88b34d0b-7bba-42b0-9770-4809734f08a6\" (UID: \"88b34d0b-7bba-42b0-9770-4809734f08a6\") "
Jul 06 12:58:07.803106 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:07.803076    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88b34d0b-7bba-42b0-9770-4809734f08a6-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "88b34d0b-7bba-42b0-9770-4809734f08a6" (UID: "88b34d0b-7bba-42b0-9770-4809734f08a6"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:58:07.805031 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:07.805007    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88b34d0b-7bba-42b0-9770-4809734f08a6-kube-api-access-wv9xd" (OuterVolumeSpecName: "kube-api-access-wv9xd") pod "88b34d0b-7bba-42b0-9770-4809734f08a6" (UID: "88b34d0b-7bba-42b0-9770-4809734f08a6"). InnerVolumeSpecName "kube-api-access-wv9xd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 12:58:07.903578 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:07.903540    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wv9xd\" (UniqueName: \"kubernetes.io/projected/88b34d0b-7bba-42b0-9770-4809734f08a6-kube-api-access-wv9xd\") on node \"ip-10-0-129-126.ec2.internal\" DevicePath \"\""
Jul 06 12:58:07.903578 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:07.903571    2579 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/88b34d0b-7bba-42b0-9770-4809734f08a6-extensions-socket-volume\") on node \"ip-10-0-129-126.ec2.internal\" DevicePath \"\""
Jul 06 12:58:08.472892 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:08.472834    2579 generic.go:356] "Generic (PLEG): container finished" podID="88b34d0b-7bba-42b0-9770-4809734f08a6" containerID="00636c97afdfa90236479ab70c8fedb3fada155917a241c15afab995bc2eb0a8" exitCode=0
Jul 06 12:58:08.473363 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:08.472898    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wsx2t"
Jul 06 12:58:08.473363 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:08.472921    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wsx2t" event={"ID":"88b34d0b-7bba-42b0-9770-4809734f08a6","Type":"ContainerDied","Data":"00636c97afdfa90236479ab70c8fedb3fada155917a241c15afab995bc2eb0a8"}
Jul 06 12:58:08.473363 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:08.472984    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wsx2t" event={"ID":"88b34d0b-7bba-42b0-9770-4809734f08a6","Type":"ContainerDied","Data":"1131f70544c98ba162210566f77fdadcaaac0b7f2bfc78e784e9abeb6b63a02e"}
Jul 06 12:58:08.473363 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:08.473017    2579 scope.go:117] "RemoveContainer" containerID="00636c97afdfa90236479ab70c8fedb3fada155917a241c15afab995bc2eb0a8"
Jul 06 12:58:08.481479 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:08.481461    2579 scope.go:117] "RemoveContainer" containerID="00636c97afdfa90236479ab70c8fedb3fada155917a241c15afab995bc2eb0a8"
Jul 06 12:58:08.481730 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:58:08.481708    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00636c97afdfa90236479ab70c8fedb3fada155917a241c15afab995bc2eb0a8\": container with ID starting with 00636c97afdfa90236479ab70c8fedb3fada155917a241c15afab995bc2eb0a8 not found: ID does not exist" containerID="00636c97afdfa90236479ab70c8fedb3fada155917a241c15afab995bc2eb0a8"
Jul 06 12:58:08.481799 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:08.481741    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00636c97afdfa90236479ab70c8fedb3fada155917a241c15afab995bc2eb0a8"} err="failed to get container status \"00636c97afdfa90236479ab70c8fedb3fada155917a241c15afab995bc2eb0a8\": rpc error: code = NotFound desc = could not find container \"00636c97afdfa90236479ab70c8fedb3fada155917a241c15afab995bc2eb0a8\": container with ID starting with 00636c97afdfa90236479ab70c8fedb3fada155917a241c15afab995bc2eb0a8 not found: ID does not exist"
Jul 06 12:58:08.520201 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:08.520173    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:58:08.523318 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:08.523289    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wsx2t"]
Jul 06 12:58:08.539475 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:08.539451    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wsx2t"]
Jul 06 12:58:09.654181 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:09.654149    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88b34d0b-7bba-42b0-9770-4809734f08a6" path="/var/lib/kubelet/pods/88b34d0b-7bba-42b0-9770-4809734f08a6/volumes"
Jul 06 12:58:23.871310 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:23.871276    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:58:24.252860 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:24.252821    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:58:25.550912 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:25.550875    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-c7c49"]
Jul 06 12:58:25.551296 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:25.551201    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88b34d0b-7bba-42b0-9770-4809734f08a6" containerName="manager"
Jul 06 12:58:25.551296 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:25.551213    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="88b34d0b-7bba-42b0-9770-4809734f08a6" containerName="manager"
Jul 06 12:58:25.551296 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:25.551264    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="88b34d0b-7bba-42b0-9770-4809734f08a6" containerName="manager"
Jul 06 12:58:25.555643 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:25.555623    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-c7c49"
Jul 06 12:58:25.559155 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:25.559132    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 06 12:58:25.559344 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:25.559331    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-7v8gc\""
Jul 06 12:58:25.559699 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:25.559681    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:58:25.560471 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:25.560455    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 06 12:58:25.560559 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:25.560494    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 06 12:58:25.565348 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:25.565325    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-c7c49"]
Jul 06 12:58:25.653158 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:25.653126    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/70b589f4-5092-4395-a0e1-db4ac25d74c5-config-file\") pod \"limitador-limitador-64c94fd64f-c7c49\" (UID: \"70b589f4-5092-4395-a0e1-db4ac25d74c5\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-c7c49"
Jul 06 12:58:25.653368 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:25.653188    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzl4b\" (UniqueName: \"kubernetes.io/projected/70b589f4-5092-4395-a0e1-db4ac25d74c5-kube-api-access-wzl4b\") pod \"limitador-limitador-64c94fd64f-c7c49\" (UID: \"70b589f4-5092-4395-a0e1-db4ac25d74c5\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-c7c49"
Jul 06 12:58:25.654550 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:25.654519    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:58:25.655186 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:25.655169    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-c7c49"]
Jul 06 12:58:25.753864 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:25.753804    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/70b589f4-5092-4395-a0e1-db4ac25d74c5-config-file\") pod \"limitador-limitador-64c94fd64f-c7c49\" (UID: \"70b589f4-5092-4395-a0e1-db4ac25d74c5\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-c7c49"
Jul 06 12:58:25.754020 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:25.753916    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzl4b\" (UniqueName: \"kubernetes.io/projected/70b589f4-5092-4395-a0e1-db4ac25d74c5-kube-api-access-wzl4b\") pod \"limitador-limitador-64c94fd64f-c7c49\" (UID: \"70b589f4-5092-4395-a0e1-db4ac25d74c5\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-c7c49"
Jul 06 12:58:25.754512 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:25.754494    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/70b589f4-5092-4395-a0e1-db4ac25d74c5-config-file\") pod \"limitador-limitador-64c94fd64f-c7c49\" (UID: \"70b589f4-5092-4395-a0e1-db4ac25d74c5\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-c7c49"
Jul 06 12:58:25.755836 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:25.755811    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:58:25.763807 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:25.763779    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzl4b\" (UniqueName: \"kubernetes.io/projected/70b589f4-5092-4395-a0e1-db4ac25d74c5-kube-api-access-wzl4b\") pod \"limitador-limitador-64c94fd64f-c7c49\" (UID: \"70b589f4-5092-4395-a0e1-db4ac25d74c5\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-c7c49"
Jul 06 12:58:25.867083 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:25.866988    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-c7c49"
Jul 06 12:58:25.920130 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:25.920096    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 12:58:25.924051 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:25.924030    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"
Jul 06 12:58:25.935174 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:25.935102    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 12:58:25.948723 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:25.948700    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 12:58:26.000384 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:26.000357    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-c7c49"]
Jul 06 12:58:26.002887 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:58:26.002858    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70b589f4_5092_4395_a0e1_db4ac25d74c5.slice/crio-10c9fb58c93ec38eb4d4447bd0ac6f12a6f58d3ad21378d217b6bc14b63014a2 WatchSource:0}: Error finding container 10c9fb58c93ec38eb4d4447bd0ac6f12a6f58d3ad21378d217b6bc14b63014a2: Status 404 returned error can't find the container with id 10c9fb58c93ec38eb4d4447bd0ac6f12a6f58d3ad21378d217b6bc14b63014a2
Jul 06 12:58:26.057283 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:26.057251    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1cbeef7e-bbc5-42b9-a50b-7f71e4f3c172-config-file\") pod \"limitador-limitador-54d6d988d5-t4l6g\" (UID: \"1cbeef7e-bbc5-42b9-a50b-7f71e4f3c172\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"
Jul 06 12:58:26.057424 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:26.057292    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsfc4\" (UniqueName: \"kubernetes.io/projected/1cbeef7e-bbc5-42b9-a50b-7f71e4f3c172-kube-api-access-bsfc4\") pod \"limitador-limitador-54d6d988d5-t4l6g\" (UID: \"1cbeef7e-bbc5-42b9-a50b-7f71e4f3c172\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"
Jul 06 12:58:26.158424 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:26.158334    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1cbeef7e-bbc5-42b9-a50b-7f71e4f3c172-config-file\") pod \"limitador-limitador-54d6d988d5-t4l6g\" (UID: \"1cbeef7e-bbc5-42b9-a50b-7f71e4f3c172\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"
Jul 06 12:58:26.158424 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:26.158381    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsfc4\" (UniqueName: \"kubernetes.io/projected/1cbeef7e-bbc5-42b9-a50b-7f71e4f3c172-kube-api-access-bsfc4\") pod \"limitador-limitador-54d6d988d5-t4l6g\" (UID: \"1cbeef7e-bbc5-42b9-a50b-7f71e4f3c172\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"
Jul 06 12:58:26.158985 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:26.158966    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1cbeef7e-bbc5-42b9-a50b-7f71e4f3c172-config-file\") pod \"limitador-limitador-54d6d988d5-t4l6g\" (UID: \"1cbeef7e-bbc5-42b9-a50b-7f71e4f3c172\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"
Jul 06 12:58:26.166870 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:26.166833    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsfc4\" (UniqueName: \"kubernetes.io/projected/1cbeef7e-bbc5-42b9-a50b-7f71e4f3c172-kube-api-access-bsfc4\") pod \"limitador-limitador-54d6d988d5-t4l6g\" (UID: \"1cbeef7e-bbc5-42b9-a50b-7f71e4f3c172\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"
Jul 06 12:58:26.238234 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:26.238201    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"
Jul 06 12:58:26.370412 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:26.370379    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 12:58:26.373250 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:58:26.373220    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cbeef7e_bbc5_42b9_a50b_7f71e4f3c172.slice/crio-5031a1b5d3a815bbdabc33e319b5f07051f9ff678a377680193b4790217d69c0 WatchSource:0}: Error finding container 5031a1b5d3a815bbdabc33e319b5f07051f9ff678a377680193b4790217d69c0: Status 404 returned error can't find the container with id 5031a1b5d3a815bbdabc33e319b5f07051f9ff678a377680193b4790217d69c0
Jul 06 12:58:26.401340 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:26.401319    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:58:26.480406 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:26.480324    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:58:26.562885 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:26.562832    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-t4l6g" event={"ID":"1cbeef7e-bbc5-42b9-a50b-7f71e4f3c172","Type":"ContainerStarted","Data":"5031a1b5d3a815bbdabc33e319b5f07051f9ff678a377680193b4790217d69c0"}
Jul 06 12:58:26.563971 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:26.563946    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-c7c49" event={"ID":"70b589f4-5092-4395-a0e1-db4ac25d74c5","Type":"ContainerStarted","Data":"10c9fb58c93ec38eb4d4447bd0ac6f12a6f58d3ad21378d217b6bc14b63014a2"}
Jul 06 12:58:29.581039 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:29.580998    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-t4l6g" event={"ID":"1cbeef7e-bbc5-42b9-a50b-7f71e4f3c172","Type":"ContainerStarted","Data":"ae79249420b1686e717c9446e42443da3183e09f73561ce2c01bf0464a410ee8"}
Jul 06 12:58:29.581473 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:29.581096    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"
Jul 06 12:58:29.582397 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:29.582377    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-c7c49" event={"ID":"70b589f4-5092-4395-a0e1-db4ac25d74c5","Type":"ContainerStarted","Data":"b4e16cb22b95cee7f6b70af5fd1744302378ef4a88096fcec1cfcc5d9e7a89c8"}
Jul 06 12:58:29.582517 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:29.582425    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-c7c49"
Jul 06 12:58:29.612514 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:29.612473    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-t4l6g" podStartSLOduration=2.021313616 podStartE2EDuration="4.612460302s" totalImagesPullingTime="2.591146686s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:58:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:58:29.612288225 +0000 UTC m=+686.481175882" watchObservedRunningTime="2026-07-06 12:58:29.612460302 +0000 UTC m=+686.481348007"
Jul 06 12:58:29.639455 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:29.639417    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-c7c49" podStartSLOduration=1.6673821659999999 podStartE2EDuration="4.639405294s" totalImagesPullingTime="2.972023128s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:58:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:58:29.638170235 +0000 UTC m=+686.507057894" watchObservedRunningTime="2026-07-06 12:58:29.639405294 +0000 UTC m=+686.508292951"
Jul 06 12:58:40.589532 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:40.589498    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-c7c49"
Jul 06 12:58:40.590021 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:40.589648    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"
Jul 06 12:58:40.666966 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:40.666934    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-c7c49"]
Jul 06 12:58:40.667127 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:40.667110    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-c7c49" podUID="70b589f4-5092-4395-a0e1-db4ac25d74c5" containerName="limitador" containerID="cri-o://b4e16cb22b95cee7f6b70af5fd1744302378ef4a88096fcec1cfcc5d9e7a89c8" gracePeriod=30
Jul 06 12:58:41.217408 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:41.217383    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-c7c49"
Jul 06 12:58:41.281083 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:41.281052    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/70b589f4-5092-4395-a0e1-db4ac25d74c5-config-file\") pod \"70b589f4-5092-4395-a0e1-db4ac25d74c5\" (UID: \"70b589f4-5092-4395-a0e1-db4ac25d74c5\") "
Jul 06 12:58:41.281225 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:41.281109    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wzl4b\" (UniqueName: \"kubernetes.io/projected/70b589f4-5092-4395-a0e1-db4ac25d74c5-kube-api-access-wzl4b\") pod \"70b589f4-5092-4395-a0e1-db4ac25d74c5\" (UID: \"70b589f4-5092-4395-a0e1-db4ac25d74c5\") "
Jul 06 12:58:41.281400 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:41.281376    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70b589f4-5092-4395-a0e1-db4ac25d74c5-config-file" (OuterVolumeSpecName: "config-file") pod "70b589f4-5092-4395-a0e1-db4ac25d74c5" (UID: "70b589f4-5092-4395-a0e1-db4ac25d74c5"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 12:58:41.283065 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:41.283047    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70b589f4-5092-4395-a0e1-db4ac25d74c5-kube-api-access-wzl4b" (OuterVolumeSpecName: "kube-api-access-wzl4b") pod "70b589f4-5092-4395-a0e1-db4ac25d74c5" (UID: "70b589f4-5092-4395-a0e1-db4ac25d74c5"). InnerVolumeSpecName "kube-api-access-wzl4b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 12:58:41.382382 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:41.382350    2579 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/70b589f4-5092-4395-a0e1-db4ac25d74c5-config-file\") on node \"ip-10-0-129-126.ec2.internal\" DevicePath \"\""
Jul 06 12:58:41.382382 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:41.382375    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wzl4b\" (UniqueName: \"kubernetes.io/projected/70b589f4-5092-4395-a0e1-db4ac25d74c5-kube-api-access-wzl4b\") on node \"ip-10-0-129-126.ec2.internal\" DevicePath \"\""
Jul 06 12:58:41.638676 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:41.638587    2579 generic.go:356] "Generic (PLEG): container finished" podID="70b589f4-5092-4395-a0e1-db4ac25d74c5" containerID="b4e16cb22b95cee7f6b70af5fd1744302378ef4a88096fcec1cfcc5d9e7a89c8" exitCode=0
Jul 06 12:58:41.638676 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:41.638634    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-c7c49"
Jul 06 12:58:41.639105 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:41.638679    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-c7c49" event={"ID":"70b589f4-5092-4395-a0e1-db4ac25d74c5","Type":"ContainerDied","Data":"b4e16cb22b95cee7f6b70af5fd1744302378ef4a88096fcec1cfcc5d9e7a89c8"}
Jul 06 12:58:41.639105 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:41.638735    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-c7c49" event={"ID":"70b589f4-5092-4395-a0e1-db4ac25d74c5","Type":"ContainerDied","Data":"10c9fb58c93ec38eb4d4447bd0ac6f12a6f58d3ad21378d217b6bc14b63014a2"}
Jul 06 12:58:41.639105 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:41.638757    2579 scope.go:117] "RemoveContainer" containerID="b4e16cb22b95cee7f6b70af5fd1744302378ef4a88096fcec1cfcc5d9e7a89c8"
Jul 06 12:58:41.646975 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:41.646958    2579 scope.go:117] "RemoveContainer" containerID="b4e16cb22b95cee7f6b70af5fd1744302378ef4a88096fcec1cfcc5d9e7a89c8"
Jul 06 12:58:41.647229 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:58:41.647208    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4e16cb22b95cee7f6b70af5fd1744302378ef4a88096fcec1cfcc5d9e7a89c8\": container with ID starting with b4e16cb22b95cee7f6b70af5fd1744302378ef4a88096fcec1cfcc5d9e7a89c8 not found: ID does not exist" containerID="b4e16cb22b95cee7f6b70af5fd1744302378ef4a88096fcec1cfcc5d9e7a89c8"
Jul 06 12:58:41.647297 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:41.647242    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4e16cb22b95cee7f6b70af5fd1744302378ef4a88096fcec1cfcc5d9e7a89c8"} err="failed to get container status \"b4e16cb22b95cee7f6b70af5fd1744302378ef4a88096fcec1cfcc5d9e7a89c8\": rpc error: code = NotFound desc = could not find container \"b4e16cb22b95cee7f6b70af5fd1744302378ef4a88096fcec1cfcc5d9e7a89c8\": container with ID starting with b4e16cb22b95cee7f6b70af5fd1744302378ef4a88096fcec1cfcc5d9e7a89c8 not found: ID does not exist"
Jul 06 12:58:41.662208 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:41.662185    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-c7c49"]
Jul 06 12:58:41.667746 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:41.667728    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-c7c49"]
Jul 06 12:58:43.653586 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:43.653553    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70b589f4-5092-4395-a0e1-db4ac25d74c5" path="/var/lib/kubelet/pods/70b589f4-5092-4395-a0e1-db4ac25d74c5/volumes"
Jul 06 12:58:47.211483 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:47.211447    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-2n4tj"]
Jul 06 12:58:47.211875 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:47.211760    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70b589f4-5092-4395-a0e1-db4ac25d74c5" containerName="limitador"
Jul 06 12:58:47.211875 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:47.211770    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="70b589f4-5092-4395-a0e1-db4ac25d74c5" containerName="limitador"
Jul 06 12:58:47.211875 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:47.211865    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="70b589f4-5092-4395-a0e1-db4ac25d74c5" containerName="limitador"
Jul 06 12:58:47.216252 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:47.216232    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-2n4tj"
Jul 06 12:58:47.219708 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:58:47.219674    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"postgres-69fb4594cf-2n4tj\" is forbidden: User \"system:node:ip-10-0-129-126.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-129-126.ec2.internal' and this object" podUID="222592d2-8e0d-45f6-83ec-67a6dcf07d3c" pod="opendatahub/postgres-69fb4594cf-2n4tj"
Jul 06 12:58:47.220966 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:58:47.220936    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"postgres-creds\" is forbidden: User \"system:node:ip-10-0-129-126.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-129-126.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"postgres-creds\"" type="*v1.Secret"
Jul 06 12:58:47.221300 ip-10-0-129-126 kubenswrapper[2579]: E0706 12:58:47.221270    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"default-dockercfg-fr2d5\" is forbidden: User \"system:node:ip-10-0-129-126.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-129-126.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"default-dockercfg-fr2d5\"" type="*v1.Secret"
Jul 06 12:58:47.232443 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:47.232413    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/222592d2-8e0d-45f6-83ec-67a6dcf07d3c-data\") pod \"postgres-69fb4594cf-2n4tj\" (UID: \"222592d2-8e0d-45f6-83ec-67a6dcf07d3c\") " pod="opendatahub/postgres-69fb4594cf-2n4tj"
Jul 06 12:58:47.232575 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:47.232450    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88mdx\" (UniqueName: \"kubernetes.io/projected/222592d2-8e0d-45f6-83ec-67a6dcf07d3c-kube-api-access-88mdx\") pod \"postgres-69fb4594cf-2n4tj\" (UID: \"222592d2-8e0d-45f6-83ec-67a6dcf07d3c\") " pod="opendatahub/postgres-69fb4594cf-2n4tj"
Jul 06 12:58:47.242208 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:47.242177    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-2n4tj"]
Jul 06 12:58:47.273040 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:47.273005    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:58:47.332913 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:47.332876    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/222592d2-8e0d-45f6-83ec-67a6dcf07d3c-data\") pod \"postgres-69fb4594cf-2n4tj\" (UID: \"222592d2-8e0d-45f6-83ec-67a6dcf07d3c\") " pod="opendatahub/postgres-69fb4594cf-2n4tj"
Jul 06 12:58:47.332913 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:47.332911    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88mdx\" (UniqueName: \"kubernetes.io/projected/222592d2-8e0d-45f6-83ec-67a6dcf07d3c-kube-api-access-88mdx\") pod \"postgres-69fb4594cf-2n4tj\" (UID: \"222592d2-8e0d-45f6-83ec-67a6dcf07d3c\") " pod="opendatahub/postgres-69fb4594cf-2n4tj"
Jul 06 12:58:47.333298 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:47.333276    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/222592d2-8e0d-45f6-83ec-67a6dcf07d3c-data\") pod \"postgres-69fb4594cf-2n4tj\" (UID: \"222592d2-8e0d-45f6-83ec-67a6dcf07d3c\") " pod="opendatahub/postgres-69fb4594cf-2n4tj"
Jul 06 12:58:47.342280 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:47.342255    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-88mdx\" (UniqueName: \"kubernetes.io/projected/222592d2-8e0d-45f6-83ec-67a6dcf07d3c-kube-api-access-88mdx\") pod \"postgres-69fb4594cf-2n4tj\" (UID: \"222592d2-8e0d-45f6-83ec-67a6dcf07d3c\") " pod="opendatahub/postgres-69fb4594cf-2n4tj"
Jul 06 12:58:48.085401 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:48.085367    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\""
Jul 06 12:58:48.515536 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:48.515509    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-fr2d5\""
Jul 06 12:58:48.516496 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:48.516479    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-2n4tj"
Jul 06 12:58:48.659976 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:48.659950    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-2n4tj"]
Jul 06 12:58:48.661678 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:58:48.661646    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod222592d2_8e0d_45f6_83ec_67a6dcf07d3c.slice/crio-d38f8ee65953f97bdb49b04387f5982239c7af7c641fefa8ac8a37ea37e1d832 WatchSource:0}: Error finding container d38f8ee65953f97bdb49b04387f5982239c7af7c641fefa8ac8a37ea37e1d832: Status 404 returned error can't find the container with id d38f8ee65953f97bdb49b04387f5982239c7af7c641fefa8ac8a37ea37e1d832
Jul 06 12:58:48.670194 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:48.670160    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-2n4tj" event={"ID":"222592d2-8e0d-45f6-83ec-67a6dcf07d3c","Type":"ContainerStarted","Data":"d38f8ee65953f97bdb49b04387f5982239c7af7c641fefa8ac8a37ea37e1d832"}
Jul 06 12:58:53.703652 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:53.703565    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-2n4tj" event={"ID":"222592d2-8e0d-45f6-83ec-67a6dcf07d3c","Type":"ContainerStarted","Data":"aabbb35c2c64ae20eea3bd09d64840aecb0c70f57d607088786bf49de4bb7cbb"}
Jul 06 12:58:53.704015 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:53.703692    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-2n4tj"
Jul 06 12:58:53.726342 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:53.726291    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-2n4tj" podStartSLOduration=2.033076968 podStartE2EDuration="6.726275828s" totalImagesPullingTime="4.69319886s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:58:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:58:53.725487055 +0000 UTC m=+710.594374717" watchObservedRunningTime="2026-07-06 12:58:53.726275828 +0000 UTC m=+710.595163517"
Jul 06 12:58:59.737198 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:58:59.737121    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-2n4tj"
Jul 06 12:59:00.079593 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:59:00.079509    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:59:00.180853 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:59:00.180821    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:59:06.287261 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:59:06.287223    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:59:06.379317 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:59:06.379283    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:59:06.441981 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:59:06.441940    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:59:06.821173 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:59:06.821140    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:59:09.708512 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:59:09.708476    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:59:09.856224 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:59:09.856189    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:59:41.998658 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:59:41.998626    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:59:42.144262 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:59:42.144230    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:59:44.455086 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:59:44.455050    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:59:44.955088 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:59:44.955051    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:59:45.219913 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:59:45.219811    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:59:45.549416 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:59:45.549379    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:59:45.655486 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:59:45.655459    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:59:45.664016 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:59:45.663984    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-9n5pd"]
Jul 06 12:59:45.667424 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:59:45.667408    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-9n5pd"
Jul 06 12:59:45.670278 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:59:45.670256    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 06 12:59:45.679011 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:59:45.678989    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-9n5pd"]
Jul 06 12:59:45.733690 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:59:45.733657    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brwhg\" (UniqueName: \"kubernetes.io/projected/84542219-860f-41c5-ad94-c618456f945f-kube-api-access-brwhg\") pod \"payload-pre-processing-7964457696-9n5pd\" (UID: \"84542219-860f-41c5-ad94-c618456f945f\") " pod="openshift-ingress/payload-pre-processing-7964457696-9n5pd"
Jul 06 12:59:45.733690 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:59:45.733701    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/84542219-860f-41c5-ad94-c618456f945f-plugins-config-volume\") pod \"payload-pre-processing-7964457696-9n5pd\" (UID: \"84542219-860f-41c5-ad94-c618456f945f\") " pod="openshift-ingress/payload-pre-processing-7964457696-9n5pd"
Jul 06 12:59:45.765717 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:59:45.765683    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-bxg76"]
Jul 06 12:59:45.769141 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:59:45.769122    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-bxg76"
Jul 06 12:59:45.773294 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:59:45.773271    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-7ftt9\""
Jul 06 12:59:45.804699 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:59:45.804626    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-bxg76"]
Jul 06 12:59:45.835103 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:59:45.835071    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brwhg\" (UniqueName: \"kubernetes.io/projected/84542219-860f-41c5-ad94-c618456f945f-kube-api-access-brwhg\") pod \"payload-pre-processing-7964457696-9n5pd\" (UID: \"84542219-860f-41c5-ad94-c618456f945f\") " pod="openshift-ingress/payload-pre-processing-7964457696-9n5pd"
Jul 06 12:59:45.835103 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:59:45.835113    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b51cb208-a9ad-4fea-99e7-5e0b29236370-plugins-config-volume\") pod \"payload-processing-58f86c7798-bxg76\" (UID: \"b51cb208-a9ad-4fea-99e7-5e0b29236370\") " pod="openshift-ingress/payload-processing-58f86c7798-bxg76"
Jul 06 12:59:45.835335 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:59:45.835138    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/84542219-860f-41c5-ad94-c618456f945f-plugins-config-volume\") pod \"payload-pre-processing-7964457696-9n5pd\" (UID: \"84542219-860f-41c5-ad94-c618456f945f\") " pod="openshift-ingress/payload-pre-processing-7964457696-9n5pd"
Jul 06 12:59:45.835335 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:59:45.835160    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4g894\" (UniqueName: \"kubernetes.io/projected/b51cb208-a9ad-4fea-99e7-5e0b29236370-kube-api-access-4g894\") pod \"payload-processing-58f86c7798-bxg76\" (UID: \"b51cb208-a9ad-4fea-99e7-5e0b29236370\") " pod="openshift-ingress/payload-processing-58f86c7798-bxg76"
Jul 06 12:59:45.835789 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:59:45.835771    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/84542219-860f-41c5-ad94-c618456f945f-plugins-config-volume\") pod \"payload-pre-processing-7964457696-9n5pd\" (UID: \"84542219-860f-41c5-ad94-c618456f945f\") " pod="openshift-ingress/payload-pre-processing-7964457696-9n5pd"
Jul 06 12:59:45.845808 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:59:45.845773    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-brwhg\" (UniqueName: \"kubernetes.io/projected/84542219-860f-41c5-ad94-c618456f945f-kube-api-access-brwhg\") pod \"payload-pre-processing-7964457696-9n5pd\" (UID: \"84542219-860f-41c5-ad94-c618456f945f\") " pod="openshift-ingress/payload-pre-processing-7964457696-9n5pd"
Jul 06 12:59:45.936156 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:59:45.936125    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4g894\" (UniqueName: \"kubernetes.io/projected/b51cb208-a9ad-4fea-99e7-5e0b29236370-kube-api-access-4g894\") pod \"payload-processing-58f86c7798-bxg76\" (UID: \"b51cb208-a9ad-4fea-99e7-5e0b29236370\") " pod="openshift-ingress/payload-processing-58f86c7798-bxg76"
Jul 06 12:59:45.936337 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:59:45.936206    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b51cb208-a9ad-4fea-99e7-5e0b29236370-plugins-config-volume\") pod \"payload-processing-58f86c7798-bxg76\" (UID: \"b51cb208-a9ad-4fea-99e7-5e0b29236370\") " pod="openshift-ingress/payload-processing-58f86c7798-bxg76"
Jul 06 12:59:45.936831 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:59:45.936812    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b51cb208-a9ad-4fea-99e7-5e0b29236370-plugins-config-volume\") pod \"payload-processing-58f86c7798-bxg76\" (UID: \"b51cb208-a9ad-4fea-99e7-5e0b29236370\") " pod="openshift-ingress/payload-processing-58f86c7798-bxg76"
Jul 06 12:59:45.940023 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:59:45.939999    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 12:59:45.947379 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:59:45.947353    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4g894\" (UniqueName: \"kubernetes.io/projected/b51cb208-a9ad-4fea-99e7-5e0b29236370-kube-api-access-4g894\") pod \"payload-processing-58f86c7798-bxg76\" (UID: \"b51cb208-a9ad-4fea-99e7-5e0b29236370\") " pod="openshift-ingress/payload-processing-58f86c7798-bxg76"
Jul 06 12:59:45.978202 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:59:45.978162    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-9n5pd"
Jul 06 12:59:46.079232 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:59:46.079174    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-bxg76"
Jul 06 12:59:46.177444 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:59:46.177417    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-9n5pd"]
Jul 06 12:59:46.179529 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:59:46.179493    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84542219_860f_41c5_ad94_c618456f945f.slice/crio-e2a4a1184c31675fe42800a0e226a5c30ea1dfdbb11bf8399d8a7559e806df7e WatchSource:0}: Error finding container e2a4a1184c31675fe42800a0e226a5c30ea1dfdbb11bf8399d8a7559e806df7e: Status 404 returned error can't find the container with id e2a4a1184c31675fe42800a0e226a5c30ea1dfdbb11bf8399d8a7559e806df7e
Jul 06 12:59:46.181477 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:59:46.181461    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 12:59:46.230987 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:59:46.230965    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-bxg76"]
Jul 06 12:59:46.232587 ip-10-0-129-126 kubenswrapper[2579]: W0706 12:59:46.232562    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb51cb208_a9ad_4fea_99e7_5e0b29236370.slice/crio-16a44f76307aef2cff0cdda886f43d1d78ee7b3f0ed26ace961293383f996469 WatchSource:0}: Error finding container 16a44f76307aef2cff0cdda886f43d1d78ee7b3f0ed26ace961293383f996469: Status 404 returned error can't find the container with id 16a44f76307aef2cff0cdda886f43d1d78ee7b3f0ed26ace961293383f996469
Jul 06 12:59:46.940222 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:59:46.940185    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-9n5pd" event={"ID":"84542219-860f-41c5-ad94-c618456f945f","Type":"ContainerStarted","Data":"e2a4a1184c31675fe42800a0e226a5c30ea1dfdbb11bf8399d8a7559e806df7e"}
Jul 06 12:59:46.941587 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:59:46.941561    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-bxg76" event={"ID":"b51cb208-a9ad-4fea-99e7-5e0b29236370","Type":"ContainerStarted","Data":"16a44f76307aef2cff0cdda886f43d1d78ee7b3f0ed26ace961293383f996469"}
Jul 06 12:59:47.948555 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:59:47.948461    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-9n5pd" event={"ID":"84542219-860f-41c5-ad94-c618456f945f","Type":"ContainerStarted","Data":"06c79f72f44f72d0eb602b2ba02769463c943b6739a87599bbb51924ed154e07"}
Jul 06 12:59:47.949018 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:59:47.948724    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-9n5pd"
Jul 06 12:59:47.949862 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:59:47.949819    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-bxg76" event={"ID":"b51cb208-a9ad-4fea-99e7-5e0b29236370","Type":"ContainerStarted","Data":"7abbbbce741bb1bcf9acf78225e36fc7d08f7ecc192cf5e55b327506873f657f"}
Jul 06 12:59:47.949949 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:59:47.949882    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-bxg76"
Jul 06 12:59:47.972296 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:59:47.972246    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-9n5pd" podStartSLOduration=1.60385832 podStartE2EDuration="2.972228495s" totalImagesPullingTime="1.368370175s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:59:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:59:47.97165222 +0000 UTC m=+764.840539881" watchObservedRunningTime="2026-07-06 12:59:47.972228495 +0000 UTC m=+764.841116158"
Jul 06 12:59:48.005504 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:59:48.005457    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-bxg76" podStartSLOduration=1.692379452 podStartE2EDuration="3.005442789s" totalImagesPullingTime="1.313063337s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:59:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:59:48.004779975 +0000 UTC m=+764.873667634" watchObservedRunningTime="2026-07-06 12:59:48.005442789 +0000 UTC m=+764.874330447"
Jul 06 12:59:54.994205 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:59:54.994167    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:59:55.076695 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:59:55.076658    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 12:59:58.956511 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:59:58.956481    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-bxg76"
Jul 06 12:59:58.956921 ip-10-0-129-126 kubenswrapper[2579]: I0706 12:59:58.956569    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-9n5pd"
Jul 06 13:00:01.511999 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:00:01.511962    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zkbdh"]
Jul 06 13:00:01.515595 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:00:01.515574    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zkbdh"
Jul 06 13:00:01.519724 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:00:01.519699    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 06 13:00:01.520826 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:00:01.520808    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 06 13:00:01.520959 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:00:01.520831    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-j6ntn\""
Jul 06 13:00:01.520959 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:00:01.520807    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 06 13:00:01.529808 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:00:01.529785    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zkbdh"]
Jul 06 13:00:01.581566 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:00:01.581527    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a0e2e198-2cfd-4369-8a0e-c917acaca45d-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zkbdh\" (UID: \"a0e2e198-2cfd-4369-8a0e-c917acaca45d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zkbdh"
Jul 06 13:00:01.581724 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:00:01.581580    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6hv4\" (UniqueName: \"kubernetes.io/projected/a0e2e198-2cfd-4369-8a0e-c917acaca45d-kube-api-access-m6hv4\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zkbdh\" (UID: \"a0e2e198-2cfd-4369-8a0e-c917acaca45d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zkbdh"
Jul 06 13:00:01.581724 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:00:01.581607    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0e2e198-2cfd-4369-8a0e-c917acaca45d-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zkbdh\" (UID: \"a0e2e198-2cfd-4369-8a0e-c917acaca45d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zkbdh"
Jul 06 13:00:01.581724 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:00:01.581695    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a0e2e198-2cfd-4369-8a0e-c917acaca45d-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zkbdh\" (UID: \"a0e2e198-2cfd-4369-8a0e-c917acaca45d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zkbdh"
Jul 06 13:00:01.581837 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:00:01.581741    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a0e2e198-2cfd-4369-8a0e-c917acaca45d-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zkbdh\" (UID: \"a0e2e198-2cfd-4369-8a0e-c917acaca45d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zkbdh"
Jul 06 13:00:01.581837 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:00:01.581784    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a0e2e198-2cfd-4369-8a0e-c917acaca45d-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zkbdh\" (UID: \"a0e2e198-2cfd-4369-8a0e-c917acaca45d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zkbdh"
Jul 06 13:00:01.594547 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:00:01.594521    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:00:01.682681 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:00:01.682652    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6hv4\" (UniqueName: \"kubernetes.io/projected/a0e2e198-2cfd-4369-8a0e-c917acaca45d-kube-api-access-m6hv4\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zkbdh\" (UID: \"a0e2e198-2cfd-4369-8a0e-c917acaca45d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zkbdh"
Jul 06 13:00:01.682877 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:00:01.682687    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0e2e198-2cfd-4369-8a0e-c917acaca45d-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zkbdh\" (UID: \"a0e2e198-2cfd-4369-8a0e-c917acaca45d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zkbdh"
Jul 06 13:00:01.682877 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:00:01.682832    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a0e2e198-2cfd-4369-8a0e-c917acaca45d-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zkbdh\" (UID: \"a0e2e198-2cfd-4369-8a0e-c917acaca45d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zkbdh"
Jul 06 13:00:01.683036 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:00:01.682914    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a0e2e198-2cfd-4369-8a0e-c917acaca45d-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zkbdh\" (UID: \"a0e2e198-2cfd-4369-8a0e-c917acaca45d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zkbdh"
Jul 06 13:00:01.683036 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:00:01.682943    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a0e2e198-2cfd-4369-8a0e-c917acaca45d-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zkbdh\" (UID: \"a0e2e198-2cfd-4369-8a0e-c917acaca45d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zkbdh"
Jul 06 13:00:01.683036 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:00:01.682997    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a0e2e198-2cfd-4369-8a0e-c917acaca45d-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zkbdh\" (UID: \"a0e2e198-2cfd-4369-8a0e-c917acaca45d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zkbdh"
Jul 06 13:00:01.683661 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:00:01.683624    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0e2e198-2cfd-4369-8a0e-c917acaca45d-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zkbdh\" (UID: \"a0e2e198-2cfd-4369-8a0e-c917acaca45d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zkbdh"
Jul 06 13:00:01.683819 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:00:01.683719    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a0e2e198-2cfd-4369-8a0e-c917acaca45d-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zkbdh\" (UID: \"a0e2e198-2cfd-4369-8a0e-c917acaca45d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zkbdh"
Jul 06 13:00:01.683960 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:00:01.683827    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a0e2e198-2cfd-4369-8a0e-c917acaca45d-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zkbdh\" (UID: \"a0e2e198-2cfd-4369-8a0e-c917acaca45d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zkbdh"
Jul 06 13:00:01.690075 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:00:01.690044    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a0e2e198-2cfd-4369-8a0e-c917acaca45d-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zkbdh\" (UID: \"a0e2e198-2cfd-4369-8a0e-c917acaca45d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zkbdh"
Jul 06 13:00:01.691237 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:00:01.691217    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a0e2e198-2cfd-4369-8a0e-c917acaca45d-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zkbdh\" (UID: \"a0e2e198-2cfd-4369-8a0e-c917acaca45d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zkbdh"
Jul 06 13:00:01.693191 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:00:01.693170    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6hv4\" (UniqueName: \"kubernetes.io/projected/a0e2e198-2cfd-4369-8a0e-c917acaca45d-kube-api-access-m6hv4\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zkbdh\" (UID: \"a0e2e198-2cfd-4369-8a0e-c917acaca45d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zkbdh"
Jul 06 13:00:01.826694 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:00:01.826610    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zkbdh"
Jul 06 13:00:01.971128 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:00:01.970932    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zkbdh"]
Jul 06 13:00:01.973938 ip-10-0-129-126 kubenswrapper[2579]: W0706 13:00:01.973913    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0e2e198_2cfd_4369_8a0e_c917acaca45d.slice/crio-6e30b0ddafadac5102eb45b54c3e9e457c72a494e71b2cda3e9fb7435e63cb13 WatchSource:0}: Error finding container 6e30b0ddafadac5102eb45b54c3e9e457c72a494e71b2cda3e9fb7435e63cb13: Status 404 returned error can't find the container with id 6e30b0ddafadac5102eb45b54c3e9e457c72a494e71b2cda3e9fb7435e63cb13
Jul 06 13:00:02.017229 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:00:02.017198    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zkbdh" event={"ID":"a0e2e198-2cfd-4369-8a0e-c917acaca45d","Type":"ContainerStarted","Data":"6e30b0ddafadac5102eb45b54c3e9e457c72a494e71b2cda3e9fb7435e63cb13"}
Jul 06 13:00:02.134733 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:00:02.134658    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:00:13.253495 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:00:13.253464    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:00:13.822261 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:00:13.822232    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:00:15.078016 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:00:15.077974    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zkbdh" event={"ID":"a0e2e198-2cfd-4369-8a0e-c917acaca45d","Type":"ContainerStarted","Data":"6d215de2939f513c8edae63859a82d04b2857e165ded528d1fc5609e31a99fc4"}
Jul 06 13:00:15.099301 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:00:15.099253    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zkbdh" podStartSLOduration=1.794407136 podStartE2EDuration="14.099238466s" totalImagesPullingTime="12.30483133s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:00:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:00:15.098023479 +0000 UTC m=+791.966911141" watchObservedRunningTime="2026-07-06 13:00:15.099238466 +0000 UTC m=+791.968126124"
Jul 06 13:00:21.827638 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:00:21.827601    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zkbdh"
Jul 06 13:00:21.828253 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:00:21.827672    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zkbdh"
Jul 06 13:00:21.839910 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:00:21.839882    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zkbdh"
Jul 06 13:00:22.120733 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:00:22.120655    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zkbdh"
Jul 06 13:00:35.647106 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:00:35.647029    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:00:36.621195 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:00:36.621165    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:00:50.278042 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:00:50.278012    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:00:51.916458 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:00:51.916422    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:00:55.841398 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:00:55.841366    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:00:57.958022 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:00:57.957986    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:00:58.061751 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:00:58.061717    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:00:58.528771 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:00:58.528733    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:01:06.629116 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:01:06.629087    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:01:08.016461 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:01:08.016427    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:01:10.227269 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:01:10.227232    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:01:56.276372 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:01:56.276299    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:01:56.381033 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:01:56.381006    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:01:57.525597 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:01:57.525562    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:01:57.681469 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:01:57.681437    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:02:35.735308 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:02:35.735259    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:02:45.432462 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:02:45.432413    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:02:56.934784 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:02:56.934744    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:02:58.209695 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:02:58.209660    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:03:05.724417 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:03:05.724380    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:03:14.588184 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:03:14.588139    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:03:15.528191 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:03:15.528154    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:03:16.090865 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:03:16.090811    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:03:18.734023 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:03:18.733988    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:03:20.632113 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:03:20.632077    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:03:44.820411 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:03:44.820363    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:03:56.415464 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:03:56.415426    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:04:01.392278 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:04:01.392239    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:04:01.495687 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:04:01.495644    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:04:01.626994 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:04:01.626959    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:04:01.731292 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:04:01.731213    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:04:08.446544 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:04:08.446473    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:04:08.560322 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:04:08.560293    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:04:08.691792 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:04:08.691758    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:04:08.811672 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:04:08.811635    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:04:15.054017 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:04:15.053957    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:04:15.153940 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:04:15.153910    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:04:31.749412 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:04:31.749378    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:04:38.828142 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:04:38.828106    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:04:48.527826 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:04:48.527788    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:04:55.516866 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:04:55.516812    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:05:05.943754 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:05:05.943683    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:05:17.620806 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:05:17.620769    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:05:28.431305 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:05:28.431273    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:05:37.526473 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:05:37.526439    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:05:48.183084 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:05:48.183055    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:06:01.233478 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:06:01.233441    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:06:10.541110 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:06:10.541075    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:06:36.199911 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:06:36.199811    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:06:47.570520 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:06:47.570488    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:07:04.096020 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:07:04.095985    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:07:13.740360 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:07:13.740326    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:07:23.629960 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:07:23.629922    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:07:32.530589 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:07:32.530551    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:07:43.029061 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:07:43.029025    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:09:33.222605 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:09:33.222516    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:09:39.731467 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:09:39.731438    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:09:41.247550 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:09:41.247513    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:09:42.120898 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:09:42.120869    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:09:54.917212 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:09:54.917178    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:10:06.838735 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:10:06.838704    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:10:18.058334 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:10:18.058300    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:10:28.377510 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:10:28.377475    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:10:37.743925 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:10:37.743889    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:10:48.327452 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:10:48.327413    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:10:59.551772 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:10:59.551675    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:11:07.321831 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:11:07.321795    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:11:17.433718 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:11:17.433686    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:11:27.356287 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:11:27.356254    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:11:45.576177 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:11:45.576142    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:11:54.493756 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:11:54.493721    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:12:05.747811 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:12:05.747775    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:12:15.035280 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:12:15.035245    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:12:31.344006 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:12:31.343969    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:12:40.449774 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:12:40.449739    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:12:49.647583 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:12:49.647546    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:13:00.043963 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:13:00.043922    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:13:08.567443 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:13:08.567410    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:13:18.746873 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:13:18.746309    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:13:31.630760 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:13:31.630721    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:13:40.837595 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:13:40.837561    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:13:50.278313 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:13:50.278280    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:14:01.230361 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:14:01.230284    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:14:13.966505 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:14:13.966463    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:14:21.432211 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:14:21.432178    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:14:32.264973 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:14:32.264936    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:14:42.834060 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:14:42.834028    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:14:52.062787 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:14:52.062755    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:14:53.626007 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:14:53.625973    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:14:55.363223 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:14:55.363161    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:15:00.135242 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:15:00.135209    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29722395-vgbw9"]
Jul 06 13:15:00.138583 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:15:00.138568    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722395-vgbw9"
Jul 06 13:15:00.143677 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:15:00.143657    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-5pfrb\""
Jul 06 13:15:00.160522 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:15:00.160502    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722395-vgbw9"]
Jul 06 13:15:00.162164 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:15:00.162144    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hfnj\" (UniqueName: \"kubernetes.io/projected/4d106846-2abc-4159-a164-eb42af40a20c-kube-api-access-7hfnj\") pod \"maas-api-key-cleanup-29722395-vgbw9\" (UID: \"4d106846-2abc-4159-a164-eb42af40a20c\") " pod="opendatahub/maas-api-key-cleanup-29722395-vgbw9"
Jul 06 13:15:00.262756 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:15:00.262722    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hfnj\" (UniqueName: \"kubernetes.io/projected/4d106846-2abc-4159-a164-eb42af40a20c-kube-api-access-7hfnj\") pod \"maas-api-key-cleanup-29722395-vgbw9\" (UID: \"4d106846-2abc-4159-a164-eb42af40a20c\") " pod="opendatahub/maas-api-key-cleanup-29722395-vgbw9"
Jul 06 13:15:00.271806 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:15:00.271781    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hfnj\" (UniqueName: \"kubernetes.io/projected/4d106846-2abc-4159-a164-eb42af40a20c-kube-api-access-7hfnj\") pod \"maas-api-key-cleanup-29722395-vgbw9\" (UID: \"4d106846-2abc-4159-a164-eb42af40a20c\") " pod="opendatahub/maas-api-key-cleanup-29722395-vgbw9"
Jul 06 13:15:00.448667 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:15:00.448592    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722395-vgbw9"
Jul 06 13:15:00.579477 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:15:00.579454    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722395-vgbw9"]
Jul 06 13:15:00.581529 ip-10-0-129-126 kubenswrapper[2579]: W0706 13:15:00.581499    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d106846_2abc_4159_a164_eb42af40a20c.slice/crio-22b2ce9bf55389443a086ad24ae48cfbb2f17ad8420a4fb63d3e0deb54765651 WatchSource:0}: Error finding container 22b2ce9bf55389443a086ad24ae48cfbb2f17ad8420a4fb63d3e0deb54765651: Status 404 returned error can't find the container with id 22b2ce9bf55389443a086ad24ae48cfbb2f17ad8420a4fb63d3e0deb54765651
Jul 06 13:15:00.583369 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:15:00.583353    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 13:15:01.097782 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:15:01.097749    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722395-vgbw9" event={"ID":"4d106846-2abc-4159-a164-eb42af40a20c","Type":"ContainerStarted","Data":"22b2ce9bf55389443a086ad24ae48cfbb2f17ad8420a4fb63d3e0deb54765651"}
Jul 06 13:15:01.764571 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:15:01.764538    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:15:03.117036 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:15:03.116985    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722395-vgbw9" event={"ID":"4d106846-2abc-4159-a164-eb42af40a20c","Type":"ContainerStarted","Data":"b94fd77312d3cf8b7c67d948b24f95a9ad4020be85a18ceec99636edd6e00602"}
Jul 06 13:15:03.134292 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:15:03.134248    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29722395-vgbw9" podStartSLOduration=0.962486462 podStartE2EDuration="3.134231802s" totalImagesPullingTime="2.17174534s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:15:03.134092828 +0000 UTC m=+1680.002980487" watchObservedRunningTime="2026-07-06 13:15:03.134231802 +0000 UTC m=+1680.003119463"
Jul 06 13:15:04.122545 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:15:04.122513    2579 generic.go:356] "Generic (PLEG): container finished" podID="4d106846-2abc-4159-a164-eb42af40a20c" containerID="b94fd77312d3cf8b7c67d948b24f95a9ad4020be85a18ceec99636edd6e00602" exitCode=0
Jul 06 13:15:04.122939 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:15:04.122549    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722395-vgbw9" event={"ID":"4d106846-2abc-4159-a164-eb42af40a20c","Type":"ContainerDied","Data":"b94fd77312d3cf8b7c67d948b24f95a9ad4020be85a18ceec99636edd6e00602"}
Jul 06 13:15:05.261209 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:15:05.261183    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722395-vgbw9"
Jul 06 13:15:05.306635 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:15:05.306606    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7hfnj\" (UniqueName: \"kubernetes.io/projected/4d106846-2abc-4159-a164-eb42af40a20c-kube-api-access-7hfnj\") pod \"4d106846-2abc-4159-a164-eb42af40a20c\" (UID: \"4d106846-2abc-4159-a164-eb42af40a20c\") "
Jul 06 13:15:05.308704 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:15:05.308681    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d106846-2abc-4159-a164-eb42af40a20c-kube-api-access-7hfnj" (OuterVolumeSpecName: "kube-api-access-7hfnj") pod "4d106846-2abc-4159-a164-eb42af40a20c" (UID: "4d106846-2abc-4159-a164-eb42af40a20c"). InnerVolumeSpecName "kube-api-access-7hfnj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 13:15:05.408035 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:15:05.407968    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7hfnj\" (UniqueName: \"kubernetes.io/projected/4d106846-2abc-4159-a164-eb42af40a20c-kube-api-access-7hfnj\") on node \"ip-10-0-129-126.ec2.internal\" DevicePath \"\""
Jul 06 13:15:05.821983 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:15:05.821954    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:15:06.134527 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:15:06.134502    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722395-vgbw9"
Jul 06 13:15:06.134692 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:15:06.134495    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722395-vgbw9" event={"ID":"4d106846-2abc-4159-a164-eb42af40a20c","Type":"ContainerDied","Data":"22b2ce9bf55389443a086ad24ae48cfbb2f17ad8420a4fb63d3e0deb54765651"}
Jul 06 13:15:06.134692 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:15:06.134653    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="22b2ce9bf55389443a086ad24ae48cfbb2f17ad8420a4fb63d3e0deb54765651"
Jul 06 13:15:10.029986 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:15:10.029928    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:15:14.327507 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:15:14.327476    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:15:15.284315 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:15:15.284279    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:15:18.400960 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:15:18.400932    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:15:18.510005 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:15:18.509963    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:15:18.894532 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:15:18.894499    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:15:23.540533 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:15:23.540502    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:15:26.037921 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:15:26.037834    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:15:26.149861 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:15:26.149813    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:15:26.309618 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:15:26.309539    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:15:26.408522 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:15:26.408489    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:15:27.531956 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:15:27.531925    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:15:27.687559 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:15:27.687527    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:15:27.808874 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:15:27.808785    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:15:28.060819 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:15:28.060740    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:15:28.456087 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:15:28.456001    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:15:28.565715 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:15:28.565682    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:15:30.144727 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:15:30.144702    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:15:31.338283 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:15:31.338250    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:15:32.545798 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:15:32.545760    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:15:32.770759 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:15:32.770733    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:15:32.892837 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:15:32.892749    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:15:33.003561 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:15:33.003523    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:15:34.623643 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:15:34.623606    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:15:39.415531 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:15:39.415484    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:15:39.526207 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:15:39.526162    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:15:39.790807 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:15:39.790780    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:15:39.897182 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:15:39.897145    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:15:40.859356 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:15:40.859307    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:15:40.969501 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:15:40.969471    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:15:41.088032 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:15:41.087995    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:15:41.712260 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:15:41.712226    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:15:41.909806 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:15:41.909768    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:15:42.808166 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:15:42.808133    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:15:43.632123 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:15:43.632091    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:15:46.045161 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:15:46.045128    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:15:46.456280 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:15:46.456203    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:15:52.129486 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:15:52.129454    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:15:52.242857 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:15:52.242817    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:15:54.636566 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:15:54.636527    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:15:58.576802 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:15:58.576770    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:15:58.776118 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:15:58.776086    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:15:58.901423 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:15:58.901341    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:15:59.536634 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:15:59.536600    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:15:59.631160 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:15:59.631126    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:16:00.030247 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:16:00.030215    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:16:00.174114 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:16:00.174078    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:16:00.283085 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:16:00.283000    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:16:00.590892 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:16:00.590803    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:16:01.047196 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:16:01.047168    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:16:01.174760 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:16:01.174726    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:16:03.638202 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:16:03.638172    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:16:03.831096 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:16:03.831062    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:16:04.398707 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:16:04.398677    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:16:04.965160 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:16:04.965123    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:16:05.081944 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:16:05.081904    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:16:05.183833 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:16:05.183799    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:16:06.328687 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:16:06.328653    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:16:11.472736 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:16:11.472703    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:16:11.612714 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:16:11.612666    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:16:11.990070 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:16:11.990028    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:16:12.109087 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:16:12.109035    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:16:13.692990 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:16:13.692950    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:16:15.961412 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:16:15.961377    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:16:21.709437 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:16:21.709400    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:16:21.968412 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:16:21.968326    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:16:22.121783 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:16:22.121747    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:16:22.731668 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:16:22.731641    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:16:48.770155 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:16:48.770123    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:16:55.344649 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:16:55.344618    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:16:55.475806 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:16:55.475770    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:16:55.570477 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:16:55.570449    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:17:11.596071 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:17:11.596037    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:17:18.592215 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:17:18.592162    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:17:18.791050 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:17:18.791012    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:17:18.934106 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:17:18.934030    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:17:29.425182 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:17:29.425153    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:17:30.307381 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:17:30.307346    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:17:37.454035 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:17:37.453993    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:17:37.606482 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:17:37.606454    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:17:37.763490 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:17:37.763449    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:17:37.918976 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:17:37.918944    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:17:38.907553 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:17:38.907523    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:17:39.074530 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:17:39.074486    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:17:40.093574 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:17:40.093545    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:17:41.104116 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:17:41.104070    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:17:47.205155 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:17:47.205118    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:17:48.322708 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:17:48.322673    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:17:48.444608 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:17:48.444574    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:17:49.073805 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:17:49.073752    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:17:54.850607 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:17:54.850567    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:17:55.996025 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:17:55.995993    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:17:56.111899 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:17:56.111863    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:17:56.287078 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:17:56.286983    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:17:56.701813 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:17:56.701730    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:17:56.809357 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:17:56.809326    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:17:59.930694 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:17:59.930658    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:18:00.120309 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:18:00.120268    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:18:00.503342 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:18:00.503306    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:18:01.141785 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:18:01.141759    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:18:01.292260 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:18:01.292225    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:18:04.279488 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:18:04.279457    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:18:04.434370 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:18:04.434332    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:18:05.073202 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:18:05.073170    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:18:05.257487 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:18:05.257456    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:18:05.621423 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:18:05.621391    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:18:06.581931 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:18:06.581900    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:18:12.717881 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:18:12.717806    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:18:12.864529 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:18:12.864497    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:18:13.211415 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:18:13.211384    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:18:13.673393 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:18:13.673360    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:18:13.949809 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:18:13.949714    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:18:17.055767 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:18:17.055738    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:18:20.418993 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:18:20.418960    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:18:20.545775 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:18:20.545746    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:18:20.734636 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:18:20.734604    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:18:20.961123 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:18:20.961094    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:18:21.108643 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:18:21.108555    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:18:21.203976 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:18:21.203945    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:18:21.306082 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:18:21.306052    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:18:27.655749 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:18:27.655661    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:18:27.917745 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:18:27.917669    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:18:28.102648 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:18:28.102611    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:18:34.433516 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:18:34.433481    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:18:34.536174 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:18:34.536140    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:18:41.363638 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:18:41.363601    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:18:41.790646 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:18:41.790618    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:18:42.160813 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:18:42.160739    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:18:44.561607 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:18:44.561575    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:18:44.668223 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:18:44.668197    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:18:45.149905 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:18:45.149871    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:18:45.371553 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:18:45.371518    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:18:45.480089 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:18:45.480011    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:18:46.188712 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:18:46.188670    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:18:46.379099 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:18:46.379068    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:18:49.647677 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:18:49.647645    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:18:51.422201 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:18:51.422167    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:18:58.716737 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:18:58.716705    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-69a5e1cc/e2e-lifecycle-model-69a5e1cc-kserve-dd9bb6cff-99mfx"]
Jul 06 13:18:58.717124 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:18:58.717068    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d106846-2abc-4159-a164-eb42af40a20c" containerName="cleanup"
Jul 06 13:18:58.717124 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:18:58.717080    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d106846-2abc-4159-a164-eb42af40a20c" containerName="cleanup"
Jul 06 13:18:58.717194 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:18:58.717144    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d106846-2abc-4159-a164-eb42af40a20c" containerName="cleanup"
Jul 06 13:18:58.720018 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:18:58.720001    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-69a5e1cc/e2e-lifecycle-model-69a5e1cc-kserve-dd9bb6cff-99mfx"
Jul 06 13:18:58.724637 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:18:58.724615    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-69a5e1cc\"/\"default-dockercfg-qwcxh\""
Jul 06 13:18:58.724763 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:18:58.724677    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-69a5e1cc\"/\"kube-root-ca.crt\""
Jul 06 13:18:58.724763 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:18:58.724693    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-69a5e1cc\"/\"e2e-lifecycle-model-69a5e1cc-kserve-self-signed-certs\""
Jul 06 13:18:58.724763 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:18:58.724707    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-69a5e1cc\"/\"openshift-service-ca.crt\""
Jul 06 13:18:58.739787 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:18:58.739759    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-69a5e1cc/e2e-lifecycle-model-69a5e1cc-kserve-dd9bb6cff-99mfx"]
Jul 06 13:18:58.748490 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:18:58.748440    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:18:58.832441 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:18:58.832395    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/072af8a4-e14c-4f15-ad4f-f35a97c25ac6-home\") pod \"e2e-lifecycle-model-69a5e1cc-kserve-dd9bb6cff-99mfx\" (UID: \"072af8a4-e14c-4f15-ad4f-f35a97c25ac6\") " pod="ai-tenant-e2e-mt-69a5e1cc/e2e-lifecycle-model-69a5e1cc-kserve-dd9bb6cff-99mfx"
Jul 06 13:18:58.832640 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:18:58.832502    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/072af8a4-e14c-4f15-ad4f-f35a97c25ac6-dshm\") pod \"e2e-lifecycle-model-69a5e1cc-kserve-dd9bb6cff-99mfx\" (UID: \"072af8a4-e14c-4f15-ad4f-f35a97c25ac6\") " pod="ai-tenant-e2e-mt-69a5e1cc/e2e-lifecycle-model-69a5e1cc-kserve-dd9bb6cff-99mfx"
Jul 06 13:18:58.832640 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:18:58.832528    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/072af8a4-e14c-4f15-ad4f-f35a97c25ac6-tmp-dir\") pod \"e2e-lifecycle-model-69a5e1cc-kserve-dd9bb6cff-99mfx\" (UID: \"072af8a4-e14c-4f15-ad4f-f35a97c25ac6\") " pod="ai-tenant-e2e-mt-69a5e1cc/e2e-lifecycle-model-69a5e1cc-kserve-dd9bb6cff-99mfx"
Jul 06 13:18:58.832640 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:18:58.832551    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/072af8a4-e14c-4f15-ad4f-f35a97c25ac6-model-cache\") pod \"e2e-lifecycle-model-69a5e1cc-kserve-dd9bb6cff-99mfx\" (UID: \"072af8a4-e14c-4f15-ad4f-f35a97c25ac6\") " pod="ai-tenant-e2e-mt-69a5e1cc/e2e-lifecycle-model-69a5e1cc-kserve-dd9bb6cff-99mfx"
Jul 06 13:18:58.832640 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:18:58.832601    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/072af8a4-e14c-4f15-ad4f-f35a97c25ac6-tls-certs\") pod \"e2e-lifecycle-model-69a5e1cc-kserve-dd9bb6cff-99mfx\" (UID: \"072af8a4-e14c-4f15-ad4f-f35a97c25ac6\") " pod="ai-tenant-e2e-mt-69a5e1cc/e2e-lifecycle-model-69a5e1cc-kserve-dd9bb6cff-99mfx"
Jul 06 13:18:58.832640 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:18:58.832623    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7xtr\" (UniqueName: \"kubernetes.io/projected/072af8a4-e14c-4f15-ad4f-f35a97c25ac6-kube-api-access-z7xtr\") pod \"e2e-lifecycle-model-69a5e1cc-kserve-dd9bb6cff-99mfx\" (UID: \"072af8a4-e14c-4f15-ad4f-f35a97c25ac6\") " pod="ai-tenant-e2e-mt-69a5e1cc/e2e-lifecycle-model-69a5e1cc-kserve-dd9bb6cff-99mfx"
Jul 06 13:18:58.933965 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:18:58.933925    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/072af8a4-e14c-4f15-ad4f-f35a97c25ac6-dshm\") pod \"e2e-lifecycle-model-69a5e1cc-kserve-dd9bb6cff-99mfx\" (UID: \"072af8a4-e14c-4f15-ad4f-f35a97c25ac6\") " pod="ai-tenant-e2e-mt-69a5e1cc/e2e-lifecycle-model-69a5e1cc-kserve-dd9bb6cff-99mfx"
Jul 06 13:18:58.934169 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:18:58.933975    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/072af8a4-e14c-4f15-ad4f-f35a97c25ac6-tmp-dir\") pod \"e2e-lifecycle-model-69a5e1cc-kserve-dd9bb6cff-99mfx\" (UID: \"072af8a4-e14c-4f15-ad4f-f35a97c25ac6\") " pod="ai-tenant-e2e-mt-69a5e1cc/e2e-lifecycle-model-69a5e1cc-kserve-dd9bb6cff-99mfx"
Jul 06 13:18:58.934169 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:18:58.934109    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/072af8a4-e14c-4f15-ad4f-f35a97c25ac6-model-cache\") pod \"e2e-lifecycle-model-69a5e1cc-kserve-dd9bb6cff-99mfx\" (UID: \"072af8a4-e14c-4f15-ad4f-f35a97c25ac6\") " pod="ai-tenant-e2e-mt-69a5e1cc/e2e-lifecycle-model-69a5e1cc-kserve-dd9bb6cff-99mfx"
Jul 06 13:18:58.934299 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:18:58.934181    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/072af8a4-e14c-4f15-ad4f-f35a97c25ac6-tls-certs\") pod \"e2e-lifecycle-model-69a5e1cc-kserve-dd9bb6cff-99mfx\" (UID: \"072af8a4-e14c-4f15-ad4f-f35a97c25ac6\") " pod="ai-tenant-e2e-mt-69a5e1cc/e2e-lifecycle-model-69a5e1cc-kserve-dd9bb6cff-99mfx"
Jul 06 13:18:58.934299 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:18:58.934210    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7xtr\" (UniqueName: \"kubernetes.io/projected/072af8a4-e14c-4f15-ad4f-f35a97c25ac6-kube-api-access-z7xtr\") pod \"e2e-lifecycle-model-69a5e1cc-kserve-dd9bb6cff-99mfx\" (UID: \"072af8a4-e14c-4f15-ad4f-f35a97c25ac6\") " pod="ai-tenant-e2e-mt-69a5e1cc/e2e-lifecycle-model-69a5e1cc-kserve-dd9bb6cff-99mfx"
Jul 06 13:18:58.934299 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:18:58.934285    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/072af8a4-e14c-4f15-ad4f-f35a97c25ac6-home\") pod \"e2e-lifecycle-model-69a5e1cc-kserve-dd9bb6cff-99mfx\" (UID: \"072af8a4-e14c-4f15-ad4f-f35a97c25ac6\") " pod="ai-tenant-e2e-mt-69a5e1cc/e2e-lifecycle-model-69a5e1cc-kserve-dd9bb6cff-99mfx"
Jul 06 13:18:58.934458 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:18:58.934363    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/072af8a4-e14c-4f15-ad4f-f35a97c25ac6-tmp-dir\") pod \"e2e-lifecycle-model-69a5e1cc-kserve-dd9bb6cff-99mfx\" (UID: \"072af8a4-e14c-4f15-ad4f-f35a97c25ac6\") " pod="ai-tenant-e2e-mt-69a5e1cc/e2e-lifecycle-model-69a5e1cc-kserve-dd9bb6cff-99mfx"
Jul 06 13:18:58.934514 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:18:58.934451    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/072af8a4-e14c-4f15-ad4f-f35a97c25ac6-model-cache\") pod \"e2e-lifecycle-model-69a5e1cc-kserve-dd9bb6cff-99mfx\" (UID: \"072af8a4-e14c-4f15-ad4f-f35a97c25ac6\") " pod="ai-tenant-e2e-mt-69a5e1cc/e2e-lifecycle-model-69a5e1cc-kserve-dd9bb6cff-99mfx"
Jul 06 13:18:58.934681 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:18:58.934574    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/072af8a4-e14c-4f15-ad4f-f35a97c25ac6-home\") pod \"e2e-lifecycle-model-69a5e1cc-kserve-dd9bb6cff-99mfx\" (UID: \"072af8a4-e14c-4f15-ad4f-f35a97c25ac6\") " pod="ai-tenant-e2e-mt-69a5e1cc/e2e-lifecycle-model-69a5e1cc-kserve-dd9bb6cff-99mfx"
Jul 06 13:18:58.937032 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:18:58.937010    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/072af8a4-e14c-4f15-ad4f-f35a97c25ac6-dshm\") pod \"e2e-lifecycle-model-69a5e1cc-kserve-dd9bb6cff-99mfx\" (UID: \"072af8a4-e14c-4f15-ad4f-f35a97c25ac6\") " pod="ai-tenant-e2e-mt-69a5e1cc/e2e-lifecycle-model-69a5e1cc-kserve-dd9bb6cff-99mfx"
Jul 06 13:18:58.937419 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:18:58.937395    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/072af8a4-e14c-4f15-ad4f-f35a97c25ac6-tls-certs\") pod \"e2e-lifecycle-model-69a5e1cc-kserve-dd9bb6cff-99mfx\" (UID: \"072af8a4-e14c-4f15-ad4f-f35a97c25ac6\") " pod="ai-tenant-e2e-mt-69a5e1cc/e2e-lifecycle-model-69a5e1cc-kserve-dd9bb6cff-99mfx"
Jul 06 13:18:58.944063 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:18:58.944040    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7xtr\" (UniqueName: \"kubernetes.io/projected/072af8a4-e14c-4f15-ad4f-f35a97c25ac6-kube-api-access-z7xtr\") pod \"e2e-lifecycle-model-69a5e1cc-kserve-dd9bb6cff-99mfx\" (UID: \"072af8a4-e14c-4f15-ad4f-f35a97c25ac6\") " pod="ai-tenant-e2e-mt-69a5e1cc/e2e-lifecycle-model-69a5e1cc-kserve-dd9bb6cff-99mfx"
Jul 06 13:18:59.029721 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:18:59.029682    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-69a5e1cc/e2e-lifecycle-model-69a5e1cc-kserve-dd9bb6cff-99mfx"
Jul 06 13:18:59.189553 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:18:59.189381    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-69a5e1cc/e2e-lifecycle-model-69a5e1cc-kserve-dd9bb6cff-99mfx"]
Jul 06 13:18:59.192308 ip-10-0-129-126 kubenswrapper[2579]: W0706 13:18:59.192277    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod072af8a4_e14c_4f15_ad4f_f35a97c25ac6.slice/crio-03b0d485156d45031d6a0e347284c7ef962cb31467f0b1d190ceca94625dc212 WatchSource:0}: Error finding container 03b0d485156d45031d6a0e347284c7ef962cb31467f0b1d190ceca94625dc212: Status 404 returned error can't find the container with id 03b0d485156d45031d6a0e347284c7ef962cb31467f0b1d190ceca94625dc212
Jul 06 13:19:00.192241 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:19:00.192201    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-69a5e1cc/e2e-lifecycle-model-69a5e1cc-kserve-dd9bb6cff-99mfx" event={"ID":"072af8a4-e14c-4f15-ad4f-f35a97c25ac6","Type":"ContainerStarted","Data":"6f83115710544269c24968619fb21dc4fa30119fb648da42258b2340b6182d6c"}
Jul 06 13:19:00.192241 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:19:00.192242    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-69a5e1cc/e2e-lifecycle-model-69a5e1cc-kserve-dd9bb6cff-99mfx" event={"ID":"072af8a4-e14c-4f15-ad4f-f35a97c25ac6","Type":"ContainerStarted","Data":"03b0d485156d45031d6a0e347284c7ef962cb31467f0b1d190ceca94625dc212"}
Jul 06 13:19:00.212029 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:19:00.211978    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-69a5e1cc/e2e-lifecycle-model-69a5e1cc-kserve-dd9bb6cff-99mfx" podStartSLOduration=2.211961825 podStartE2EDuration="2.211961825s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:18:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:19:00.211422972 +0000 UTC m=+1917.080310631" watchObservedRunningTime="2026-07-06 13:19:00.211961825 +0000 UTC m=+1917.080849484"
Jul 06 13:19:01.342628 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:19:01.342594    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:19:09.030285 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:19:09.030251    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-69a5e1cc/e2e-lifecycle-model-69a5e1cc-kserve-dd9bb6cff-99mfx"
Jul 06 13:19:09.030285 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:19:09.030289    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-69a5e1cc/e2e-lifecycle-model-69a5e1cc-kserve-dd9bb6cff-99mfx"
Jul 06 13:19:09.042801 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:19:09.042774    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-69a5e1cc/e2e-lifecycle-model-69a5e1cc-kserve-dd9bb6cff-99mfx"
Jul 06 13:19:09.246714 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:19:09.246690    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-69a5e1cc/e2e-lifecycle-model-69a5e1cc-kserve-dd9bb6cff-99mfx"
Jul 06 13:19:15.958179 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:19:15.958144    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:19:22.505550 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:19:22.505510    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:19:22.914460 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:19:22.914376    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:19:26.138767 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:19:26.138729    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:19:28.635115 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:19:28.635081    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:19:33.610905 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:19:33.610868    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-69a5e1cc/e2e-lifecycle-model-69a5e1cc-kserve-dd9bb6cff-99mfx"]
Jul 06 13:19:33.704285 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:19:33.704247    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:19:37.945576 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:19:37.945540    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:19:48.631807 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:19:48.631753    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-69a5e1cc/e2e-lifecycle-model-69a5e1cc-kserve-dd9bb6cff-99mfx" podUID="072af8a4-e14c-4f15-ad4f-f35a97c25ac6" containerName="main" containerID="cri-o://6f83115710544269c24968619fb21dc4fa30119fb648da42258b2340b6182d6c" gracePeriod=45
Jul 06 13:19:48.877753 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:19:48.877728    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-69a5e1cc/e2e-lifecycle-model-69a5e1cc-kserve-dd9bb6cff-99mfx"
Jul 06 13:19:48.967590 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:19:48.967513    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/072af8a4-e14c-4f15-ad4f-f35a97c25ac6-model-cache\") pod \"072af8a4-e14c-4f15-ad4f-f35a97c25ac6\" (UID: \"072af8a4-e14c-4f15-ad4f-f35a97c25ac6\") "
Jul 06 13:19:48.967590 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:19:48.967589    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/072af8a4-e14c-4f15-ad4f-f35a97c25ac6-tmp-dir\") pod \"072af8a4-e14c-4f15-ad4f-f35a97c25ac6\" (UID: \"072af8a4-e14c-4f15-ad4f-f35a97c25ac6\") "
Jul 06 13:19:48.967790 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:19:48.967611    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/072af8a4-e14c-4f15-ad4f-f35a97c25ac6-tls-certs\") pod \"072af8a4-e14c-4f15-ad4f-f35a97c25ac6\" (UID: \"072af8a4-e14c-4f15-ad4f-f35a97c25ac6\") "
Jul 06 13:19:48.967790 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:19:48.967630    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/072af8a4-e14c-4f15-ad4f-f35a97c25ac6-dshm\") pod \"072af8a4-e14c-4f15-ad4f-f35a97c25ac6\" (UID: \"072af8a4-e14c-4f15-ad4f-f35a97c25ac6\") "
Jul 06 13:19:48.967790 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:19:48.967657    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/072af8a4-e14c-4f15-ad4f-f35a97c25ac6-home\") pod \"072af8a4-e14c-4f15-ad4f-f35a97c25ac6\" (UID: \"072af8a4-e14c-4f15-ad4f-f35a97c25ac6\") "
Jul 06 13:19:48.967790 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:19:48.967692    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z7xtr\" (UniqueName: \"kubernetes.io/projected/072af8a4-e14c-4f15-ad4f-f35a97c25ac6-kube-api-access-z7xtr\") pod \"072af8a4-e14c-4f15-ad4f-f35a97c25ac6\" (UID: \"072af8a4-e14c-4f15-ad4f-f35a97c25ac6\") "
Jul 06 13:19:48.968025 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:19:48.967791    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/072af8a4-e14c-4f15-ad4f-f35a97c25ac6-model-cache" (OuterVolumeSpecName: "model-cache") pod "072af8a4-e14c-4f15-ad4f-f35a97c25ac6" (UID: "072af8a4-e14c-4f15-ad4f-f35a97c25ac6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 13:19:48.968025 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:19:48.967859    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/072af8a4-e14c-4f15-ad4f-f35a97c25ac6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "072af8a4-e14c-4f15-ad4f-f35a97c25ac6" (UID: "072af8a4-e14c-4f15-ad4f-f35a97c25ac6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 13:19:48.968025 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:19:48.967967    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/072af8a4-e14c-4f15-ad4f-f35a97c25ac6-home" (OuterVolumeSpecName: "home") pod "072af8a4-e14c-4f15-ad4f-f35a97c25ac6" (UID: "072af8a4-e14c-4f15-ad4f-f35a97c25ac6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 13:19:48.968171 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:19:48.968025    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/072af8a4-e14c-4f15-ad4f-f35a97c25ac6-model-cache\") on node \"ip-10-0-129-126.ec2.internal\" DevicePath \"\""
Jul 06 13:19:48.968171 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:19:48.968039    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/072af8a4-e14c-4f15-ad4f-f35a97c25ac6-tmp-dir\") on node \"ip-10-0-129-126.ec2.internal\" DevicePath \"\""
Jul 06 13:19:48.969874 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:19:48.969832    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/072af8a4-e14c-4f15-ad4f-f35a97c25ac6-dshm" (OuterVolumeSpecName: "dshm") pod "072af8a4-e14c-4f15-ad4f-f35a97c25ac6" (UID: "072af8a4-e14c-4f15-ad4f-f35a97c25ac6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 13:19:48.969979 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:19:48.969871    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/072af8a4-e14c-4f15-ad4f-f35a97c25ac6-kube-api-access-z7xtr" (OuterVolumeSpecName: "kube-api-access-z7xtr") pod "072af8a4-e14c-4f15-ad4f-f35a97c25ac6" (UID: "072af8a4-e14c-4f15-ad4f-f35a97c25ac6"). InnerVolumeSpecName "kube-api-access-z7xtr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 13:19:48.969979 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:19:48.969892    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/072af8a4-e14c-4f15-ad4f-f35a97c25ac6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "072af8a4-e14c-4f15-ad4f-f35a97c25ac6" (UID: "072af8a4-e14c-4f15-ad4f-f35a97c25ac6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 13:19:49.068670 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:19:49.068642    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/072af8a4-e14c-4f15-ad4f-f35a97c25ac6-home\") on node \"ip-10-0-129-126.ec2.internal\" DevicePath \"\""
Jul 06 13:19:49.068670 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:19:49.068669    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z7xtr\" (UniqueName: \"kubernetes.io/projected/072af8a4-e14c-4f15-ad4f-f35a97c25ac6-kube-api-access-z7xtr\") on node \"ip-10-0-129-126.ec2.internal\" DevicePath \"\""
Jul 06 13:19:49.068814 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:19:49.068683    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/072af8a4-e14c-4f15-ad4f-f35a97c25ac6-tls-certs\") on node \"ip-10-0-129-126.ec2.internal\" DevicePath \"\""
Jul 06 13:19:49.068814 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:19:49.068696    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/072af8a4-e14c-4f15-ad4f-f35a97c25ac6-dshm\") on node \"ip-10-0-129-126.ec2.internal\" DevicePath \"\""
Jul 06 13:19:49.419404 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:19:49.419367    2579 generic.go:356] "Generic (PLEG): container finished" podID="072af8a4-e14c-4f15-ad4f-f35a97c25ac6" containerID="6f83115710544269c24968619fb21dc4fa30119fb648da42258b2340b6182d6c" exitCode=0
Jul 06 13:19:49.419580 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:19:49.419422    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-69a5e1cc/e2e-lifecycle-model-69a5e1cc-kserve-dd9bb6cff-99mfx"
Jul 06 13:19:49.419580 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:19:49.419435    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-69a5e1cc/e2e-lifecycle-model-69a5e1cc-kserve-dd9bb6cff-99mfx" event={"ID":"072af8a4-e14c-4f15-ad4f-f35a97c25ac6","Type":"ContainerDied","Data":"6f83115710544269c24968619fb21dc4fa30119fb648da42258b2340b6182d6c"}
Jul 06 13:19:49.419580 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:19:49.419476    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-69a5e1cc/e2e-lifecycle-model-69a5e1cc-kserve-dd9bb6cff-99mfx" event={"ID":"072af8a4-e14c-4f15-ad4f-f35a97c25ac6","Type":"ContainerDied","Data":"03b0d485156d45031d6a0e347284c7ef962cb31467f0b1d190ceca94625dc212"}
Jul 06 13:19:49.419580 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:19:49.419498    2579 scope.go:117] "RemoveContainer" containerID="6f83115710544269c24968619fb21dc4fa30119fb648da42258b2340b6182d6c"
Jul 06 13:19:49.430834 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:19:49.430813    2579 scope.go:117] "RemoveContainer" containerID="6f83115710544269c24968619fb21dc4fa30119fb648da42258b2340b6182d6c"
Jul 06 13:19:49.431101 ip-10-0-129-126 kubenswrapper[2579]: E0706 13:19:49.431080    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f83115710544269c24968619fb21dc4fa30119fb648da42258b2340b6182d6c\": container with ID starting with 6f83115710544269c24968619fb21dc4fa30119fb648da42258b2340b6182d6c not found: ID does not exist" containerID="6f83115710544269c24968619fb21dc4fa30119fb648da42258b2340b6182d6c"
Jul 06 13:19:49.431147 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:19:49.431111    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f83115710544269c24968619fb21dc4fa30119fb648da42258b2340b6182d6c"} err="failed to get container status \"6f83115710544269c24968619fb21dc4fa30119fb648da42258b2340b6182d6c\": rpc error: code = NotFound desc = could not find container \"6f83115710544269c24968619fb21dc4fa30119fb648da42258b2340b6182d6c\": container with ID starting with 6f83115710544269c24968619fb21dc4fa30119fb648da42258b2340b6182d6c not found: ID does not exist"
Jul 06 13:19:49.445595 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:19:49.445573    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-69a5e1cc/e2e-lifecycle-model-69a5e1cc-kserve-dd9bb6cff-99mfx"]
Jul 06 13:19:49.449221 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:19:49.449200    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-69a5e1cc/e2e-lifecycle-model-69a5e1cc-kserve-dd9bb6cff-99mfx"]
Jul 06 13:19:49.655457 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:19:49.655418    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="072af8a4-e14c-4f15-ad4f-f35a97c25ac6" path="/var/lib/kubelet/pods/072af8a4-e14c-4f15-ad4f-f35a97c25ac6/volumes"
Jul 06 13:20:11.333007 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:20:11.332972    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:20:12.927799 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:20:12.927767    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:20:13.161562 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:20:13.161537    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:20:18.096327 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:20:18.096293    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:20:18.172310 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:20:18.172279    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:20:18.442117 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:20:18.442035    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:20:18.665744 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:20:18.665715    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:20:19.784158 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:20:19.784130    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:20:19.883806 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:20:19.883778    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:20:19.981889 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:20:19.981860    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:20:20.750515 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:20:20.750489    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:20:20.846943 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:20:20.846913    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:20:20.945769 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:20:20.945743    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:20:22.037948 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:20:22.037915    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:20:22.487487 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:20:22.487453    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:20:29.340699 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:20:29.340664    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:20:29.470182 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:20:29.470151    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:20:30.126586 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:20:30.126554    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:20:32.731662 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:20:32.731628    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:20:36.883956 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:20:36.883925    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:20:36.963580 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:20:36.963550    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:20:37.070673 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:20:37.070646    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:20:37.172559 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:20:37.172495    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:20:47.703800 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:20:47.703766    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:20:48.093893 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:20:48.093865    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:21:09.123667 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:21:09.123629    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:21:15.338833 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:21:15.338799    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:21:15.417942 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:21:15.417910    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:21:15.748128 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:21:15.748097    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:21:16.154605 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:21:16.154514    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:21:16.285350 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:21:16.285319    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:21:18.832866 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:21:18.832812    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:21:18.961486 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:21:18.961455    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:21:19.051368 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:21:19.051343    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:21:19.197456 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:21:19.197380    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:21:19.559338 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:21:19.559307    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:21:19.672612 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:21:19.672585    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:21:23.414853 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:21:23.414815    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:21:23.891790 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:21:23.891763    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:21:24.283791 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:21:24.283765    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:21:24.452378 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:21:24.452346    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:21:24.566659 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:21:24.566594    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:21:26.934656 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:21:26.934571    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:21:27.028139 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:21:27.028108    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:21:27.144496 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:21:27.144464    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:21:27.311220 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:21:27.311191    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:21:27.458390 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:21:27.458362    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:21:27.809790 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:21:27.809750    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:21:27.904313 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:21:27.904283    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:21:31.450504 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:21:31.450477    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:21:38.567247 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:21:38.567214    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:21:41.216751 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:21:41.216719    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:21:41.317712 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:21:41.317681    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:21:42.796791 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:21:42.796757    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-8bf2fb/test-model-8bf2fb-kserve-8548d85dd5-7vln5"]
Jul 06 13:21:42.797169 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:21:42.797123    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="072af8a4-e14c-4f15-ad4f-f35a97c25ac6" containerName="main"
Jul 06 13:21:42.797169 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:21:42.797133    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="072af8a4-e14c-4f15-ad4f-f35a97c25ac6" containerName="main"
Jul 06 13:21:42.797248 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:21:42.797209    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="072af8a4-e14c-4f15-ad4f-f35a97c25ac6" containerName="main"
Jul 06 13:21:42.800410 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:21:42.800392    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-8bf2fb/test-model-8bf2fb-kserve-8548d85dd5-7vln5"
Jul 06 13:21:42.803313 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:21:42.803292    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-8bf2fb\"/\"kube-root-ca.crt\""
Jul 06 13:21:42.803397 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:21:42.803386    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-8bf2fb\"/\"default-dockercfg-kwkld\""
Jul 06 13:21:42.804564 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:21:42.804550    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-8bf2fb\"/\"openshift-service-ca.crt\""
Jul 06 13:21:42.804620 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:21:42.804603    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-8bf2fb\"/\"test-model-8bf2fb-kserve-self-signed-certs\""
Jul 06 13:21:42.814631 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:21:42.814612    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-8bf2fb/test-model-8bf2fb-kserve-8548d85dd5-7vln5"]
Jul 06 13:21:42.904916 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:21:42.904875    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8908a996-219d-4ea7-b3cd-8bea5c72a1f7-tls-certs\") pod \"test-model-8bf2fb-kserve-8548d85dd5-7vln5\" (UID: \"8908a996-219d-4ea7-b3cd-8bea5c72a1f7\") " pod="ai-tenant-e2e-inf-a-8bf2fb/test-model-8bf2fb-kserve-8548d85dd5-7vln5"
Jul 06 13:21:42.904916 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:21:42.904917    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8908a996-219d-4ea7-b3cd-8bea5c72a1f7-model-cache\") pod \"test-model-8bf2fb-kserve-8548d85dd5-7vln5\" (UID: \"8908a996-219d-4ea7-b3cd-8bea5c72a1f7\") " pod="ai-tenant-e2e-inf-a-8bf2fb/test-model-8bf2fb-kserve-8548d85dd5-7vln5"
Jul 06 13:21:42.905149 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:21:42.905007    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7smrg\" (UniqueName: \"kubernetes.io/projected/8908a996-219d-4ea7-b3cd-8bea5c72a1f7-kube-api-access-7smrg\") pod \"test-model-8bf2fb-kserve-8548d85dd5-7vln5\" (UID: \"8908a996-219d-4ea7-b3cd-8bea5c72a1f7\") " pod="ai-tenant-e2e-inf-a-8bf2fb/test-model-8bf2fb-kserve-8548d85dd5-7vln5"
Jul 06 13:21:42.905149 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:21:42.905055    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8908a996-219d-4ea7-b3cd-8bea5c72a1f7-home\") pod \"test-model-8bf2fb-kserve-8548d85dd5-7vln5\" (UID: \"8908a996-219d-4ea7-b3cd-8bea5c72a1f7\") " pod="ai-tenant-e2e-inf-a-8bf2fb/test-model-8bf2fb-kserve-8548d85dd5-7vln5"
Jul 06 13:21:42.905149 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:21:42.905139    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8908a996-219d-4ea7-b3cd-8bea5c72a1f7-dshm\") pod \"test-model-8bf2fb-kserve-8548d85dd5-7vln5\" (UID: \"8908a996-219d-4ea7-b3cd-8bea5c72a1f7\") " pod="ai-tenant-e2e-inf-a-8bf2fb/test-model-8bf2fb-kserve-8548d85dd5-7vln5"
Jul 06 13:21:42.905276 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:21:42.905167    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8908a996-219d-4ea7-b3cd-8bea5c72a1f7-tmp-dir\") pod \"test-model-8bf2fb-kserve-8548d85dd5-7vln5\" (UID: \"8908a996-219d-4ea7-b3cd-8bea5c72a1f7\") " pod="ai-tenant-e2e-inf-a-8bf2fb/test-model-8bf2fb-kserve-8548d85dd5-7vln5"
Jul 06 13:21:42.906094 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:21:42.906073    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:21:43.005860 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:21:43.005818    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8908a996-219d-4ea7-b3cd-8bea5c72a1f7-home\") pod \"test-model-8bf2fb-kserve-8548d85dd5-7vln5\" (UID: \"8908a996-219d-4ea7-b3cd-8bea5c72a1f7\") " pod="ai-tenant-e2e-inf-a-8bf2fb/test-model-8bf2fb-kserve-8548d85dd5-7vln5"
Jul 06 13:21:43.006045 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:21:43.005898    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8908a996-219d-4ea7-b3cd-8bea5c72a1f7-dshm\") pod \"test-model-8bf2fb-kserve-8548d85dd5-7vln5\" (UID: \"8908a996-219d-4ea7-b3cd-8bea5c72a1f7\") " pod="ai-tenant-e2e-inf-a-8bf2fb/test-model-8bf2fb-kserve-8548d85dd5-7vln5"
Jul 06 13:21:43.006045 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:21:43.005922    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8908a996-219d-4ea7-b3cd-8bea5c72a1f7-tmp-dir\") pod \"test-model-8bf2fb-kserve-8548d85dd5-7vln5\" (UID: \"8908a996-219d-4ea7-b3cd-8bea5c72a1f7\") " pod="ai-tenant-e2e-inf-a-8bf2fb/test-model-8bf2fb-kserve-8548d85dd5-7vln5"
Jul 06 13:21:43.006045 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:21:43.005969    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8908a996-219d-4ea7-b3cd-8bea5c72a1f7-tls-certs\") pod \"test-model-8bf2fb-kserve-8548d85dd5-7vln5\" (UID: \"8908a996-219d-4ea7-b3cd-8bea5c72a1f7\") " pod="ai-tenant-e2e-inf-a-8bf2fb/test-model-8bf2fb-kserve-8548d85dd5-7vln5"
Jul 06 13:21:43.006045 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:21:43.005995    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8908a996-219d-4ea7-b3cd-8bea5c72a1f7-model-cache\") pod \"test-model-8bf2fb-kserve-8548d85dd5-7vln5\" (UID: \"8908a996-219d-4ea7-b3cd-8bea5c72a1f7\") " pod="ai-tenant-e2e-inf-a-8bf2fb/test-model-8bf2fb-kserve-8548d85dd5-7vln5"
Jul 06 13:21:43.006045 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:21:43.006041    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7smrg\" (UniqueName: \"kubernetes.io/projected/8908a996-219d-4ea7-b3cd-8bea5c72a1f7-kube-api-access-7smrg\") pod \"test-model-8bf2fb-kserve-8548d85dd5-7vln5\" (UID: \"8908a996-219d-4ea7-b3cd-8bea5c72a1f7\") " pod="ai-tenant-e2e-inf-a-8bf2fb/test-model-8bf2fb-kserve-8548d85dd5-7vln5"
Jul 06 13:21:43.006293 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:21:43.006264    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8908a996-219d-4ea7-b3cd-8bea5c72a1f7-home\") pod \"test-model-8bf2fb-kserve-8548d85dd5-7vln5\" (UID: \"8908a996-219d-4ea7-b3cd-8bea5c72a1f7\") " pod="ai-tenant-e2e-inf-a-8bf2fb/test-model-8bf2fb-kserve-8548d85dd5-7vln5"
Jul 06 13:21:43.006346 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:21:43.006313    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8908a996-219d-4ea7-b3cd-8bea5c72a1f7-tmp-dir\") pod \"test-model-8bf2fb-kserve-8548d85dd5-7vln5\" (UID: \"8908a996-219d-4ea7-b3cd-8bea5c72a1f7\") " pod="ai-tenant-e2e-inf-a-8bf2fb/test-model-8bf2fb-kserve-8548d85dd5-7vln5"
Jul 06 13:21:43.006393 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:21:43.006375    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8908a996-219d-4ea7-b3cd-8bea5c72a1f7-model-cache\") pod \"test-model-8bf2fb-kserve-8548d85dd5-7vln5\" (UID: \"8908a996-219d-4ea7-b3cd-8bea5c72a1f7\") " pod="ai-tenant-e2e-inf-a-8bf2fb/test-model-8bf2fb-kserve-8548d85dd5-7vln5"
Jul 06 13:21:43.008253 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:21:43.008236    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8908a996-219d-4ea7-b3cd-8bea5c72a1f7-dshm\") pod \"test-model-8bf2fb-kserve-8548d85dd5-7vln5\" (UID: \"8908a996-219d-4ea7-b3cd-8bea5c72a1f7\") " pod="ai-tenant-e2e-inf-a-8bf2fb/test-model-8bf2fb-kserve-8548d85dd5-7vln5"
Jul 06 13:21:43.008380 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:21:43.008364    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8908a996-219d-4ea7-b3cd-8bea5c72a1f7-tls-certs\") pod \"test-model-8bf2fb-kserve-8548d85dd5-7vln5\" (UID: \"8908a996-219d-4ea7-b3cd-8bea5c72a1f7\") " pod="ai-tenant-e2e-inf-a-8bf2fb/test-model-8bf2fb-kserve-8548d85dd5-7vln5"
Jul 06 13:21:43.014758 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:21:43.014735    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7smrg\" (UniqueName: \"kubernetes.io/projected/8908a996-219d-4ea7-b3cd-8bea5c72a1f7-kube-api-access-7smrg\") pod \"test-model-8bf2fb-kserve-8548d85dd5-7vln5\" (UID: \"8908a996-219d-4ea7-b3cd-8bea5c72a1f7\") " pod="ai-tenant-e2e-inf-a-8bf2fb/test-model-8bf2fb-kserve-8548d85dd5-7vln5"
Jul 06 13:21:43.109612 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:21:43.109543    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-8bf2fb/test-model-8bf2fb-kserve-8548d85dd5-7vln5"
Jul 06 13:21:43.241097 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:21:43.241071    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-8bf2fb/test-model-8bf2fb-kserve-8548d85dd5-7vln5"]
Jul 06 13:21:43.242935 ip-10-0-129-126 kubenswrapper[2579]: W0706 13:21:43.242905    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8908a996_219d_4ea7_b3cd_8bea5c72a1f7.slice/crio-49385cfcde4e5b3d6072831bb025f37bd20b9db3b42d5cb4352f398c21daf3c1 WatchSource:0}: Error finding container 49385cfcde4e5b3d6072831bb025f37bd20b9db3b42d5cb4352f398c21daf3c1: Status 404 returned error can't find the container with id 49385cfcde4e5b3d6072831bb025f37bd20b9db3b42d5cb4352f398c21daf3c1
Jul 06 13:21:43.947430 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:21:43.947396    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-8bf2fb/test-model-8bf2fb-kserve-8548d85dd5-7vln5" event={"ID":"8908a996-219d-4ea7-b3cd-8bea5c72a1f7","Type":"ContainerStarted","Data":"1e24729fcc8f4713a901a963a374b2fe3bf1694dac49772db011e391541a32c1"}
Jul 06 13:21:43.947430 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:21:43.947436    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-8bf2fb/test-model-8bf2fb-kserve-8548d85dd5-7vln5" event={"ID":"8908a996-219d-4ea7-b3cd-8bea5c72a1f7","Type":"ContainerStarted","Data":"49385cfcde4e5b3d6072831bb025f37bd20b9db3b42d5cb4352f398c21daf3c1"}
Jul 06 13:21:43.971352 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:21:43.971305    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-8bf2fb/test-model-8bf2fb-kserve-8548d85dd5-7vln5" podStartSLOduration=1.9712926020000001 podStartE2EDuration="1.971292602s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:21:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:21:43.96901578 +0000 UTC m=+2080.837903439" watchObservedRunningTime="2026-07-06 13:21:43.971292602 +0000 UTC m=+2080.840180261"
Jul 06 13:21:48.124378 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:21:48.124340    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:21:48.683939 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:21:48.683898    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:21:48.784434 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:21:48.784405    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:21:53.109903 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:21:53.109874    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-8bf2fb/test-model-8bf2fb-kserve-8548d85dd5-7vln5"
Jul 06 13:21:53.110245 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:21:53.109930    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-8bf2fb/test-model-8bf2fb-kserve-8548d85dd5-7vln5"
Jul 06 13:21:53.123746 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:21:53.123723    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-8bf2fb/test-model-8bf2fb-kserve-8548d85dd5-7vln5"
Jul 06 13:21:54.003107 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:21:54.003076    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-8bf2fb/test-model-8bf2fb-kserve-8548d85dd5-7vln5"
Jul 06 13:21:57.699834 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:21:57.699797    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:22:18.202701 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:18.202669    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-cb2d4a/test-model-cb2d4a-kserve-5bdc9cf9df-sq2wv"]
Jul 06 13:22:18.206031 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:18.206015    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-cb2d4a/test-model-cb2d4a-kserve-5bdc9cf9df-sq2wv"
Jul 06 13:22:18.209493 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:18.209471    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-cb2d4a\"/\"kube-root-ca.crt\""
Jul 06 13:22:18.209606 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:18.209514    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-cb2d4a\"/\"test-model-cb2d4a-kserve-self-signed-certs\""
Jul 06 13:22:18.210807 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:18.210784    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-cb2d4a\"/\"default-dockercfg-4pnt9\""
Jul 06 13:22:18.210921 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:18.210792    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-cb2d4a\"/\"openshift-service-ca.crt\""
Jul 06 13:22:18.217858 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:18.217825    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-cb2d4a/test-model-cb2d4a-kserve-5bdc9cf9df-sq2wv"]
Jul 06 13:22:18.241737 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:18.241705    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:22:18.321714 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:18.321678    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b-tmp-dir\") pod \"test-model-cb2d4a-kserve-5bdc9cf9df-sq2wv\" (UID: \"ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b\") " pod="ai-tenant-e2e-inf-b-cb2d4a/test-model-cb2d4a-kserve-5bdc9cf9df-sq2wv"
Jul 06 13:22:18.321714 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:18.321716    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b-dshm\") pod \"test-model-cb2d4a-kserve-5bdc9cf9df-sq2wv\" (UID: \"ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b\") " pod="ai-tenant-e2e-inf-b-cb2d4a/test-model-cb2d4a-kserve-5bdc9cf9df-sq2wv"
Jul 06 13:22:18.321955 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:18.321736    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b-tls-certs\") pod \"test-model-cb2d4a-kserve-5bdc9cf9df-sq2wv\" (UID: \"ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b\") " pod="ai-tenant-e2e-inf-b-cb2d4a/test-model-cb2d4a-kserve-5bdc9cf9df-sq2wv"
Jul 06 13:22:18.321955 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:18.321857    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b-home\") pod \"test-model-cb2d4a-kserve-5bdc9cf9df-sq2wv\" (UID: \"ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b\") " pod="ai-tenant-e2e-inf-b-cb2d4a/test-model-cb2d4a-kserve-5bdc9cf9df-sq2wv"
Jul 06 13:22:18.321955 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:18.321906    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b-model-cache\") pod \"test-model-cb2d4a-kserve-5bdc9cf9df-sq2wv\" (UID: \"ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b\") " pod="ai-tenant-e2e-inf-b-cb2d4a/test-model-cb2d4a-kserve-5bdc9cf9df-sq2wv"
Jul 06 13:22:18.321955 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:18.321942    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rk725\" (UniqueName: \"kubernetes.io/projected/ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b-kube-api-access-rk725\") pod \"test-model-cb2d4a-kserve-5bdc9cf9df-sq2wv\" (UID: \"ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b\") " pod="ai-tenant-e2e-inf-b-cb2d4a/test-model-cb2d4a-kserve-5bdc9cf9df-sq2wv"
Jul 06 13:22:18.422671 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:18.422633    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b-tmp-dir\") pod \"test-model-cb2d4a-kserve-5bdc9cf9df-sq2wv\" (UID: \"ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b\") " pod="ai-tenant-e2e-inf-b-cb2d4a/test-model-cb2d4a-kserve-5bdc9cf9df-sq2wv"
Jul 06 13:22:18.422671 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:18.422672    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b-dshm\") pod \"test-model-cb2d4a-kserve-5bdc9cf9df-sq2wv\" (UID: \"ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b\") " pod="ai-tenant-e2e-inf-b-cb2d4a/test-model-cb2d4a-kserve-5bdc9cf9df-sq2wv"
Jul 06 13:22:18.422965 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:18.422693    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b-tls-certs\") pod \"test-model-cb2d4a-kserve-5bdc9cf9df-sq2wv\" (UID: \"ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b\") " pod="ai-tenant-e2e-inf-b-cb2d4a/test-model-cb2d4a-kserve-5bdc9cf9df-sq2wv"
Jul 06 13:22:18.422965 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:18.422726    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b-home\") pod \"test-model-cb2d4a-kserve-5bdc9cf9df-sq2wv\" (UID: \"ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b\") " pod="ai-tenant-e2e-inf-b-cb2d4a/test-model-cb2d4a-kserve-5bdc9cf9df-sq2wv"
Jul 06 13:22:18.422965 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:18.422756    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b-model-cache\") pod \"test-model-cb2d4a-kserve-5bdc9cf9df-sq2wv\" (UID: \"ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b\") " pod="ai-tenant-e2e-inf-b-cb2d4a/test-model-cb2d4a-kserve-5bdc9cf9df-sq2wv"
Jul 06 13:22:18.422965 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:18.422780    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rk725\" (UniqueName: \"kubernetes.io/projected/ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b-kube-api-access-rk725\") pod \"test-model-cb2d4a-kserve-5bdc9cf9df-sq2wv\" (UID: \"ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b\") " pod="ai-tenant-e2e-inf-b-cb2d4a/test-model-cb2d4a-kserve-5bdc9cf9df-sq2wv"
Jul 06 13:22:18.423180 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:18.423151    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b-tmp-dir\") pod \"test-model-cb2d4a-kserve-5bdc9cf9df-sq2wv\" (UID: \"ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b\") " pod="ai-tenant-e2e-inf-b-cb2d4a/test-model-cb2d4a-kserve-5bdc9cf9df-sq2wv"
Jul 06 13:22:18.423233 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:18.423176    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b-home\") pod \"test-model-cb2d4a-kserve-5bdc9cf9df-sq2wv\" (UID: \"ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b\") " pod="ai-tenant-e2e-inf-b-cb2d4a/test-model-cb2d4a-kserve-5bdc9cf9df-sq2wv"
Jul 06 13:22:18.423233 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:18.423207    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b-model-cache\") pod \"test-model-cb2d4a-kserve-5bdc9cf9df-sq2wv\" (UID: \"ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b\") " pod="ai-tenant-e2e-inf-b-cb2d4a/test-model-cb2d4a-kserve-5bdc9cf9df-sq2wv"
Jul 06 13:22:18.425098 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:18.425078    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b-dshm\") pod \"test-model-cb2d4a-kserve-5bdc9cf9df-sq2wv\" (UID: \"ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b\") " pod="ai-tenant-e2e-inf-b-cb2d4a/test-model-cb2d4a-kserve-5bdc9cf9df-sq2wv"
Jul 06 13:22:18.425340 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:18.425321    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b-tls-certs\") pod \"test-model-cb2d4a-kserve-5bdc9cf9df-sq2wv\" (UID: \"ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b\") " pod="ai-tenant-e2e-inf-b-cb2d4a/test-model-cb2d4a-kserve-5bdc9cf9df-sq2wv"
Jul 06 13:22:18.433994 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:18.433965    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rk725\" (UniqueName: \"kubernetes.io/projected/ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b-kube-api-access-rk725\") pod \"test-model-cb2d4a-kserve-5bdc9cf9df-sq2wv\" (UID: \"ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b\") " pod="ai-tenant-e2e-inf-b-cb2d4a/test-model-cb2d4a-kserve-5bdc9cf9df-sq2wv"
Jul 06 13:22:18.515905 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:18.515838    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-cb2d4a/test-model-cb2d4a-kserve-5bdc9cf9df-sq2wv"
Jul 06 13:22:18.658235 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:18.658128    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-cb2d4a/test-model-cb2d4a-kserve-5bdc9cf9df-sq2wv"]
Jul 06 13:22:18.660494 ip-10-0-129-126 kubenswrapper[2579]: W0706 13:22:18.660467    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podef91fbb0_d28d_4cb1_808a_461cd6d6fe3b.slice/crio-8def3c2f2f873d39a549998f609740c44b4b00ffebb0d87e089af5add84ce3aa WatchSource:0}: Error finding container 8def3c2f2f873d39a549998f609740c44b4b00ffebb0d87e089af5add84ce3aa: Status 404 returned error can't find the container with id 8def3c2f2f873d39a549998f609740c44b4b00ffebb0d87e089af5add84ce3aa
Jul 06 13:22:19.111607 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:19.111571    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-cb2d4a/test-model-cb2d4a-kserve-5bdc9cf9df-sq2wv" event={"ID":"ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b","Type":"ContainerStarted","Data":"c5d67d6b1691cdec74808a5c8faab94f65750a9f063757c83dc2958989e1c815"}
Jul 06 13:22:19.111773 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:19.111619    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-cb2d4a/test-model-cb2d4a-kserve-5bdc9cf9df-sq2wv" event={"ID":"ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b","Type":"ContainerStarted","Data":"8def3c2f2f873d39a549998f609740c44b4b00ffebb0d87e089af5add84ce3aa"}
Jul 06 13:22:19.134582 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:19.134519    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-cb2d4a/test-model-cb2d4a-kserve-5bdc9cf9df-sq2wv" podStartSLOduration=1.134501414 podStartE2EDuration="1.134501414s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:22:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:22:19.132548201 +0000 UTC m=+2116.001435861" watchObservedRunningTime="2026-07-06 13:22:19.134501414 +0000 UTC m=+2116.003389072"
Jul 06 13:22:22.126609 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:22.126575    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:22:28.516765 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:28.516727    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-cb2d4a/test-model-cb2d4a-kserve-5bdc9cf9df-sq2wv"
Jul 06 13:22:28.517190 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:28.516781    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-cb2d4a/test-model-cb2d4a-kserve-5bdc9cf9df-sq2wv"
Jul 06 13:22:28.529323 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:28.529296    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-cb2d4a/test-model-cb2d4a-kserve-5bdc9cf9df-sq2wv"
Jul 06 13:22:29.169558 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:29.169526    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-cb2d4a/test-model-cb2d4a-kserve-5bdc9cf9df-sq2wv"
Jul 06 13:22:34.047660 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:34.047619    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:22:42.076030 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:42.075994    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-8bf2fb/test-model-8bf2fb-kserve-8548d85dd5-7vln5"]
Jul 06 13:22:42.110411 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:42.110370    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:22:42.952070 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:42.952033    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-cb2d4a/test-model-cb2d4a-kserve-5bdc9cf9df-sq2wv"]
Jul 06 13:22:42.977217 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:42.977187    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:22:43.126165 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:43.126135    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:22:43.226889 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:43.226792    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:22:43.563097 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:43.563065    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:22:43.662157 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:43.662112    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:22:43.843172 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:43.843095    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:22:46.817789 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:46.817748    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:22:48.743455 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:48.743425    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:22:57.095940 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:57.095804    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-8bf2fb/test-model-8bf2fb-kserve-8548d85dd5-7vln5" podUID="8908a996-219d-4ea7-b3cd-8bea5c72a1f7" containerName="main" containerID="cri-o://1e24729fcc8f4713a901a963a374b2fe3bf1694dac49772db011e391541a32c1" gracePeriod=45
Jul 06 13:22:57.293699 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:57.293652    2579 generic.go:356] "Generic (PLEG): container finished" podID="8908a996-219d-4ea7-b3cd-8bea5c72a1f7" containerID="1e24729fcc8f4713a901a963a374b2fe3bf1694dac49772db011e391541a32c1" exitCode=0
Jul 06 13:22:57.293901 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:57.293703    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-8bf2fb/test-model-8bf2fb-kserve-8548d85dd5-7vln5" event={"ID":"8908a996-219d-4ea7-b3cd-8bea5c72a1f7","Type":"ContainerDied","Data":"1e24729fcc8f4713a901a963a374b2fe3bf1694dac49772db011e391541a32c1"}
Jul 06 13:22:57.346751 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:57.346683    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-8bf2fb/test-model-8bf2fb-kserve-8548d85dd5-7vln5"
Jul 06 13:22:57.466088 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:57.466046    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8908a996-219d-4ea7-b3cd-8bea5c72a1f7-tmp-dir\") pod \"8908a996-219d-4ea7-b3cd-8bea5c72a1f7\" (UID: \"8908a996-219d-4ea7-b3cd-8bea5c72a1f7\") "
Jul 06 13:22:57.466088 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:57.466088    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8908a996-219d-4ea7-b3cd-8bea5c72a1f7-model-cache\") pod \"8908a996-219d-4ea7-b3cd-8bea5c72a1f7\" (UID: \"8908a996-219d-4ea7-b3cd-8bea5c72a1f7\") "
Jul 06 13:22:57.466340 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:57.466163    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8908a996-219d-4ea7-b3cd-8bea5c72a1f7-home\") pod \"8908a996-219d-4ea7-b3cd-8bea5c72a1f7\" (UID: \"8908a996-219d-4ea7-b3cd-8bea5c72a1f7\") "
Jul 06 13:22:57.466340 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:57.466178    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8908a996-219d-4ea7-b3cd-8bea5c72a1f7-dshm\") pod \"8908a996-219d-4ea7-b3cd-8bea5c72a1f7\" (UID: \"8908a996-219d-4ea7-b3cd-8bea5c72a1f7\") "
Jul 06 13:22:57.466340 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:57.466223    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7smrg\" (UniqueName: \"kubernetes.io/projected/8908a996-219d-4ea7-b3cd-8bea5c72a1f7-kube-api-access-7smrg\") pod \"8908a996-219d-4ea7-b3cd-8bea5c72a1f7\" (UID: \"8908a996-219d-4ea7-b3cd-8bea5c72a1f7\") "
Jul 06 13:22:57.466340 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:57.466243    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8908a996-219d-4ea7-b3cd-8bea5c72a1f7-tls-certs\") pod \"8908a996-219d-4ea7-b3cd-8bea5c72a1f7\" (UID: \"8908a996-219d-4ea7-b3cd-8bea5c72a1f7\") "
Jul 06 13:22:57.466542 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:57.466382    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8908a996-219d-4ea7-b3cd-8bea5c72a1f7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8908a996-219d-4ea7-b3cd-8bea5c72a1f7" (UID: "8908a996-219d-4ea7-b3cd-8bea5c72a1f7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 13:22:57.466542 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:57.466469    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8908a996-219d-4ea7-b3cd-8bea5c72a1f7-model-cache" (OuterVolumeSpecName: "model-cache") pod "8908a996-219d-4ea7-b3cd-8bea5c72a1f7" (UID: "8908a996-219d-4ea7-b3cd-8bea5c72a1f7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 13:22:57.466542 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:57.466495    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8908a996-219d-4ea7-b3cd-8bea5c72a1f7-home" (OuterVolumeSpecName: "home") pod "8908a996-219d-4ea7-b3cd-8bea5c72a1f7" (UID: "8908a996-219d-4ea7-b3cd-8bea5c72a1f7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 13:22:57.468532 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:57.468506    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8908a996-219d-4ea7-b3cd-8bea5c72a1f7-kube-api-access-7smrg" (OuterVolumeSpecName: "kube-api-access-7smrg") pod "8908a996-219d-4ea7-b3cd-8bea5c72a1f7" (UID: "8908a996-219d-4ea7-b3cd-8bea5c72a1f7"). InnerVolumeSpecName "kube-api-access-7smrg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 13:22:57.468532 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:57.468516    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8908a996-219d-4ea7-b3cd-8bea5c72a1f7-dshm" (OuterVolumeSpecName: "dshm") pod "8908a996-219d-4ea7-b3cd-8bea5c72a1f7" (UID: "8908a996-219d-4ea7-b3cd-8bea5c72a1f7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 13:22:57.468680 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:57.468512    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8908a996-219d-4ea7-b3cd-8bea5c72a1f7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8908a996-219d-4ea7-b3cd-8bea5c72a1f7" (UID: "8908a996-219d-4ea7-b3cd-8bea5c72a1f7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 13:22:57.567122 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:57.567068    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8908a996-219d-4ea7-b3cd-8bea5c72a1f7-home\") on node \"ip-10-0-129-126.ec2.internal\" DevicePath \"\""
Jul 06 13:22:57.567122 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:57.567112    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8908a996-219d-4ea7-b3cd-8bea5c72a1f7-dshm\") on node \"ip-10-0-129-126.ec2.internal\" DevicePath \"\""
Jul 06 13:22:57.567122 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:57.567122    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7smrg\" (UniqueName: \"kubernetes.io/projected/8908a996-219d-4ea7-b3cd-8bea5c72a1f7-kube-api-access-7smrg\") on node \"ip-10-0-129-126.ec2.internal\" DevicePath \"\""
Jul 06 13:22:57.567122 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:57.567132    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8908a996-219d-4ea7-b3cd-8bea5c72a1f7-tls-certs\") on node \"ip-10-0-129-126.ec2.internal\" DevicePath \"\""
Jul 06 13:22:57.567122 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:57.567141    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8908a996-219d-4ea7-b3cd-8bea5c72a1f7-tmp-dir\") on node \"ip-10-0-129-126.ec2.internal\" DevicePath \"\""
Jul 06 13:22:57.567492 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:57.567148    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8908a996-219d-4ea7-b3cd-8bea5c72a1f7-model-cache\") on node \"ip-10-0-129-126.ec2.internal\" DevicePath \"\""
Jul 06 13:22:57.972540 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:57.972451    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-cb2d4a/test-model-cb2d4a-kserve-5bdc9cf9df-sq2wv" podUID="ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b" containerName="main" containerID="cri-o://c5d67d6b1691cdec74808a5c8faab94f65750a9f063757c83dc2958989e1c815" gracePeriod=45
Jul 06 13:22:58.228464 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:58.228395    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-cb2d4a/test-model-cb2d4a-kserve-5bdc9cf9df-sq2wv"
Jul 06 13:22:58.299079 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:58.299042    2579 generic.go:356] "Generic (PLEG): container finished" podID="ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b" containerID="c5d67d6b1691cdec74808a5c8faab94f65750a9f063757c83dc2958989e1c815" exitCode=0
Jul 06 13:22:58.299079 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:58.299085    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-cb2d4a/test-model-cb2d4a-kserve-5bdc9cf9df-sq2wv"
Jul 06 13:22:58.299310 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:58.299122    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-cb2d4a/test-model-cb2d4a-kserve-5bdc9cf9df-sq2wv" event={"ID":"ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b","Type":"ContainerDied","Data":"c5d67d6b1691cdec74808a5c8faab94f65750a9f063757c83dc2958989e1c815"}
Jul 06 13:22:58.299310 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:58.299178    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-cb2d4a/test-model-cb2d4a-kserve-5bdc9cf9df-sq2wv" event={"ID":"ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b","Type":"ContainerDied","Data":"8def3c2f2f873d39a549998f609740c44b4b00ffebb0d87e089af5add84ce3aa"}
Jul 06 13:22:58.299310 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:58.299201    2579 scope.go:117] "RemoveContainer" containerID="c5d67d6b1691cdec74808a5c8faab94f65750a9f063757c83dc2958989e1c815"
Jul 06 13:22:58.300408 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:58.300366    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-8bf2fb/test-model-8bf2fb-kserve-8548d85dd5-7vln5"
Jul 06 13:22:58.300475 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:58.300365    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-8bf2fb/test-model-8bf2fb-kserve-8548d85dd5-7vln5" event={"ID":"8908a996-219d-4ea7-b3cd-8bea5c72a1f7","Type":"ContainerDied","Data":"49385cfcde4e5b3d6072831bb025f37bd20b9db3b42d5cb4352f398c21daf3c1"}
Jul 06 13:22:58.307685 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:58.307666    2579 scope.go:117] "RemoveContainer" containerID="c5d67d6b1691cdec74808a5c8faab94f65750a9f063757c83dc2958989e1c815"
Jul 06 13:22:58.307965 ip-10-0-129-126 kubenswrapper[2579]: E0706 13:22:58.307938    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5d67d6b1691cdec74808a5c8faab94f65750a9f063757c83dc2958989e1c815\": container with ID starting with c5d67d6b1691cdec74808a5c8faab94f65750a9f063757c83dc2958989e1c815 not found: ID does not exist" containerID="c5d67d6b1691cdec74808a5c8faab94f65750a9f063757c83dc2958989e1c815"
Jul 06 13:22:58.308068 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:58.307966    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5d67d6b1691cdec74808a5c8faab94f65750a9f063757c83dc2958989e1c815"} err="failed to get container status \"c5d67d6b1691cdec74808a5c8faab94f65750a9f063757c83dc2958989e1c815\": rpc error: code = NotFound desc = could not find container \"c5d67d6b1691cdec74808a5c8faab94f65750a9f063757c83dc2958989e1c815\": container with ID starting with c5d67d6b1691cdec74808a5c8faab94f65750a9f063757c83dc2958989e1c815 not found: ID does not exist"
Jul 06 13:22:58.308068 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:58.307984    2579 scope.go:117] "RemoveContainer" containerID="1e24729fcc8f4713a901a963a374b2fe3bf1694dac49772db011e391541a32c1"
Jul 06 13:22:58.320640 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:58.320616    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-8bf2fb/test-model-8bf2fb-kserve-8548d85dd5-7vln5"]
Jul 06 13:22:58.328523 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:58.328490    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-8bf2fb/test-model-8bf2fb-kserve-8548d85dd5-7vln5"]
Jul 06 13:22:58.373568 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:58.373531    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b-tls-certs\") pod \"ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b\" (UID: \"ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b\") "
Jul 06 13:22:58.373568 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:58.373571    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b-model-cache\") pod \"ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b\" (UID: \"ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b\") "
Jul 06 13:22:58.373786 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:58.373605    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b-tmp-dir\") pod \"ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b\" (UID: \"ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b\") "
Jul 06 13:22:58.373786 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:58.373641    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b-dshm\") pod \"ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b\" (UID: \"ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b\") "
Jul 06 13:22:58.373786 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:58.373655    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b-home\") pod \"ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b\" (UID: \"ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b\") "
Jul 06 13:22:58.373786 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:58.373727    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rk725\" (UniqueName: \"kubernetes.io/projected/ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b-kube-api-access-rk725\") pod \"ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b\" (UID: \"ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b\") "
Jul 06 13:22:58.374011 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:58.373924    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b" (UID: "ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 13:22:58.374011 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:58.373964    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b-model-cache" (OuterVolumeSpecName: "model-cache") pod "ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b" (UID: "ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 13:22:58.374103 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:58.374034    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b-home" (OuterVolumeSpecName: "home") pod "ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b" (UID: "ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 13:22:58.374103 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:58.374053    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b-model-cache\") on node \"ip-10-0-129-126.ec2.internal\" DevicePath \"\""
Jul 06 13:22:58.374103 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:58.374071    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b-tmp-dir\") on node \"ip-10-0-129-126.ec2.internal\" DevicePath \"\""
Jul 06 13:22:58.375943 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:58.375921    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b-dshm" (OuterVolumeSpecName: "dshm") pod "ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b" (UID: "ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 13:22:58.375943 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:58.375931    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b-kube-api-access-rk725" (OuterVolumeSpecName: "kube-api-access-rk725") pod "ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b" (UID: "ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b"). InnerVolumeSpecName "kube-api-access-rk725". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 13:22:58.376091 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:58.375950    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b" (UID: "ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 13:22:58.474780 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:58.474742    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b-tls-certs\") on node \"ip-10-0-129-126.ec2.internal\" DevicePath \"\""
Jul 06 13:22:58.474780 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:58.474775    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b-dshm\") on node \"ip-10-0-129-126.ec2.internal\" DevicePath \"\""
Jul 06 13:22:58.474780 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:58.474784    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b-home\") on node \"ip-10-0-129-126.ec2.internal\" DevicePath \"\""
Jul 06 13:22:58.475039 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:58.474794    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rk725\" (UniqueName: \"kubernetes.io/projected/ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b-kube-api-access-rk725\") on node \"ip-10-0-129-126.ec2.internal\" DevicePath \"\""
Jul 06 13:22:58.622431 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:58.622396    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-cb2d4a/test-model-cb2d4a-kserve-5bdc9cf9df-sq2wv"]
Jul 06 13:22:58.624933 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:58.624907    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-cb2d4a/test-model-cb2d4a-kserve-5bdc9cf9df-sq2wv"]
Jul 06 13:22:59.654557 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:59.654519    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8908a996-219d-4ea7-b3cd-8bea5c72a1f7" path="/var/lib/kubelet/pods/8908a996-219d-4ea7-b3cd-8bea5c72a1f7/volumes"
Jul 06 13:22:59.654949 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:22:59.654921    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b" path="/var/lib/kubelet/pods/ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b/volumes"
Jul 06 13:23:26.698076 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:26.698042    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:23:27.026603 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:27.026573    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:23:27.264510 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:27.264479    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:23:27.541808 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:27.541768    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:23:28.066214 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:28.066181    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:23:28.363244 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:28.363163    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:23:28.546133 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:28.546103    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:23:28.740576 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:28.740548    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:23:31.136603 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:31.136571    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:23:34.768435 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:34.768405    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:23:34.874589 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:34.874557    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:23:35.108089 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:35.108000    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:23:35.396248 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:35.396163    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:23:35.844327 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:35.844292    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:23:36.220055 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:36.219979    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:23:36.828642 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:36.828611    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:23:39.829769 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:39.829735    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:23:39.944830 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:39.944801    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:23:40.029577 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:40.029544    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:23:40.422621 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:40.422590    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:23:40.529255 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:40.529220    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:23:40.624204 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:40.624173    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:23:43.724883 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:43.724824    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:23:44.305004 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:44.304974    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:23:44.975723 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:44.975689    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:23:45.333965 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:45.333932    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g"]
Jul 06 13:23:45.334365 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:45.334348    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b" containerName="main"
Jul 06 13:23:45.334455 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:45.334367    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b" containerName="main"
Jul 06 13:23:45.334455 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:45.334386    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8908a996-219d-4ea7-b3cd-8bea5c72a1f7" containerName="main"
Jul 06 13:23:45.334455 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:45.334394    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8908a996-219d-4ea7-b3cd-8bea5c72a1f7" containerName="main"
Jul 06 13:23:45.334610 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:45.334492    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef91fbb0-d28d-4cb1-808a-461cd6d6fe3b" containerName="main"
Jul 06 13:23:45.334610 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:45.334505    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="8908a996-219d-4ea7-b3cd-8bea5c72a1f7" containerName="main"
Jul 06 13:23:45.337635 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:45.337610    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g"
Jul 06 13:23:45.341689 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:45.341665    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-544a3c-openshift-default-dockercfg-575lb\""
Jul 06 13:23:45.365112 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:45.365075    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g"]
Jul 06 13:23:45.391108 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:45.391066    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:23:45.479095 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:45.479062    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8208c812-88d0-47e6-8512-90264e7670f7-workload-certs\") pod \"e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g\" (UID: \"8208c812-88d0-47e6-8512-90264e7670f7\") " pod="openshift-ingress/e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g"
Jul 06 13:23:45.479279 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:45.479109    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8208c812-88d0-47e6-8512-90264e7670f7-istio-envoy\") pod \"e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g\" (UID: \"8208c812-88d0-47e6-8512-90264e7670f7\") " pod="openshift-ingress/e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g"
Jul 06 13:23:45.479279 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:45.479173    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8208c812-88d0-47e6-8512-90264e7670f7-istio-token\") pod \"e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g\" (UID: \"8208c812-88d0-47e6-8512-90264e7670f7\") " pod="openshift-ingress/e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g"
Jul 06 13:23:45.479279 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:45.479220    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8208c812-88d0-47e6-8512-90264e7670f7-credential-socket\") pod \"e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g\" (UID: \"8208c812-88d0-47e6-8512-90264e7670f7\") " pod="openshift-ingress/e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g"
Jul 06 13:23:45.479279 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:45.479251    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8208c812-88d0-47e6-8512-90264e7670f7-istio-podinfo\") pod \"e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g\" (UID: \"8208c812-88d0-47e6-8512-90264e7670f7\") " pod="openshift-ingress/e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g"
Jul 06 13:23:45.479279 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:45.479266    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8208c812-88d0-47e6-8512-90264e7670f7-istiod-ca-cert\") pod \"e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g\" (UID: \"8208c812-88d0-47e6-8512-90264e7670f7\") " pod="openshift-ingress/e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g"
Jul 06 13:23:45.479469 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:45.479282    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8208c812-88d0-47e6-8512-90264e7670f7-istio-data\") pod \"e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g\" (UID: \"8208c812-88d0-47e6-8512-90264e7670f7\") " pod="openshift-ingress/e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g"
Jul 06 13:23:45.479469 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:45.479341    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4xkw\" (UniqueName: \"kubernetes.io/projected/8208c812-88d0-47e6-8512-90264e7670f7-kube-api-access-r4xkw\") pod \"e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g\" (UID: \"8208c812-88d0-47e6-8512-90264e7670f7\") " pod="openshift-ingress/e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g"
Jul 06 13:23:45.479469 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:45.479373    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8208c812-88d0-47e6-8512-90264e7670f7-workload-socket\") pod \"e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g\" (UID: \"8208c812-88d0-47e6-8512-90264e7670f7\") " pod="openshift-ingress/e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g"
Jul 06 13:23:45.539757 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:45.539719    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:23:45.579807 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:45.579767    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8208c812-88d0-47e6-8512-90264e7670f7-istio-token\") pod \"e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g\" (UID: \"8208c812-88d0-47e6-8512-90264e7670f7\") " pod="openshift-ingress/e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g"
Jul 06 13:23:45.579807 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:45.579809    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8208c812-88d0-47e6-8512-90264e7670f7-credential-socket\") pod \"e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g\" (UID: \"8208c812-88d0-47e6-8512-90264e7670f7\") " pod="openshift-ingress/e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g"
Jul 06 13:23:45.580081 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:45.579869    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8208c812-88d0-47e6-8512-90264e7670f7-istio-podinfo\") pod \"e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g\" (UID: \"8208c812-88d0-47e6-8512-90264e7670f7\") " pod="openshift-ingress/e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g"
Jul 06 13:23:45.580081 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:45.579890    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8208c812-88d0-47e6-8512-90264e7670f7-istiod-ca-cert\") pod \"e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g\" (UID: \"8208c812-88d0-47e6-8512-90264e7670f7\") " pod="openshift-ingress/e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g"
Jul 06 13:23:45.580081 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:45.579913    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8208c812-88d0-47e6-8512-90264e7670f7-istio-data\") pod \"e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g\" (UID: \"8208c812-88d0-47e6-8512-90264e7670f7\") " pod="openshift-ingress/e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g"
Jul 06 13:23:45.580081 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:45.579953    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4xkw\" (UniqueName: \"kubernetes.io/projected/8208c812-88d0-47e6-8512-90264e7670f7-kube-api-access-r4xkw\") pod \"e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g\" (UID: \"8208c812-88d0-47e6-8512-90264e7670f7\") " pod="openshift-ingress/e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g"
Jul 06 13:23:45.580081 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:45.579993    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8208c812-88d0-47e6-8512-90264e7670f7-workload-socket\") pod \"e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g\" (UID: \"8208c812-88d0-47e6-8512-90264e7670f7\") " pod="openshift-ingress/e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g"
Jul 06 13:23:45.580081 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:45.580044    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8208c812-88d0-47e6-8512-90264e7670f7-workload-certs\") pod \"e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g\" (UID: \"8208c812-88d0-47e6-8512-90264e7670f7\") " pod="openshift-ingress/e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g"
Jul 06 13:23:45.580340 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:45.580096    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8208c812-88d0-47e6-8512-90264e7670f7-istio-envoy\") pod \"e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g\" (UID: \"8208c812-88d0-47e6-8512-90264e7670f7\") " pod="openshift-ingress/e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g"
Jul 06 13:23:45.580340 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:45.580289    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8208c812-88d0-47e6-8512-90264e7670f7-credential-socket\") pod \"e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g\" (UID: \"8208c812-88d0-47e6-8512-90264e7670f7\") " pod="openshift-ingress/e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g"
Jul 06 13:23:45.580406 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:45.580350    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8208c812-88d0-47e6-8512-90264e7670f7-istio-data\") pod \"e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g\" (UID: \"8208c812-88d0-47e6-8512-90264e7670f7\") " pod="openshift-ingress/e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g"
Jul 06 13:23:45.580651 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:45.580631    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8208c812-88d0-47e6-8512-90264e7670f7-workload-socket\") pod \"e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g\" (UID: \"8208c812-88d0-47e6-8512-90264e7670f7\") " pod="openshift-ingress/e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g"
Jul 06 13:23:45.580734 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:45.580655    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8208c812-88d0-47e6-8512-90264e7670f7-workload-certs\") pod \"e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g\" (UID: \"8208c812-88d0-47e6-8512-90264e7670f7\") " pod="openshift-ingress/e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g"
Jul 06 13:23:45.580734 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:45.580665    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8208c812-88d0-47e6-8512-90264e7670f7-istiod-ca-cert\") pod \"e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g\" (UID: \"8208c812-88d0-47e6-8512-90264e7670f7\") " pod="openshift-ingress/e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g"
Jul 06 13:23:45.582430 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:45.582410    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8208c812-88d0-47e6-8512-90264e7670f7-istio-envoy\") pod \"e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g\" (UID: \"8208c812-88d0-47e6-8512-90264e7670f7\") " pod="openshift-ingress/e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g"
Jul 06 13:23:45.582503 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:45.582466    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8208c812-88d0-47e6-8512-90264e7670f7-istio-podinfo\") pod \"e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g\" (UID: \"8208c812-88d0-47e6-8512-90264e7670f7\") " pod="openshift-ingress/e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g"
Jul 06 13:23:45.595217 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:45.595156    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4xkw\" (UniqueName: \"kubernetes.io/projected/8208c812-88d0-47e6-8512-90264e7670f7-kube-api-access-r4xkw\") pod \"e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g\" (UID: \"8208c812-88d0-47e6-8512-90264e7670f7\") " pod="openshift-ingress/e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g"
Jul 06 13:23:45.595416 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:45.595400    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8208c812-88d0-47e6-8512-90264e7670f7-istio-token\") pod \"e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g\" (UID: \"8208c812-88d0-47e6-8512-90264e7670f7\") " pod="openshift-ingress/e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g"
Jul 06 13:23:45.650370 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:45.650339    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g"
Jul 06 13:23:45.807996 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:45.807962    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g"]
Jul 06 13:23:45.812594 ip-10-0-129-126 kubenswrapper[2579]: W0706 13:23:45.812565    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8208c812_88d0_47e6_8512_90264e7670f7.slice/crio-1bee8602659d73a500cba0414bfc05e6cd887c74f88858f6f90ddb7d9b825a17 WatchSource:0}: Error finding container 1bee8602659d73a500cba0414bfc05e6cd887c74f88858f6f90ddb7d9b825a17: Status 404 returned error can't find the container with id 1bee8602659d73a500cba0414bfc05e6cd887c74f88858f6f90ddb7d9b825a17
Jul 06 13:23:45.814794 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:45.814776    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 13:23:45.826313 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:45.826288    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:23:45.921166 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:45.921067    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:23:46.531919 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:46.531876    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g" event={"ID":"8208c812-88d0-47e6-8512-90264e7670f7","Type":"ContainerStarted","Data":"1bee8602659d73a500cba0414bfc05e6cd887c74f88858f6f90ddb7d9b825a17"}
Jul 06 13:23:48.650656 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:48.650614    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 13:23:48.650976 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:48.650691    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 13:23:48.650976 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:48.650719    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 13:23:49.556866 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:49.556817    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g" event={"ID":"8208c812-88d0-47e6-8512-90264e7670f7","Type":"ContainerStarted","Data":"a794c72e7e4f0283537f3ee78167cbd46b2171f5d3d57bfb525d31a0cccf1c4a"}
Jul 06 13:23:49.592430 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:49.592375    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g" podStartSLOduration=1.757038535 podStartE2EDuration="4.592357571s" totalImagesPullingTime="2.835319036s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:23:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:23:49.591814926 +0000 UTC m=+2206.460702585" watchObservedRunningTime="2026-07-06 13:23:49.592357571 +0000 UTC m=+2206.461245288"
Jul 06 13:23:49.655526 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:49.655497    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g"
Jul 06 13:23:49.656409 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:49.656391    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g"
Jul 06 13:23:50.562993 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:50.562957    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g"
Jul 06 13:23:50.564007 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:50.563983    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g"
Jul 06 13:23:51.845233 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:51.845196    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:23:51.985975 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:51.985944    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:23:52.380677 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:52.380642    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:23:52.826850 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:52.826804    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:23:52.980081 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:52.980047    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:23:56.365747 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:56.365710    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:23:57.246428 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:23:57.246391    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:24:01.330712 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:01.330666    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:24:01.442979 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:01.442934    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:24:04.686725 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:04.686685    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:24:05.062436 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:05.062403    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:24:05.158469 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:05.158439    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:24:05.564546 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:05.564509    2579 patch_prober.go:28] interesting pod/e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Jul 06 13:24:05.564808 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:05.564588    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g" podUID="8208c812-88d0-47e6-8512-90264e7670f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Jul 06 13:24:05.644041 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:05.644008    2579 generic.go:356] "Generic (PLEG): container finished" podID="8208c812-88d0-47e6-8512-90264e7670f7" containerID="a794c72e7e4f0283537f3ee78167cbd46b2171f5d3d57bfb525d31a0cccf1c4a" exitCode=0
Jul 06 13:24:05.644209 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:05.644078    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g" event={"ID":"8208c812-88d0-47e6-8512-90264e7670f7","Type":"ContainerDied","Data":"a794c72e7e4f0283537f3ee78167cbd46b2171f5d3d57bfb525d31a0cccf1c4a"}
Jul 06 13:24:05.644499 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:05.644484    2579 scope.go:117] "RemoveContainer" containerID="a794c72e7e4f0283537f3ee78167cbd46b2171f5d3d57bfb525d31a0cccf1c4a"
Jul 06 13:24:05.645511 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:05.645479    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 13:24:05.645573 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:05.645553    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 13:24:05.645610 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:05.645583    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 13:24:06.655059 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:06.655013    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g" event={"ID":"8208c812-88d0-47e6-8512-90264e7670f7","Type":"ContainerStarted","Data":"ec9a0169e152ca8bb9aa63c723bf082fe688a89d9764a2de5661d465107bb372"}
Jul 06 13:24:06.656249 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:06.656210    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g"
Jul 06 13:24:06.656532 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:06.656504    2579 patch_prober.go:28] interesting pod/e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Jul 06 13:24:06.656622 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:06.656592    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g" podUID="8208c812-88d0-47e6-8512-90264e7670f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Jul 06 13:24:07.654762 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:07.654231    2579 patch_prober.go:28] interesting pod/e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Jul 06 13:24:07.654762 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:07.654301    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g" podUID="8208c812-88d0-47e6-8512-90264e7670f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Jul 06 13:24:08.650856 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:08.650789    2579 patch_prober.go:28] interesting pod/e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Jul 06 13:24:08.651366 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:08.650876    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g" podUID="8208c812-88d0-47e6-8512-90264e7670f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Jul 06 13:24:09.651127 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:09.651086    2579 patch_prober.go:28] interesting pod/e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Jul 06 13:24:09.651743 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:09.651708    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g" podUID="8208c812-88d0-47e6-8512-90264e7670f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Jul 06 13:24:09.738559 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:09.738504    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:24:10.650747 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:10.650712    2579 patch_prober.go:28] interesting pod/e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Jul 06 13:24:10.650988 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:10.650766    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g" podUID="8208c812-88d0-47e6-8512-90264e7670f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Jul 06 13:24:11.655575 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:11.655545    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g"
Jul 06 13:24:11.655968 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:11.655773    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g"
Jul 06 13:24:11.656519 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:11.656499    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g"
Jul 06 13:24:11.901739 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:11.901698    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:24:12.002468 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:12.002438    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:24:12.102172 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:12.102141    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:24:12.333751 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:12.333670    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:24:12.700360 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:12.700281    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:24:12.921857 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:12.921821    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:24:13.362834 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:13.362805    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:24:13.511027 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:13.510986    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:24:13.749194 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:13.749160    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:24:20.420479 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:20.420447    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:24:20.520281 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:20.520243    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:24:20.599505 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:20.599472    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g"]
Jul 06 13:24:20.599681 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:20.599661    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g" podUID="8208c812-88d0-47e6-8512-90264e7670f7" containerName="istio-proxy" containerID="cri-o://ec9a0169e152ca8bb9aa63c723bf082fe688a89d9764a2de5661d465107bb372" gracePeriod=30
Jul 06 13:24:20.634099 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:20.634064    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:24:20.846228 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:20.846192    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:24:21.269982 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:21.269951    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:24:21.852463 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:21.852432    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:24:22.578090 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:22.578055    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:24:22.846902 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:22.846781    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:24:25.076067 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:25.076036    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:24:25.184942 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:25.184907    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:24:25.451902 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:25.451797    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:24:25.746267 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:25.746233    2579 generic.go:356] "Generic (PLEG): container finished" podID="8208c812-88d0-47e6-8512-90264e7670f7" containerID="ec9a0169e152ca8bb9aa63c723bf082fe688a89d9764a2de5661d465107bb372" exitCode=0
Jul 06 13:24:25.746444 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:25.746304    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g" event={"ID":"8208c812-88d0-47e6-8512-90264e7670f7","Type":"ContainerDied","Data":"ec9a0169e152ca8bb9aa63c723bf082fe688a89d9764a2de5661d465107bb372"}
Jul 06 13:24:25.746444 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:25.746361    2579 scope.go:117] "RemoveContainer" containerID="a794c72e7e4f0283537f3ee78167cbd46b2171f5d3d57bfb525d31a0cccf1c4a"
Jul 06 13:24:25.826783 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:25.826754    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:24:25.862002 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:25.861979    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g"
Jul 06 13:24:25.928488 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:25.928454    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:24:25.950585 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:25.950555    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8208c812-88d0-47e6-8512-90264e7670f7-credential-socket\") pod \"8208c812-88d0-47e6-8512-90264e7670f7\" (UID: \"8208c812-88d0-47e6-8512-90264e7670f7\") "
Jul 06 13:24:25.950585 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:25.950587    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8208c812-88d0-47e6-8512-90264e7670f7-workload-certs\") pod \"8208c812-88d0-47e6-8512-90264e7670f7\" (UID: \"8208c812-88d0-47e6-8512-90264e7670f7\") "
Jul 06 13:24:25.950821 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:25.950606    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8208c812-88d0-47e6-8512-90264e7670f7-istio-token\") pod \"8208c812-88d0-47e6-8512-90264e7670f7\" (UID: \"8208c812-88d0-47e6-8512-90264e7670f7\") "
Jul 06 13:24:25.950821 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:25.950646    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8208c812-88d0-47e6-8512-90264e7670f7-istio-podinfo\") pod \"8208c812-88d0-47e6-8512-90264e7670f7\" (UID: \"8208c812-88d0-47e6-8512-90264e7670f7\") "
Jul 06 13:24:25.950821 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:25.950676    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8208c812-88d0-47e6-8512-90264e7670f7-istio-envoy\") pod \"8208c812-88d0-47e6-8512-90264e7670f7\" (UID: \"8208c812-88d0-47e6-8512-90264e7670f7\") "
Jul 06 13:24:25.950821 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:25.950709    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8208c812-88d0-47e6-8512-90264e7670f7-istio-data\") pod \"8208c812-88d0-47e6-8512-90264e7670f7\" (UID: \"8208c812-88d0-47e6-8512-90264e7670f7\") "
Jul 06 13:24:25.950821 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:25.950753    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8208c812-88d0-47e6-8512-90264e7670f7-workload-socket\") pod \"8208c812-88d0-47e6-8512-90264e7670f7\" (UID: \"8208c812-88d0-47e6-8512-90264e7670f7\") "
Jul 06 13:24:25.950821 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:25.950790    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r4xkw\" (UniqueName: \"kubernetes.io/projected/8208c812-88d0-47e6-8512-90264e7670f7-kube-api-access-r4xkw\") pod \"8208c812-88d0-47e6-8512-90264e7670f7\" (UID: \"8208c812-88d0-47e6-8512-90264e7670f7\") "
Jul 06 13:24:25.951168 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:25.950832    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8208c812-88d0-47e6-8512-90264e7670f7-istiod-ca-cert\") pod \"8208c812-88d0-47e6-8512-90264e7670f7\" (UID: \"8208c812-88d0-47e6-8512-90264e7670f7\") "
Jul 06 13:24:25.951168 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:25.950893    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8208c812-88d0-47e6-8512-90264e7670f7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8208c812-88d0-47e6-8512-90264e7670f7" (UID: "8208c812-88d0-47e6-8512-90264e7670f7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 13:24:25.951168 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:25.950909    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8208c812-88d0-47e6-8512-90264e7670f7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8208c812-88d0-47e6-8512-90264e7670f7" (UID: "8208c812-88d0-47e6-8512-90264e7670f7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 13:24:25.951168 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:25.951091    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8208c812-88d0-47e6-8512-90264e7670f7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8208c812-88d0-47e6-8512-90264e7670f7" (UID: "8208c812-88d0-47e6-8512-90264e7670f7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 13:24:25.951168 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:25.951166    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8208c812-88d0-47e6-8512-90264e7670f7-credential-socket\") on node \"ip-10-0-129-126.ec2.internal\" DevicePath \"\""
Jul 06 13:24:25.951413 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:25.951182    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8208c812-88d0-47e6-8512-90264e7670f7-workload-certs\") on node \"ip-10-0-129-126.ec2.internal\" DevicePath \"\""
Jul 06 13:24:25.951413 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:25.951293    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8208c812-88d0-47e6-8512-90264e7670f7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8208c812-88d0-47e6-8512-90264e7670f7" (UID: "8208c812-88d0-47e6-8512-90264e7670f7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 13:24:25.951770 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:25.951737    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8208c812-88d0-47e6-8512-90264e7670f7-istio-data" (OuterVolumeSpecName: "istio-data") pod "8208c812-88d0-47e6-8512-90264e7670f7" (UID: "8208c812-88d0-47e6-8512-90264e7670f7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 13:24:25.953091 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:25.953063    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8208c812-88d0-47e6-8512-90264e7670f7-istio-token" (OuterVolumeSpecName: "istio-token") pod "8208c812-88d0-47e6-8512-90264e7670f7" (UID: "8208c812-88d0-47e6-8512-90264e7670f7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 13:24:25.953174 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:25.953130    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8208c812-88d0-47e6-8512-90264e7670f7-kube-api-access-r4xkw" (OuterVolumeSpecName: "kube-api-access-r4xkw") pod "8208c812-88d0-47e6-8512-90264e7670f7" (UID: "8208c812-88d0-47e6-8512-90264e7670f7"). InnerVolumeSpecName "kube-api-access-r4xkw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 13:24:25.953246 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:25.953228    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8208c812-88d0-47e6-8512-90264e7670f7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8208c812-88d0-47e6-8512-90264e7670f7" (UID: "8208c812-88d0-47e6-8512-90264e7670f7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 13:24:25.953354 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:25.953336    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8208c812-88d0-47e6-8512-90264e7670f7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8208c812-88d0-47e6-8512-90264e7670f7" (UID: "8208c812-88d0-47e6-8512-90264e7670f7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 13:24:26.052432 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:26.052351    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8208c812-88d0-47e6-8512-90264e7670f7-istio-podinfo\") on node \"ip-10-0-129-126.ec2.internal\" DevicePath \"\""
Jul 06 13:24:26.052432 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:26.052380    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8208c812-88d0-47e6-8512-90264e7670f7-istio-envoy\") on node \"ip-10-0-129-126.ec2.internal\" DevicePath \"\""
Jul 06 13:24:26.052432 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:26.052391    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8208c812-88d0-47e6-8512-90264e7670f7-istio-data\") on node \"ip-10-0-129-126.ec2.internal\" DevicePath \"\""
Jul 06 13:24:26.052432 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:26.052399    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8208c812-88d0-47e6-8512-90264e7670f7-workload-socket\") on node \"ip-10-0-129-126.ec2.internal\" DevicePath \"\""
Jul 06 13:24:26.052432 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:26.052408    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r4xkw\" (UniqueName: \"kubernetes.io/projected/8208c812-88d0-47e6-8512-90264e7670f7-kube-api-access-r4xkw\") on node \"ip-10-0-129-126.ec2.internal\" DevicePath \"\""
Jul 06 13:24:26.052432 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:26.052417    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8208c812-88d0-47e6-8512-90264e7670f7-istiod-ca-cert\") on node \"ip-10-0-129-126.ec2.internal\" DevicePath \"\""
Jul 06 13:24:26.052432 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:26.052424    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8208c812-88d0-47e6-8512-90264e7670f7-istio-token\") on node \"ip-10-0-129-126.ec2.internal\" DevicePath \"\""
Jul 06 13:24:26.752803 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:26.752764    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g" event={"ID":"8208c812-88d0-47e6-8512-90264e7670f7","Type":"ContainerDied","Data":"1bee8602659d73a500cba0414bfc05e6cd887c74f88858f6f90ddb7d9b825a17"}
Jul 06 13:24:26.752803 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:26.752784    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g"
Jul 06 13:24:26.753377 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:26.752833    2579 scope.go:117] "RemoveContainer" containerID="ec9a0169e152ca8bb9aa63c723bf082fe688a89d9764a2de5661d465107bb372"
Jul 06 13:24:26.787950 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:26.787910    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g"]
Jul 06 13:24:26.794939 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:26.794912    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-544a3c-openshift-default-5568559c6f-fp25g"]
Jul 06 13:24:27.654454 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:27.654421    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8208c812-88d0-47e6-8512-90264e7670f7" path="/var/lib/kubelet/pods/8208c812-88d0-47e6-8512-90264e7670f7/volumes"
Jul 06 13:24:30.018683 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:30.018646    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:24:30.664892 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:30.664836    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:24:31.028198 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:31.028161    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc"]
Jul 06 13:24:31.028593 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:31.028515    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8208c812-88d0-47e6-8512-90264e7670f7" containerName="istio-proxy"
Jul 06 13:24:31.028593 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:31.028525    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8208c812-88d0-47e6-8512-90264e7670f7" containerName="istio-proxy"
Jul 06 13:24:31.028669 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:31.028613    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="8208c812-88d0-47e6-8512-90264e7670f7" containerName="istio-proxy"
Jul 06 13:24:31.028669 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:31.028622    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="8208c812-88d0-47e6-8512-90264e7670f7" containerName="istio-proxy"
Jul 06 13:24:31.033117 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:31.033094    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc"
Jul 06 13:24:31.036454 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:31.036430    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-03b528-openshift-default-dockercfg-zblbt\""
Jul 06 13:24:31.048186 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:31.048157    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc"]
Jul 06 13:24:31.082433 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:31.082395    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:24:31.097315 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:31.097274    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb9e956b-f2d8-40dd-b9ba-ec5e51127829-workload-certs\") pod \"e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc\" (UID: \"eb9e956b-f2d8-40dd-b9ba-ec5e51127829\") " pod="openshift-ingress/e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc"
Jul 06 13:24:31.097315 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:31.097320    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb9e956b-f2d8-40dd-b9ba-ec5e51127829-istio-envoy\") pod \"e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc\" (UID: \"eb9e956b-f2d8-40dd-b9ba-ec5e51127829\") " pod="openshift-ingress/e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc"
Jul 06 13:24:31.097538 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:31.097374    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb9e956b-f2d8-40dd-b9ba-ec5e51127829-istiod-ca-cert\") pod \"e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc\" (UID: \"eb9e956b-f2d8-40dd-b9ba-ec5e51127829\") " pod="openshift-ingress/e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc"
Jul 06 13:24:31.097538 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:31.097406    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb9e956b-f2d8-40dd-b9ba-ec5e51127829-istio-podinfo\") pod \"e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc\" (UID: \"eb9e956b-f2d8-40dd-b9ba-ec5e51127829\") " pod="openshift-ingress/e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc"
Jul 06 13:24:31.097538 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:31.097430    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb9e956b-f2d8-40dd-b9ba-ec5e51127829-istio-data\") pod \"e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc\" (UID: \"eb9e956b-f2d8-40dd-b9ba-ec5e51127829\") " pod="openshift-ingress/e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc"
Jul 06 13:24:31.097538 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:31.097467    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb9e956b-f2d8-40dd-b9ba-ec5e51127829-istio-token\") pod \"e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc\" (UID: \"eb9e956b-f2d8-40dd-b9ba-ec5e51127829\") " pod="openshift-ingress/e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc"
Jul 06 13:24:31.097675 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:31.097550    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb9e956b-f2d8-40dd-b9ba-ec5e51127829-workload-socket\") pod \"e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc\" (UID: \"eb9e956b-f2d8-40dd-b9ba-ec5e51127829\") " pod="openshift-ingress/e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc"
Jul 06 13:24:31.097675 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:31.097586    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7qrr\" (UniqueName: \"kubernetes.io/projected/eb9e956b-f2d8-40dd-b9ba-ec5e51127829-kube-api-access-r7qrr\") pod \"e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc\" (UID: \"eb9e956b-f2d8-40dd-b9ba-ec5e51127829\") " pod="openshift-ingress/e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc"
Jul 06 13:24:31.097675 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:31.097609    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb9e956b-f2d8-40dd-b9ba-ec5e51127829-credential-socket\") pod \"e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc\" (UID: \"eb9e956b-f2d8-40dd-b9ba-ec5e51127829\") " pod="openshift-ingress/e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc"
Jul 06 13:24:31.198940 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:31.198902    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb9e956b-f2d8-40dd-b9ba-ec5e51127829-workload-certs\") pod \"e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc\" (UID: \"eb9e956b-f2d8-40dd-b9ba-ec5e51127829\") " pod="openshift-ingress/e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc"
Jul 06 13:24:31.198940 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:31.198939    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb9e956b-f2d8-40dd-b9ba-ec5e51127829-istio-envoy\") pod \"e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc\" (UID: \"eb9e956b-f2d8-40dd-b9ba-ec5e51127829\") " pod="openshift-ingress/e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc"
Jul 06 13:24:31.199215 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:31.198955    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb9e956b-f2d8-40dd-b9ba-ec5e51127829-istiod-ca-cert\") pod \"e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc\" (UID: \"eb9e956b-f2d8-40dd-b9ba-ec5e51127829\") " pod="openshift-ingress/e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc"
Jul 06 13:24:31.199215 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:31.198976    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb9e956b-f2d8-40dd-b9ba-ec5e51127829-istio-podinfo\") pod \"e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc\" (UID: \"eb9e956b-f2d8-40dd-b9ba-ec5e51127829\") " pod="openshift-ingress/e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc"
Jul 06 13:24:31.199215 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:31.198999    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb9e956b-f2d8-40dd-b9ba-ec5e51127829-istio-data\") pod \"e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc\" (UID: \"eb9e956b-f2d8-40dd-b9ba-ec5e51127829\") " pod="openshift-ingress/e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc"
Jul 06 13:24:31.199215 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:31.199048    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb9e956b-f2d8-40dd-b9ba-ec5e51127829-istio-token\") pod \"e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc\" (UID: \"eb9e956b-f2d8-40dd-b9ba-ec5e51127829\") " pod="openshift-ingress/e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc"
Jul 06 13:24:31.199215 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:31.199125    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb9e956b-f2d8-40dd-b9ba-ec5e51127829-workload-socket\") pod \"e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc\" (UID: \"eb9e956b-f2d8-40dd-b9ba-ec5e51127829\") " pod="openshift-ingress/e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc"
Jul 06 13:24:31.199215 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:31.199175    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7qrr\" (UniqueName: \"kubernetes.io/projected/eb9e956b-f2d8-40dd-b9ba-ec5e51127829-kube-api-access-r7qrr\") pod \"e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc\" (UID: \"eb9e956b-f2d8-40dd-b9ba-ec5e51127829\") " pod="openshift-ingress/e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc"
Jul 06 13:24:31.199215 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:31.199204    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb9e956b-f2d8-40dd-b9ba-ec5e51127829-credential-socket\") pod \"e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc\" (UID: \"eb9e956b-f2d8-40dd-b9ba-ec5e51127829\") " pod="openshift-ingress/e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc"
Jul 06 13:24:31.199495 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:31.199371    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb9e956b-f2d8-40dd-b9ba-ec5e51127829-workload-certs\") pod \"e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc\" (UID: \"eb9e956b-f2d8-40dd-b9ba-ec5e51127829\") " pod="openshift-ingress/e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc"
Jul 06 13:24:31.199495 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:31.199410    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb9e956b-f2d8-40dd-b9ba-ec5e51127829-istio-data\") pod \"e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc\" (UID: \"eb9e956b-f2d8-40dd-b9ba-ec5e51127829\") " pod="openshift-ingress/e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc"
Jul 06 13:24:31.199604 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:31.199547    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb9e956b-f2d8-40dd-b9ba-ec5e51127829-credential-socket\") pod \"e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc\" (UID: \"eb9e956b-f2d8-40dd-b9ba-ec5e51127829\") " pod="openshift-ingress/e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc"
Jul 06 13:24:31.199660 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:31.199638    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb9e956b-f2d8-40dd-b9ba-ec5e51127829-workload-socket\") pod \"e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc\" (UID: \"eb9e956b-f2d8-40dd-b9ba-ec5e51127829\") " pod="openshift-ingress/e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc"
Jul 06 13:24:31.200124 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:31.200103    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb9e956b-f2d8-40dd-b9ba-ec5e51127829-istiod-ca-cert\") pod \"e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc\" (UID: \"eb9e956b-f2d8-40dd-b9ba-ec5e51127829\") " pod="openshift-ingress/e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc"
Jul 06 13:24:31.201613 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:31.201591    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb9e956b-f2d8-40dd-b9ba-ec5e51127829-istio-envoy\") pod \"e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc\" (UID: \"eb9e956b-f2d8-40dd-b9ba-ec5e51127829\") " pod="openshift-ingress/e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc"
Jul 06 13:24:31.201800 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:31.201766    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb9e956b-f2d8-40dd-b9ba-ec5e51127829-istio-podinfo\") pod \"e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc\" (UID: \"eb9e956b-f2d8-40dd-b9ba-ec5e51127829\") " pod="openshift-ingress/e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc"
Jul 06 13:24:31.209208 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:31.209183    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb9e956b-f2d8-40dd-b9ba-ec5e51127829-istio-token\") pod \"e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc\" (UID: \"eb9e956b-f2d8-40dd-b9ba-ec5e51127829\") " pod="openshift-ingress/e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc"
Jul 06 13:24:31.211246 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:31.211222    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7qrr\" (UniqueName: \"kubernetes.io/projected/eb9e956b-f2d8-40dd-b9ba-ec5e51127829-kube-api-access-r7qrr\") pod \"e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc\" (UID: \"eb9e956b-f2d8-40dd-b9ba-ec5e51127829\") " pod="openshift-ingress/e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc"
Jul 06 13:24:31.344126 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:31.344027    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc"
Jul 06 13:24:31.478871 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:31.478828    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:24:31.502977 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:31.502951    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc"]
Jul 06 13:24:31.505454 ip-10-0-129-126 kubenswrapper[2579]: W0706 13:24:31.505417    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb9e956b_f2d8_40dd_b9ba_ec5e51127829.slice/crio-82148bee2a0282bbef467e921288d38b557a72ef01486ab736d15ce8bec93ea1 WatchSource:0}: Error finding container 82148bee2a0282bbef467e921288d38b557a72ef01486ab736d15ce8bec93ea1: Status 404 returned error can't find the container with id 82148bee2a0282bbef467e921288d38b557a72ef01486ab736d15ce8bec93ea1
Jul 06 13:24:31.507643 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:31.507613    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 13:24:31.507722 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:31.507679    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 13:24:31.507722 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:31.507710    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 13:24:31.783685 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:31.783646    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc" event={"ID":"eb9e956b-f2d8-40dd-b9ba-ec5e51127829","Type":"ContainerStarted","Data":"f9da1972ec725fcb8ddee7f7214390a97769409a2c9382f320c0977a862336fb"}
Jul 06 13:24:31.783883 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:31.783719    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc" event={"ID":"eb9e956b-f2d8-40dd-b9ba-ec5e51127829","Type":"ContainerStarted","Data":"82148bee2a0282bbef467e921288d38b557a72ef01486ab736d15ce8bec93ea1"}
Jul 06 13:24:31.815525 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:31.815468    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc" podStartSLOduration=0.815450872 podStartE2EDuration="815.450872ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:24:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:24:31.809971454 +0000 UTC m=+2248.678859113" watchObservedRunningTime="2026-07-06 13:24:31.815450872 +0000 UTC m=+2248.684338509"
Jul 06 13:24:32.345033 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:32.344999    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc"
Jul 06 13:24:32.350008 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:32.349985    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc"
Jul 06 13:24:32.789468 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:32.789437    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc"
Jul 06 13:24:32.790337 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:32.790318    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc"
Jul 06 13:24:34.587706 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:34.587666    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:24:34.738417 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:34.738392    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:24:34.832171 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:34.832143    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:24:35.027443 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:35.027412    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:24:35.450414 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:35.450331    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:24:35.550354 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:35.550317    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:24:37.427914 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:37.427877    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:24:39.068531 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:39.068497    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:24:45.854078 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:45.854044    2579 generic.go:356] "Generic (PLEG): container finished" podID="eb9e956b-f2d8-40dd-b9ba-ec5e51127829" containerID="f9da1972ec725fcb8ddee7f7214390a97769409a2c9382f320c0977a862336fb" exitCode=0
Jul 06 13:24:45.854505 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:45.854085    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc" event={"ID":"eb9e956b-f2d8-40dd-b9ba-ec5e51127829","Type":"ContainerDied","Data":"f9da1972ec725fcb8ddee7f7214390a97769409a2c9382f320c0977a862336fb"}
Jul 06 13:24:45.854505 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:45.854500    2579 scope.go:117] "RemoveContainer" containerID="f9da1972ec725fcb8ddee7f7214390a97769409a2c9382f320c0977a862336fb"
Jul 06 13:24:45.855482 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:45.855449    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 13:24:45.855587 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:45.855542    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 13:24:45.855649 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:45.855624    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 13:24:46.758643 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:46.758553    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:24:46.860979 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:46.860931    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:24:46.863327 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:46.863299    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc" event={"ID":"eb9e956b-f2d8-40dd-b9ba-ec5e51127829","Type":"ContainerStarted","Data":"4aee20af0c715ca3e51f8a6e2eafec838f91e44926c7eabd22dc1326c9067b3e"}
Jul 06 13:24:47.345084 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:47.345035    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc"
Jul 06 13:24:47.346837 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:47.346805    2579 patch_prober.go:28] interesting pod/e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Jul 06 13:24:47.346992 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:47.346896    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc" podUID="eb9e956b-f2d8-40dd-b9ba-ec5e51127829" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Jul 06 13:24:47.789746 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:47.789711    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc"
Jul 06 13:24:48.345359 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:48.345323    2579 patch_prober.go:28] interesting pod/e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Jul 06 13:24:48.345965 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:48.345917    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc" podUID="eb9e956b-f2d8-40dd-b9ba-ec5e51127829" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Jul 06 13:24:49.344934 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:49.344890    2579 patch_prober.go:28] interesting pod/e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Jul 06 13:24:49.345164 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:49.344961    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc" podUID="eb9e956b-f2d8-40dd-b9ba-ec5e51127829" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Jul 06 13:24:50.344917 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:50.344879    2579 patch_prober.go:28] interesting pod/e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Jul 06 13:24:50.345529 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:50.345497    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc" podUID="eb9e956b-f2d8-40dd-b9ba-ec5e51127829" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Jul 06 13:24:51.348109 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:51.348081    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc"
Jul 06 13:24:51.348975 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:51.348954    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc"
Jul 06 13:24:51.620692 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:51.620605    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-164b27/auth-test-model-164b27-kserve-fb8748859-bvq2m"]
Jul 06 13:24:51.621021 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:51.621007    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8208c812-88d0-47e6-8512-90264e7670f7" containerName="istio-proxy"
Jul 06 13:24:51.621068 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:51.621022    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8208c812-88d0-47e6-8512-90264e7670f7" containerName="istio-proxy"
Jul 06 13:24:51.624602 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:51.624579    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-164b27/auth-test-model-164b27-kserve-fb8748859-bvq2m"
Jul 06 13:24:51.627584 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:51.627561    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-164b27\"/\"openshift-service-ca.crt\""
Jul 06 13:24:51.627687 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:51.627676    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-164b27\"/\"kube-root-ca.crt\""
Jul 06 13:24:51.627952 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:51.627937    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-164b27\"/\"default-dockercfg-fm54g\""
Jul 06 13:24:51.628065 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:51.628049    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-164b27\"/\"auth-test-model-164b27-kserve-self-signed-certs\""
Jul 06 13:24:51.639507 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:51.639476    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-164b27/auth-test-model-164b27-kserve-fb8748859-bvq2m"]
Jul 06 13:24:51.649182 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:51.649154    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:24:51.789470 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:51.789434    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c962c917-53f8-4d2c-b77c-013a9be9771d-tls-certs\") pod \"auth-test-model-164b27-kserve-fb8748859-bvq2m\" (UID: \"c962c917-53f8-4d2c-b77c-013a9be9771d\") " pod="ai-tenant-e2e-shared-a-164b27/auth-test-model-164b27-kserve-fb8748859-bvq2m"
Jul 06 13:24:51.789647 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:51.789482    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnnvq\" (UniqueName: \"kubernetes.io/projected/c962c917-53f8-4d2c-b77c-013a9be9771d-kube-api-access-rnnvq\") pod \"auth-test-model-164b27-kserve-fb8748859-bvq2m\" (UID: \"c962c917-53f8-4d2c-b77c-013a9be9771d\") " pod="ai-tenant-e2e-shared-a-164b27/auth-test-model-164b27-kserve-fb8748859-bvq2m"
Jul 06 13:24:51.789647 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:51.789535    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c962c917-53f8-4d2c-b77c-013a9be9771d-dshm\") pod \"auth-test-model-164b27-kserve-fb8748859-bvq2m\" (UID: \"c962c917-53f8-4d2c-b77c-013a9be9771d\") " pod="ai-tenant-e2e-shared-a-164b27/auth-test-model-164b27-kserve-fb8748859-bvq2m"
Jul 06 13:24:51.789647 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:51.789559    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c962c917-53f8-4d2c-b77c-013a9be9771d-home\") pod \"auth-test-model-164b27-kserve-fb8748859-bvq2m\" (UID: \"c962c917-53f8-4d2c-b77c-013a9be9771d\") " pod="ai-tenant-e2e-shared-a-164b27/auth-test-model-164b27-kserve-fb8748859-bvq2m"
Jul 06 13:24:51.789647 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:51.789604    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c962c917-53f8-4d2c-b77c-013a9be9771d-model-cache\") pod \"auth-test-model-164b27-kserve-fb8748859-bvq2m\" (UID: \"c962c917-53f8-4d2c-b77c-013a9be9771d\") " pod="ai-tenant-e2e-shared-a-164b27/auth-test-model-164b27-kserve-fb8748859-bvq2m"
Jul 06 13:24:51.789647 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:51.789640    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c962c917-53f8-4d2c-b77c-013a9be9771d-tmp-dir\") pod \"auth-test-model-164b27-kserve-fb8748859-bvq2m\" (UID: \"c962c917-53f8-4d2c-b77c-013a9be9771d\") " pod="ai-tenant-e2e-shared-a-164b27/auth-test-model-164b27-kserve-fb8748859-bvq2m"
Jul 06 13:24:51.890674 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:51.890592    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c962c917-53f8-4d2c-b77c-013a9be9771d-tls-certs\") pod \"auth-test-model-164b27-kserve-fb8748859-bvq2m\" (UID: \"c962c917-53f8-4d2c-b77c-013a9be9771d\") " pod="ai-tenant-e2e-shared-a-164b27/auth-test-model-164b27-kserve-fb8748859-bvq2m"
Jul 06 13:24:51.890674 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:51.890634    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnnvq\" (UniqueName: \"kubernetes.io/projected/c962c917-53f8-4d2c-b77c-013a9be9771d-kube-api-access-rnnvq\") pod \"auth-test-model-164b27-kserve-fb8748859-bvq2m\" (UID: \"c962c917-53f8-4d2c-b77c-013a9be9771d\") " pod="ai-tenant-e2e-shared-a-164b27/auth-test-model-164b27-kserve-fb8748859-bvq2m"
Jul 06 13:24:51.890927 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:51.890678    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c962c917-53f8-4d2c-b77c-013a9be9771d-dshm\") pod \"auth-test-model-164b27-kserve-fb8748859-bvq2m\" (UID: \"c962c917-53f8-4d2c-b77c-013a9be9771d\") " pod="ai-tenant-e2e-shared-a-164b27/auth-test-model-164b27-kserve-fb8748859-bvq2m"
Jul 06 13:24:51.890927 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:51.890712    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c962c917-53f8-4d2c-b77c-013a9be9771d-home\") pod \"auth-test-model-164b27-kserve-fb8748859-bvq2m\" (UID: \"c962c917-53f8-4d2c-b77c-013a9be9771d\") " pod="ai-tenant-e2e-shared-a-164b27/auth-test-model-164b27-kserve-fb8748859-bvq2m"
Jul 06 13:24:51.890927 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:51.890733    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c962c917-53f8-4d2c-b77c-013a9be9771d-model-cache\") pod \"auth-test-model-164b27-kserve-fb8748859-bvq2m\" (UID: \"c962c917-53f8-4d2c-b77c-013a9be9771d\") " pod="ai-tenant-e2e-shared-a-164b27/auth-test-model-164b27-kserve-fb8748859-bvq2m"
Jul 06 13:24:51.890927 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:51.890872    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c962c917-53f8-4d2c-b77c-013a9be9771d-tmp-dir\") pod \"auth-test-model-164b27-kserve-fb8748859-bvq2m\" (UID: \"c962c917-53f8-4d2c-b77c-013a9be9771d\") " pod="ai-tenant-e2e-shared-a-164b27/auth-test-model-164b27-kserve-fb8748859-bvq2m"
Jul 06 13:24:51.891158 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:51.891140    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c962c917-53f8-4d2c-b77c-013a9be9771d-model-cache\") pod \"auth-test-model-164b27-kserve-fb8748859-bvq2m\" (UID: \"c962c917-53f8-4d2c-b77c-013a9be9771d\") " pod="ai-tenant-e2e-shared-a-164b27/auth-test-model-164b27-kserve-fb8748859-bvq2m"
Jul 06 13:24:51.891219 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:51.891192    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c962c917-53f8-4d2c-b77c-013a9be9771d-home\") pod \"auth-test-model-164b27-kserve-fb8748859-bvq2m\" (UID: \"c962c917-53f8-4d2c-b77c-013a9be9771d\") " pod="ai-tenant-e2e-shared-a-164b27/auth-test-model-164b27-kserve-fb8748859-bvq2m"
Jul 06 13:24:51.891302 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:51.891286    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c962c917-53f8-4d2c-b77c-013a9be9771d-tmp-dir\") pod \"auth-test-model-164b27-kserve-fb8748859-bvq2m\" (UID: \"c962c917-53f8-4d2c-b77c-013a9be9771d\") " pod="ai-tenant-e2e-shared-a-164b27/auth-test-model-164b27-kserve-fb8748859-bvq2m"
Jul 06 13:24:51.893010 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:51.892981    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c962c917-53f8-4d2c-b77c-013a9be9771d-dshm\") pod \"auth-test-model-164b27-kserve-fb8748859-bvq2m\" (UID: \"c962c917-53f8-4d2c-b77c-013a9be9771d\") " pod="ai-tenant-e2e-shared-a-164b27/auth-test-model-164b27-kserve-fb8748859-bvq2m"
Jul 06 13:24:51.893262 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:51.893244    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c962c917-53f8-4d2c-b77c-013a9be9771d-tls-certs\") pod \"auth-test-model-164b27-kserve-fb8748859-bvq2m\" (UID: \"c962c917-53f8-4d2c-b77c-013a9be9771d\") " pod="ai-tenant-e2e-shared-a-164b27/auth-test-model-164b27-kserve-fb8748859-bvq2m"
Jul 06 13:24:51.900686 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:51.900657    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnnvq\" (UniqueName: \"kubernetes.io/projected/c962c917-53f8-4d2c-b77c-013a9be9771d-kube-api-access-rnnvq\") pod \"auth-test-model-164b27-kserve-fb8748859-bvq2m\" (UID: \"c962c917-53f8-4d2c-b77c-013a9be9771d\") " pod="ai-tenant-e2e-shared-a-164b27/auth-test-model-164b27-kserve-fb8748859-bvq2m"
Jul 06 13:24:51.933364 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:51.933318    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-164b27/auth-test-model-164b27-kserve-fb8748859-bvq2m"
Jul 06 13:24:52.077443 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:52.077280    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-164b27/auth-test-model-164b27-kserve-fb8748859-bvq2m"]
Jul 06 13:24:52.080353 ip-10-0-129-126 kubenswrapper[2579]: W0706 13:24:52.080327    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc962c917_53f8_4d2c_b77c_013a9be9771d.slice/crio-29322aad87e947b4eb7f887ceda43185d8b20915ce7928a24fad20449dda4efb WatchSource:0}: Error finding container 29322aad87e947b4eb7f887ceda43185d8b20915ce7928a24fad20449dda4efb: Status 404 returned error can't find the container with id 29322aad87e947b4eb7f887ceda43185d8b20915ce7928a24fad20449dda4efb
Jul 06 13:24:52.893330 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:52.893292    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-164b27/auth-test-model-164b27-kserve-fb8748859-bvq2m" event={"ID":"c962c917-53f8-4d2c-b77c-013a9be9771d","Type":"ContainerStarted","Data":"23c2960ea157f3c7e5d0f6e473b84b7e6a2fe607b8c3508e6cb9b1a673edc83d"}
Jul 06 13:24:52.893830 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:52.893340    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-164b27/auth-test-model-164b27-kserve-fb8748859-bvq2m" event={"ID":"c962c917-53f8-4d2c-b77c-013a9be9771d","Type":"ContainerStarted","Data":"29322aad87e947b4eb7f887ceda43185d8b20915ce7928a24fad20449dda4efb"}
Jul 06 13:24:54.951364 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:54.951306    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-164b27/auth-test-model-164b27-kserve-fb8748859-bvq2m" podStartSLOduration=3.951284647 podStartE2EDuration="3.951284647s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:24:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:24:52.959576316 +0000 UTC m=+2269.828463975" watchObservedRunningTime="2026-07-06 13:24:54.951284647 +0000 UTC m=+2271.820172312"
Jul 06 13:24:54.953189 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:54.953170    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:24:56.497574 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:56.497543    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:24:56.828008 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:24:56.827922    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:25:01.934389 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:25:01.934350    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-164b27/auth-test-model-164b27-kserve-fb8748859-bvq2m"
Jul 06 13:25:01.934897 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:25:01.934413    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-164b27/auth-test-model-164b27-kserve-fb8748859-bvq2m"
Jul 06 13:25:01.947471 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:25:01.947446    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-164b27/auth-test-model-164b27-kserve-fb8748859-bvq2m"
Jul 06 13:25:02.954363 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:25:02.954336    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-164b27/auth-test-model-164b27-kserve-fb8748859-bvq2m"
Jul 06 13:25:18.767533 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:25:18.767481    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:25:20.256924 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:25:20.256884    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:25:22.227521 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:25:22.227487    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:25:40.895590 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:25:40.895556    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:25:58.060932 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:25:58.060836    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:26:12.756237 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:26:12.756203    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:26:29.394392 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:26:29.394353    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:26:45.942359 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:26:45.942317    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:27:01.978323 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:27:01.978286    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:27:14.545879 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:27:14.545797    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:27:18.136304 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:27:18.136264    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-164b27/auth-test-model-164b27-kserve-fb8748859-bvq2m"]
Jul 06 13:27:18.261485 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:27:18.261453    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:27:19.349337 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:27:19.349301    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:27:26.609882 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:27:26.609749    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:27:26.787953 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:27:26.787915    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:27:28.749545 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:27:28.749510    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:27:31.292106 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:27:31.292075    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:27:33.157941 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:27:33.157884    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-164b27/auth-test-model-164b27-kserve-fb8748859-bvq2m" podUID="c962c917-53f8-4d2c-b77c-013a9be9771d" containerName="main" containerID="cri-o://23c2960ea157f3c7e5d0f6e473b84b7e6a2fe607b8c3508e6cb9b1a673edc83d" gracePeriod=45
Jul 06 13:27:33.412503 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:27:33.412447    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-164b27/auth-test-model-164b27-kserve-fb8748859-bvq2m"
Jul 06 13:27:33.566926 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:27:33.566898    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rnnvq\" (UniqueName: \"kubernetes.io/projected/c962c917-53f8-4d2c-b77c-013a9be9771d-kube-api-access-rnnvq\") pod \"c962c917-53f8-4d2c-b77c-013a9be9771d\" (UID: \"c962c917-53f8-4d2c-b77c-013a9be9771d\") "
Jul 06 13:27:33.566926 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:27:33.566930    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c962c917-53f8-4d2c-b77c-013a9be9771d-tmp-dir\") pod \"c962c917-53f8-4d2c-b77c-013a9be9771d\" (UID: \"c962c917-53f8-4d2c-b77c-013a9be9771d\") "
Jul 06 13:27:33.567147 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:27:33.566958    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c962c917-53f8-4d2c-b77c-013a9be9771d-tls-certs\") pod \"c962c917-53f8-4d2c-b77c-013a9be9771d\" (UID: \"c962c917-53f8-4d2c-b77c-013a9be9771d\") "
Jul 06 13:27:33.567147 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:27:33.567001    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c962c917-53f8-4d2c-b77c-013a9be9771d-model-cache\") pod \"c962c917-53f8-4d2c-b77c-013a9be9771d\" (UID: \"c962c917-53f8-4d2c-b77c-013a9be9771d\") "
Jul 06 13:27:33.567147 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:27:33.567023    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c962c917-53f8-4d2c-b77c-013a9be9771d-dshm\") pod \"c962c917-53f8-4d2c-b77c-013a9be9771d\" (UID: \"c962c917-53f8-4d2c-b77c-013a9be9771d\") "
Jul 06 13:27:33.567147 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:27:33.567059    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c962c917-53f8-4d2c-b77c-013a9be9771d-home\") pod \"c962c917-53f8-4d2c-b77c-013a9be9771d\" (UID: \"c962c917-53f8-4d2c-b77c-013a9be9771d\") "
Jul 06 13:27:33.567378 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:27:33.567198    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c962c917-53f8-4d2c-b77c-013a9be9771d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c962c917-53f8-4d2c-b77c-013a9be9771d" (UID: "c962c917-53f8-4d2c-b77c-013a9be9771d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 13:27:33.567378 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:27:33.567290    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c962c917-53f8-4d2c-b77c-013a9be9771d-model-cache" (OuterVolumeSpecName: "model-cache") pod "c962c917-53f8-4d2c-b77c-013a9be9771d" (UID: "c962c917-53f8-4d2c-b77c-013a9be9771d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 13:27:33.567482 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:27:33.567373    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c962c917-53f8-4d2c-b77c-013a9be9771d-home" (OuterVolumeSpecName: "home") pod "c962c917-53f8-4d2c-b77c-013a9be9771d" (UID: "c962c917-53f8-4d2c-b77c-013a9be9771d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 13:27:33.567482 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:27:33.567417    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c962c917-53f8-4d2c-b77c-013a9be9771d-model-cache\") on node \"ip-10-0-129-126.ec2.internal\" DevicePath \"\""
Jul 06 13:27:33.567482 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:27:33.567435    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c962c917-53f8-4d2c-b77c-013a9be9771d-tmp-dir\") on node \"ip-10-0-129-126.ec2.internal\" DevicePath \"\""
Jul 06 13:27:33.569082 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:27:33.569056    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c962c917-53f8-4d2c-b77c-013a9be9771d-dshm" (OuterVolumeSpecName: "dshm") pod "c962c917-53f8-4d2c-b77c-013a9be9771d" (UID: "c962c917-53f8-4d2c-b77c-013a9be9771d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 13:27:33.569427 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:27:33.569407    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c962c917-53f8-4d2c-b77c-013a9be9771d-kube-api-access-rnnvq" (OuterVolumeSpecName: "kube-api-access-rnnvq") pod "c962c917-53f8-4d2c-b77c-013a9be9771d" (UID: "c962c917-53f8-4d2c-b77c-013a9be9771d"). InnerVolumeSpecName "kube-api-access-rnnvq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 13:27:33.569489 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:27:33.569416    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c962c917-53f8-4d2c-b77c-013a9be9771d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c962c917-53f8-4d2c-b77c-013a9be9771d" (UID: "c962c917-53f8-4d2c-b77c-013a9be9771d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 13:27:33.646379 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:27:33.646347    2579 generic.go:356] "Generic (PLEG): container finished" podID="c962c917-53f8-4d2c-b77c-013a9be9771d" containerID="23c2960ea157f3c7e5d0f6e473b84b7e6a2fe607b8c3508e6cb9b1a673edc83d" exitCode=0
Jul 06 13:27:33.646537 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:27:33.646401    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-164b27/auth-test-model-164b27-kserve-fb8748859-bvq2m"
Jul 06 13:27:33.646537 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:27:33.646434    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-164b27/auth-test-model-164b27-kserve-fb8748859-bvq2m" event={"ID":"c962c917-53f8-4d2c-b77c-013a9be9771d","Type":"ContainerDied","Data":"23c2960ea157f3c7e5d0f6e473b84b7e6a2fe607b8c3508e6cb9b1a673edc83d"}
Jul 06 13:27:33.646537 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:27:33.646476    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-164b27/auth-test-model-164b27-kserve-fb8748859-bvq2m" event={"ID":"c962c917-53f8-4d2c-b77c-013a9be9771d","Type":"ContainerDied","Data":"29322aad87e947b4eb7f887ceda43185d8b20915ce7928a24fad20449dda4efb"}
Jul 06 13:27:33.646537 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:27:33.646495    2579 scope.go:117] "RemoveContainer" containerID="23c2960ea157f3c7e5d0f6e473b84b7e6a2fe607b8c3508e6cb9b1a673edc83d"
Jul 06 13:27:33.656098 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:27:33.656083    2579 scope.go:117] "RemoveContainer" containerID="23c2960ea157f3c7e5d0f6e473b84b7e6a2fe607b8c3508e6cb9b1a673edc83d"
Jul 06 13:27:33.656352 ip-10-0-129-126 kubenswrapper[2579]: E0706 13:27:33.656328    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23c2960ea157f3c7e5d0f6e473b84b7e6a2fe607b8c3508e6cb9b1a673edc83d\": container with ID starting with 23c2960ea157f3c7e5d0f6e473b84b7e6a2fe607b8c3508e6cb9b1a673edc83d not found: ID does not exist" containerID="23c2960ea157f3c7e5d0f6e473b84b7e6a2fe607b8c3508e6cb9b1a673edc83d"
Jul 06 13:27:33.656400 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:27:33.656364    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23c2960ea157f3c7e5d0f6e473b84b7e6a2fe607b8c3508e6cb9b1a673edc83d"} err="failed to get container status \"23c2960ea157f3c7e5d0f6e473b84b7e6a2fe607b8c3508e6cb9b1a673edc83d\": rpc error: code = NotFound desc = could not find container \"23c2960ea157f3c7e5d0f6e473b84b7e6a2fe607b8c3508e6cb9b1a673edc83d\": container with ID starting with 23c2960ea157f3c7e5d0f6e473b84b7e6a2fe607b8c3508e6cb9b1a673edc83d not found: ID does not exist"
Jul 06 13:27:33.668485 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:27:33.668429    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c962c917-53f8-4d2c-b77c-013a9be9771d-dshm\") on node \"ip-10-0-129-126.ec2.internal\" DevicePath \"\""
Jul 06 13:27:33.668485 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:27:33.668449    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c962c917-53f8-4d2c-b77c-013a9be9771d-home\") on node \"ip-10-0-129-126.ec2.internal\" DevicePath \"\""
Jul 06 13:27:33.668485 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:27:33.668458    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rnnvq\" (UniqueName: \"kubernetes.io/projected/c962c917-53f8-4d2c-b77c-013a9be9771d-kube-api-access-rnnvq\") on node \"ip-10-0-129-126.ec2.internal\" DevicePath \"\""
Jul 06 13:27:33.668485 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:27:33.668467    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c962c917-53f8-4d2c-b77c-013a9be9771d-tls-certs\") on node \"ip-10-0-129-126.ec2.internal\" DevicePath \"\""
Jul 06 13:27:33.679241 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:27:33.679221    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-164b27/auth-test-model-164b27-kserve-fb8748859-bvq2m"]
Jul 06 13:27:33.693097 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:27:33.693077    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-164b27/auth-test-model-164b27-kserve-fb8748859-bvq2m"]
Jul 06 13:27:35.654702 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:27:35.654670    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c962c917-53f8-4d2c-b77c-013a9be9771d" path="/var/lib/kubelet/pods/c962c917-53f8-4d2c-b77c-013a9be9771d/volumes"
Jul 06 13:27:50.835469 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:27:50.835433    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-03b528/sub-test-model-03b528-kserve-fd5849fff-hrqss"]
Jul 06 13:27:50.835872 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:27:50.835777    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c962c917-53f8-4d2c-b77c-013a9be9771d" containerName="main"
Jul 06 13:27:50.835872 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:27:50.835787    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c962c917-53f8-4d2c-b77c-013a9be9771d" containerName="main"
Jul 06 13:27:50.835872 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:27:50.835860    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="c962c917-53f8-4d2c-b77c-013a9be9771d" containerName="main"
Jul 06 13:27:50.838698 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:27:50.838681    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-03b528/sub-test-model-03b528-kserve-fd5849fff-hrqss"
Jul 06 13:27:50.843739 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:27:50.843712    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-03b528\"/\"openshift-service-ca.crt\""
Jul 06 13:27:50.843900 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:27:50.843714    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-03b528\"/\"kube-root-ca.crt\""
Jul 06 13:27:50.844930 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:27:50.844899    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-03b528\"/\"default-dockercfg-xhkc8\""
Jul 06 13:27:50.845059 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:27:50.845008    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-03b528\"/\"sub-test-model-03b528-kserve-self-signed-certs\""
Jul 06 13:27:50.854908 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:27:50.854886    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-03b528/sub-test-model-03b528-kserve-fd5849fff-hrqss"]
Jul 06 13:27:50.908539 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:27:50.908510    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cce370be-6d5e-4004-becd-0f5146d33fb9-model-cache\") pod \"sub-test-model-03b528-kserve-fd5849fff-hrqss\" (UID: \"cce370be-6d5e-4004-becd-0f5146d33fb9\") " pod="ai-tenant-e2e-shared-b-03b528/sub-test-model-03b528-kserve-fd5849fff-hrqss"
Jul 06 13:27:50.908694 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:27:50.908561    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cce370be-6d5e-4004-becd-0f5146d33fb9-dshm\") pod \"sub-test-model-03b528-kserve-fd5849fff-hrqss\" (UID: \"cce370be-6d5e-4004-becd-0f5146d33fb9\") " pod="ai-tenant-e2e-shared-b-03b528/sub-test-model-03b528-kserve-fd5849fff-hrqss"
Jul 06 13:27:50.908694 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:27:50.908633    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cce370be-6d5e-4004-becd-0f5146d33fb9-tmp-dir\") pod \"sub-test-model-03b528-kserve-fd5849fff-hrqss\" (UID: \"cce370be-6d5e-4004-becd-0f5146d33fb9\") " pod="ai-tenant-e2e-shared-b-03b528/sub-test-model-03b528-kserve-fd5849fff-hrqss"
Jul 06 13:27:50.908694 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:27:50.908672    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cce370be-6d5e-4004-becd-0f5146d33fb9-home\") pod \"sub-test-model-03b528-kserve-fd5849fff-hrqss\" (UID: \"cce370be-6d5e-4004-becd-0f5146d33fb9\") " pod="ai-tenant-e2e-shared-b-03b528/sub-test-model-03b528-kserve-fd5849fff-hrqss"
Jul 06 13:27:50.908819 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:27:50.908699    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z96xg\" (UniqueName: \"kubernetes.io/projected/cce370be-6d5e-4004-becd-0f5146d33fb9-kube-api-access-z96xg\") pod \"sub-test-model-03b528-kserve-fd5849fff-hrqss\" (UID: \"cce370be-6d5e-4004-becd-0f5146d33fb9\") " pod="ai-tenant-e2e-shared-b-03b528/sub-test-model-03b528-kserve-fd5849fff-hrqss"
Jul 06 13:27:50.908819 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:27:50.908717    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cce370be-6d5e-4004-becd-0f5146d33fb9-tls-certs\") pod \"sub-test-model-03b528-kserve-fd5849fff-hrqss\" (UID: \"cce370be-6d5e-4004-becd-0f5146d33fb9\") " pod="ai-tenant-e2e-shared-b-03b528/sub-test-model-03b528-kserve-fd5849fff-hrqss"
Jul 06 13:27:50.964705 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:27:50.964672    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:27:51.009498 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:27:51.009473    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cce370be-6d5e-4004-becd-0f5146d33fb9-model-cache\") pod \"sub-test-model-03b528-kserve-fd5849fff-hrqss\" (UID: \"cce370be-6d5e-4004-becd-0f5146d33fb9\") " pod="ai-tenant-e2e-shared-b-03b528/sub-test-model-03b528-kserve-fd5849fff-hrqss"
Jul 06 13:27:51.009588 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:27:51.009521    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cce370be-6d5e-4004-becd-0f5146d33fb9-dshm\") pod \"sub-test-model-03b528-kserve-fd5849fff-hrqss\" (UID: \"cce370be-6d5e-4004-becd-0f5146d33fb9\") " pod="ai-tenant-e2e-shared-b-03b528/sub-test-model-03b528-kserve-fd5849fff-hrqss"
Jul 06 13:27:51.009588 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:27:51.009553    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cce370be-6d5e-4004-becd-0f5146d33fb9-tmp-dir\") pod \"sub-test-model-03b528-kserve-fd5849fff-hrqss\" (UID: \"cce370be-6d5e-4004-becd-0f5146d33fb9\") " pod="ai-tenant-e2e-shared-b-03b528/sub-test-model-03b528-kserve-fd5849fff-hrqss"
Jul 06 13:27:51.009588 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:27:51.009577    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cce370be-6d5e-4004-becd-0f5146d33fb9-home\") pod \"sub-test-model-03b528-kserve-fd5849fff-hrqss\" (UID: \"cce370be-6d5e-4004-becd-0f5146d33fb9\") " pod="ai-tenant-e2e-shared-b-03b528/sub-test-model-03b528-kserve-fd5849fff-hrqss"
Jul 06 13:27:51.009710 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:27:51.009606    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z96xg\" (UniqueName: \"kubernetes.io/projected/cce370be-6d5e-4004-becd-0f5146d33fb9-kube-api-access-z96xg\") pod \"sub-test-model-03b528-kserve-fd5849fff-hrqss\" (UID: \"cce370be-6d5e-4004-becd-0f5146d33fb9\") " pod="ai-tenant-e2e-shared-b-03b528/sub-test-model-03b528-kserve-fd5849fff-hrqss"
Jul 06 13:27:51.009710 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:27:51.009632    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cce370be-6d5e-4004-becd-0f5146d33fb9-tls-certs\") pod \"sub-test-model-03b528-kserve-fd5849fff-hrqss\" (UID: \"cce370be-6d5e-4004-becd-0f5146d33fb9\") " pod="ai-tenant-e2e-shared-b-03b528/sub-test-model-03b528-kserve-fd5849fff-hrqss"
Jul 06 13:27:51.009954 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:27:51.009936    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cce370be-6d5e-4004-becd-0f5146d33fb9-model-cache\") pod \"sub-test-model-03b528-kserve-fd5849fff-hrqss\" (UID: \"cce370be-6d5e-4004-becd-0f5146d33fb9\") " pod="ai-tenant-e2e-shared-b-03b528/sub-test-model-03b528-kserve-fd5849fff-hrqss"
Jul 06 13:27:51.010010 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:27:51.009943    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cce370be-6d5e-4004-becd-0f5146d33fb9-home\") pod \"sub-test-model-03b528-kserve-fd5849fff-hrqss\" (UID: \"cce370be-6d5e-4004-becd-0f5146d33fb9\") " pod="ai-tenant-e2e-shared-b-03b528/sub-test-model-03b528-kserve-fd5849fff-hrqss"
Jul 06 13:27:51.010068 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:27:51.010021    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cce370be-6d5e-4004-becd-0f5146d33fb9-tmp-dir\") pod \"sub-test-model-03b528-kserve-fd5849fff-hrqss\" (UID: \"cce370be-6d5e-4004-becd-0f5146d33fb9\") " pod="ai-tenant-e2e-shared-b-03b528/sub-test-model-03b528-kserve-fd5849fff-hrqss"
Jul 06 13:27:51.011858 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:27:51.011819    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cce370be-6d5e-4004-becd-0f5146d33fb9-dshm\") pod \"sub-test-model-03b528-kserve-fd5849fff-hrqss\" (UID: \"cce370be-6d5e-4004-becd-0f5146d33fb9\") " pod="ai-tenant-e2e-shared-b-03b528/sub-test-model-03b528-kserve-fd5849fff-hrqss"
Jul 06 13:27:51.012070 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:27:51.012054    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cce370be-6d5e-4004-becd-0f5146d33fb9-tls-certs\") pod \"sub-test-model-03b528-kserve-fd5849fff-hrqss\" (UID: \"cce370be-6d5e-4004-becd-0f5146d33fb9\") " pod="ai-tenant-e2e-shared-b-03b528/sub-test-model-03b528-kserve-fd5849fff-hrqss"
Jul 06 13:27:51.023424 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:27:51.023399    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z96xg\" (UniqueName: \"kubernetes.io/projected/cce370be-6d5e-4004-becd-0f5146d33fb9-kube-api-access-z96xg\") pod \"sub-test-model-03b528-kserve-fd5849fff-hrqss\" (UID: \"cce370be-6d5e-4004-becd-0f5146d33fb9\") " pod="ai-tenant-e2e-shared-b-03b528/sub-test-model-03b528-kserve-fd5849fff-hrqss"
Jul 06 13:27:51.147733 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:27:51.147653    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-03b528/sub-test-model-03b528-kserve-fd5849fff-hrqss"
Jul 06 13:27:51.298852 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:27:51.298808    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-03b528/sub-test-model-03b528-kserve-fd5849fff-hrqss"]
Jul 06 13:27:51.301647 ip-10-0-129-126 kubenswrapper[2579]: W0706 13:27:51.301607    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcce370be_6d5e_4004_becd_0f5146d33fb9.slice/crio-88845bd57ce56c60dd5e2f1b2640aac5999f6281366212de42bd35834a3db44b WatchSource:0}: Error finding container 88845bd57ce56c60dd5e2f1b2640aac5999f6281366212de42bd35834a3db44b: Status 404 returned error can't find the container with id 88845bd57ce56c60dd5e2f1b2640aac5999f6281366212de42bd35834a3db44b
Jul 06 13:27:51.733723 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:27:51.733682    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-03b528/sub-test-model-03b528-kserve-fd5849fff-hrqss" event={"ID":"cce370be-6d5e-4004-becd-0f5146d33fb9","Type":"ContainerStarted","Data":"90f5a14967cb5de0a52eb9f67e20a781b5e02b38a7b1c9f638c3172a2da70ec5"}
Jul 06 13:27:51.733934 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:27:51.733731    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-03b528/sub-test-model-03b528-kserve-fd5849fff-hrqss" event={"ID":"cce370be-6d5e-4004-becd-0f5146d33fb9","Type":"ContainerStarted","Data":"88845bd57ce56c60dd5e2f1b2640aac5999f6281366212de42bd35834a3db44b"}
Jul 06 13:27:51.758116 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:27:51.758068    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-03b528/sub-test-model-03b528-kserve-fd5849fff-hrqss" podStartSLOduration=1.758049684 podStartE2EDuration="1.758049684s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:27:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:27:51.75498032 +0000 UTC m=+2448.623867980" watchObservedRunningTime="2026-07-06 13:27:51.758049684 +0000 UTC m=+2448.626937337"
Jul 06 13:27:55.048563 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:27:55.048524    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:28:01.148687 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:28:01.148647    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-03b528/sub-test-model-03b528-kserve-fd5849fff-hrqss"
Jul 06 13:28:01.149171 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:28:01.148699    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-03b528/sub-test-model-03b528-kserve-fd5849fff-hrqss"
Jul 06 13:28:01.161211 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:28:01.161188    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-03b528/sub-test-model-03b528-kserve-fd5849fff-hrqss"
Jul 06 13:28:01.791698 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:28:01.791669    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-03b528/sub-test-model-03b528-kserve-fd5849fff-hrqss"
Jul 06 13:28:03.599908 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:28:03.599867    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:28:09.178487 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:28:09.178452    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:28:24.278440 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:28:24.278407    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:28:25.048572 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:28:25.048535    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-03b528/sub-test-model-03b528-kserve-fd5849fff-hrqss"]
Jul 06 13:28:25.084764 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:28:25.084730    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:28:28.553552 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:28:28.553520    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:28:30.093784 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:28:30.093752    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-164b27/rate-test-model-164b27-kserve-6967cd5fd7-p8g5d"]
Jul 06 13:28:30.097242 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:28:30.097226    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-164b27/rate-test-model-164b27-kserve-6967cd5fd7-p8g5d"
Jul 06 13:28:30.102904 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:28:30.102877    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-164b27\"/\"kube-root-ca.crt\""
Jul 06 13:28:30.103031 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:28:30.102934    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-164b27\"/\"rate-test-model-164b27-kserve-self-signed-certs\""
Jul 06 13:28:30.103612 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:28:30.103332    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-164b27\"/\"openshift-service-ca.crt\""
Jul 06 13:28:30.103675 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:28:30.103647    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-164b27\"/\"default-dockercfg-fm54g\""
Jul 06 13:28:30.149014 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:28:30.148991    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-164b27/rate-test-model-164b27-kserve-6967cd5fd7-p8g5d"]
Jul 06 13:28:30.195150 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:28:30.195120    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:28:30.237861 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:28:30.237819    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c3db896-676c-42be-9fb7-be18c2130120-tmp-dir\") pod \"rate-test-model-164b27-kserve-6967cd5fd7-p8g5d\" (UID: \"4c3db896-676c-42be-9fb7-be18c2130120\") " pod="ai-tenant-e2e-shared-a-164b27/rate-test-model-164b27-kserve-6967cd5fd7-p8g5d"
Jul 06 13:28:30.237958 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:28:30.237873    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c3db896-676c-42be-9fb7-be18c2130120-tls-certs\") pod \"rate-test-model-164b27-kserve-6967cd5fd7-p8g5d\" (UID: \"4c3db896-676c-42be-9fb7-be18c2130120\") " pod="ai-tenant-e2e-shared-a-164b27/rate-test-model-164b27-kserve-6967cd5fd7-p8g5d"
Jul 06 13:28:30.237958 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:28:30.237943    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c3db896-676c-42be-9fb7-be18c2130120-dshm\") pod \"rate-test-model-164b27-kserve-6967cd5fd7-p8g5d\" (UID: \"4c3db896-676c-42be-9fb7-be18c2130120\") " pod="ai-tenant-e2e-shared-a-164b27/rate-test-model-164b27-kserve-6967cd5fd7-p8g5d"
Jul 06 13:28:30.238049 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:28:30.237981    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c3db896-676c-42be-9fb7-be18c2130120-home\") pod \"rate-test-model-164b27-kserve-6967cd5fd7-p8g5d\" (UID: \"4c3db896-676c-42be-9fb7-be18c2130120\") " pod="ai-tenant-e2e-shared-a-164b27/rate-test-model-164b27-kserve-6967cd5fd7-p8g5d"
Jul 06 13:28:30.238049 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:28:30.238004    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gqmd\" (UniqueName: \"kubernetes.io/projected/4c3db896-676c-42be-9fb7-be18c2130120-kube-api-access-2gqmd\") pod \"rate-test-model-164b27-kserve-6967cd5fd7-p8g5d\" (UID: \"4c3db896-676c-42be-9fb7-be18c2130120\") " pod="ai-tenant-e2e-shared-a-164b27/rate-test-model-164b27-kserve-6967cd5fd7-p8g5d"
Jul 06 13:28:30.238127 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:28:30.238068    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c3db896-676c-42be-9fb7-be18c2130120-model-cache\") pod \"rate-test-model-164b27-kserve-6967cd5fd7-p8g5d\" (UID: \"4c3db896-676c-42be-9fb7-be18c2130120\") " pod="ai-tenant-e2e-shared-a-164b27/rate-test-model-164b27-kserve-6967cd5fd7-p8g5d"
Jul 06 13:28:30.339540 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:28:30.339506    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c3db896-676c-42be-9fb7-be18c2130120-tls-certs\") pod \"rate-test-model-164b27-kserve-6967cd5fd7-p8g5d\" (UID: \"4c3db896-676c-42be-9fb7-be18c2130120\") " pod="ai-tenant-e2e-shared-a-164b27/rate-test-model-164b27-kserve-6967cd5fd7-p8g5d"
Jul 06 13:28:30.339696 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:28:30.339567    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c3db896-676c-42be-9fb7-be18c2130120-dshm\") pod \"rate-test-model-164b27-kserve-6967cd5fd7-p8g5d\" (UID: \"4c3db896-676c-42be-9fb7-be18c2130120\") " pod="ai-tenant-e2e-shared-a-164b27/rate-test-model-164b27-kserve-6967cd5fd7-p8g5d"
Jul 06 13:28:30.339696 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:28:30.339601    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c3db896-676c-42be-9fb7-be18c2130120-home\") pod \"rate-test-model-164b27-kserve-6967cd5fd7-p8g5d\" (UID: \"4c3db896-676c-42be-9fb7-be18c2130120\") " pod="ai-tenant-e2e-shared-a-164b27/rate-test-model-164b27-kserve-6967cd5fd7-p8g5d"
Jul 06 13:28:30.339696 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:28:30.339624    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gqmd\" (UniqueName: \"kubernetes.io/projected/4c3db896-676c-42be-9fb7-be18c2130120-kube-api-access-2gqmd\") pod \"rate-test-model-164b27-kserve-6967cd5fd7-p8g5d\" (UID: \"4c3db896-676c-42be-9fb7-be18c2130120\") " pod="ai-tenant-e2e-shared-a-164b27/rate-test-model-164b27-kserve-6967cd5fd7-p8g5d"
Jul 06 13:28:30.339696 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:28:30.339680    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c3db896-676c-42be-9fb7-be18c2130120-model-cache\") pod \"rate-test-model-164b27-kserve-6967cd5fd7-p8g5d\" (UID: \"4c3db896-676c-42be-9fb7-be18c2130120\") " pod="ai-tenant-e2e-shared-a-164b27/rate-test-model-164b27-kserve-6967cd5fd7-p8g5d"
Jul 06 13:28:30.339922 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:28:30.339709    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c3db896-676c-42be-9fb7-be18c2130120-tmp-dir\") pod \"rate-test-model-164b27-kserve-6967cd5fd7-p8g5d\" (UID: \"4c3db896-676c-42be-9fb7-be18c2130120\") " pod="ai-tenant-e2e-shared-a-164b27/rate-test-model-164b27-kserve-6967cd5fd7-p8g5d"
Jul 06 13:28:30.340159 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:28:30.340130    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c3db896-676c-42be-9fb7-be18c2130120-tmp-dir\") pod \"rate-test-model-164b27-kserve-6967cd5fd7-p8g5d\" (UID: \"4c3db896-676c-42be-9fb7-be18c2130120\") " pod="ai-tenant-e2e-shared-a-164b27/rate-test-model-164b27-kserve-6967cd5fd7-p8g5d"
Jul 06 13:28:30.340298 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:28:30.340175    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c3db896-676c-42be-9fb7-be18c2130120-home\") pod \"rate-test-model-164b27-kserve-6967cd5fd7-p8g5d\" (UID: \"4c3db896-676c-42be-9fb7-be18c2130120\") " pod="ai-tenant-e2e-shared-a-164b27/rate-test-model-164b27-kserve-6967cd5fd7-p8g5d"
Jul 06 13:28:30.340298 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:28:30.340214    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c3db896-676c-42be-9fb7-be18c2130120-model-cache\") pod \"rate-test-model-164b27-kserve-6967cd5fd7-p8g5d\" (UID: \"4c3db896-676c-42be-9fb7-be18c2130120\") " pod="ai-tenant-e2e-shared-a-164b27/rate-test-model-164b27-kserve-6967cd5fd7-p8g5d"
Jul 06 13:28:30.342524 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:28:30.342498    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c3db896-676c-42be-9fb7-be18c2130120-dshm\") pod \"rate-test-model-164b27-kserve-6967cd5fd7-p8g5d\" (UID: \"4c3db896-676c-42be-9fb7-be18c2130120\") " pod="ai-tenant-e2e-shared-a-164b27/rate-test-model-164b27-kserve-6967cd5fd7-p8g5d"
Jul 06 13:28:30.342676 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:28:30.342656    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c3db896-676c-42be-9fb7-be18c2130120-tls-certs\") pod \"rate-test-model-164b27-kserve-6967cd5fd7-p8g5d\" (UID: \"4c3db896-676c-42be-9fb7-be18c2130120\") " pod="ai-tenant-e2e-shared-a-164b27/rate-test-model-164b27-kserve-6967cd5fd7-p8g5d"
Jul 06 13:28:30.354577 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:28:30.354518    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gqmd\" (UniqueName: \"kubernetes.io/projected/4c3db896-676c-42be-9fb7-be18c2130120-kube-api-access-2gqmd\") pod \"rate-test-model-164b27-kserve-6967cd5fd7-p8g5d\" (UID: \"4c3db896-676c-42be-9fb7-be18c2130120\") " pod="ai-tenant-e2e-shared-a-164b27/rate-test-model-164b27-kserve-6967cd5fd7-p8g5d"
Jul 06 13:28:30.406164 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:28:30.406140    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-164b27/rate-test-model-164b27-kserve-6967cd5fd7-p8g5d"
Jul 06 13:28:30.547772 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:28:30.547739    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-164b27/rate-test-model-164b27-kserve-6967cd5fd7-p8g5d"]
Jul 06 13:28:30.551332 ip-10-0-129-126 kubenswrapper[2579]: W0706 13:28:30.551303    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4c3db896_676c_42be_9fb7_be18c2130120.slice/crio-a233391f2c9ceab2be7720b29b36de098fddd2f9937d0c8ddb11f69eebcd4a18 WatchSource:0}: Error finding container a233391f2c9ceab2be7720b29b36de098fddd2f9937d0c8ddb11f69eebcd4a18: Status 404 returned error can't find the container with id a233391f2c9ceab2be7720b29b36de098fddd2f9937d0c8ddb11f69eebcd4a18
Jul 06 13:28:30.915861 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:28:30.915819    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-164b27/rate-test-model-164b27-kserve-6967cd5fd7-p8g5d" event={"ID":"4c3db896-676c-42be-9fb7-be18c2130120","Type":"ContainerStarted","Data":"62e2f4d4ce83c219a6527fbe3847ac4f94b2a3cf1d6a1f75cb29232752ce9478"}
Jul 06 13:28:30.916026 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:28:30.915877    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-164b27/rate-test-model-164b27-kserve-6967cd5fd7-p8g5d" event={"ID":"4c3db896-676c-42be-9fb7-be18c2130120","Type":"ContainerStarted","Data":"a233391f2c9ceab2be7720b29b36de098fddd2f9937d0c8ddb11f69eebcd4a18"}
Jul 06 13:28:30.956681 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:28:30.956636    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-164b27/rate-test-model-164b27-kserve-6967cd5fd7-p8g5d" podStartSLOduration=0.956620854 podStartE2EDuration="956.620854ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:28:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:28:30.956279439 +0000 UTC m=+2487.825167110" watchObservedRunningTime="2026-07-06 13:28:30.956620854 +0000 UTC m=+2487.825508800"
Jul 06 13:28:40.068338 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:28:40.068275    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-03b528/sub-test-model-03b528-kserve-fd5849fff-hrqss" podUID="cce370be-6d5e-4004-becd-0f5146d33fb9" containerName="main" containerID="cri-o://90f5a14967cb5de0a52eb9f67e20a781b5e02b38a7b1c9f638c3172a2da70ec5" gracePeriod=45
Jul 06 13:28:40.323634 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:28:40.323568    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-03b528/sub-test-model-03b528-kserve-fd5849fff-hrqss"
Jul 06 13:28:40.407036 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:28:40.406989    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-164b27/rate-test-model-164b27-kserve-6967cd5fd7-p8g5d"
Jul 06 13:28:40.407207 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:28:40.407060    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-164b27/rate-test-model-164b27-kserve-6967cd5fd7-p8g5d"
Jul 06 13:28:40.419505 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:28:40.419475    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-164b27/rate-test-model-164b27-kserve-6967cd5fd7-p8g5d"
Jul 06 13:28:40.426082 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:28:40.426055    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cce370be-6d5e-4004-becd-0f5146d33fb9-tls-certs\") pod \"cce370be-6d5e-4004-becd-0f5146d33fb9\" (UID: \"cce370be-6d5e-4004-becd-0f5146d33fb9\") "
Jul 06 13:28:40.426195 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:28:40.426095    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cce370be-6d5e-4004-becd-0f5146d33fb9-dshm\") pod \"cce370be-6d5e-4004-becd-0f5146d33fb9\" (UID: \"cce370be-6d5e-4004-becd-0f5146d33fb9\") "
Jul 06 13:28:40.426195 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:28:40.426167    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z96xg\" (UniqueName: \"kubernetes.io/projected/cce370be-6d5e-4004-becd-0f5146d33fb9-kube-api-access-z96xg\") pod \"cce370be-6d5e-4004-becd-0f5146d33fb9\" (UID: \"cce370be-6d5e-4004-becd-0f5146d33fb9\") "
Jul 06 13:28:40.426195 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:28:40.426190    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cce370be-6d5e-4004-becd-0f5146d33fb9-home\") pod \"cce370be-6d5e-4004-becd-0f5146d33fb9\" (UID: \"cce370be-6d5e-4004-becd-0f5146d33fb9\") "
Jul 06 13:28:40.426352 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:28:40.426227    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cce370be-6d5e-4004-becd-0f5146d33fb9-tmp-dir\") pod \"cce370be-6d5e-4004-becd-0f5146d33fb9\" (UID: \"cce370be-6d5e-4004-becd-0f5146d33fb9\") "
Jul 06 13:28:40.426352 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:28:40.426285    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cce370be-6d5e-4004-becd-0f5146d33fb9-model-cache\") pod \"cce370be-6d5e-4004-becd-0f5146d33fb9\" (UID: \"cce370be-6d5e-4004-becd-0f5146d33fb9\") "
Jul 06 13:28:40.426459 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:28:40.426428    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cce370be-6d5e-4004-becd-0f5146d33fb9-home" (OuterVolumeSpecName: "home") pod "cce370be-6d5e-4004-becd-0f5146d33fb9" (UID: "cce370be-6d5e-4004-becd-0f5146d33fb9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 13:28:40.426605 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:28:40.426587    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cce370be-6d5e-4004-becd-0f5146d33fb9-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "cce370be-6d5e-4004-becd-0f5146d33fb9" (UID: "cce370be-6d5e-4004-becd-0f5146d33fb9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 13:28:40.426668 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:28:40.426617    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cce370be-6d5e-4004-becd-0f5146d33fb9-model-cache" (OuterVolumeSpecName: "model-cache") pod "cce370be-6d5e-4004-becd-0f5146d33fb9" (UID: "cce370be-6d5e-4004-becd-0f5146d33fb9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 13:28:40.428474 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:28:40.428445    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cce370be-6d5e-4004-becd-0f5146d33fb9-kube-api-access-z96xg" (OuterVolumeSpecName: "kube-api-access-z96xg") pod "cce370be-6d5e-4004-becd-0f5146d33fb9" (UID: "cce370be-6d5e-4004-becd-0f5146d33fb9"). InnerVolumeSpecName "kube-api-access-z96xg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 13:28:40.428568 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:28:40.428498    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cce370be-6d5e-4004-becd-0f5146d33fb9-dshm" (OuterVolumeSpecName: "dshm") pod "cce370be-6d5e-4004-becd-0f5146d33fb9" (UID: "cce370be-6d5e-4004-becd-0f5146d33fb9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 13:28:40.428568 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:28:40.428503    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cce370be-6d5e-4004-becd-0f5146d33fb9-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "cce370be-6d5e-4004-becd-0f5146d33fb9" (UID: "cce370be-6d5e-4004-becd-0f5146d33fb9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 13:28:40.528036 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:28:40.527997    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z96xg\" (UniqueName: \"kubernetes.io/projected/cce370be-6d5e-4004-becd-0f5146d33fb9-kube-api-access-z96xg\") on node \"ip-10-0-129-126.ec2.internal\" DevicePath \"\""
Jul 06 13:28:40.528036 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:28:40.528027    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cce370be-6d5e-4004-becd-0f5146d33fb9-home\") on node \"ip-10-0-129-126.ec2.internal\" DevicePath \"\""
Jul 06 13:28:40.528036 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:28:40.528036    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cce370be-6d5e-4004-becd-0f5146d33fb9-tmp-dir\") on node \"ip-10-0-129-126.ec2.internal\" DevicePath \"\""
Jul 06 13:28:40.528036 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:28:40.528046    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cce370be-6d5e-4004-becd-0f5146d33fb9-model-cache\") on node \"ip-10-0-129-126.ec2.internal\" DevicePath \"\""
Jul 06 13:28:40.528376 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:28:40.528055    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cce370be-6d5e-4004-becd-0f5146d33fb9-tls-certs\") on node \"ip-10-0-129-126.ec2.internal\" DevicePath \"\""
Jul 06 13:28:40.528376 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:28:40.528063    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cce370be-6d5e-4004-becd-0f5146d33fb9-dshm\") on node \"ip-10-0-129-126.ec2.internal\" DevicePath \"\""
Jul 06 13:28:40.963561 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:28:40.963518    2579 generic.go:356] "Generic (PLEG): container finished" podID="cce370be-6d5e-4004-becd-0f5146d33fb9" containerID="90f5a14967cb5de0a52eb9f67e20a781b5e02b38a7b1c9f638c3172a2da70ec5" exitCode=0
Jul 06 13:28:40.963561 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:28:40.963567    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-03b528/sub-test-model-03b528-kserve-fd5849fff-hrqss"
Jul 06 13:28:40.963774 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:28:40.963597    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-03b528/sub-test-model-03b528-kserve-fd5849fff-hrqss" event={"ID":"cce370be-6d5e-4004-becd-0f5146d33fb9","Type":"ContainerDied","Data":"90f5a14967cb5de0a52eb9f67e20a781b5e02b38a7b1c9f638c3172a2da70ec5"}
Jul 06 13:28:40.963774 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:28:40.963643    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-03b528/sub-test-model-03b528-kserve-fd5849fff-hrqss" event={"ID":"cce370be-6d5e-4004-becd-0f5146d33fb9","Type":"ContainerDied","Data":"88845bd57ce56c60dd5e2f1b2640aac5999f6281366212de42bd35834a3db44b"}
Jul 06 13:28:40.963774 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:28:40.963659    2579 scope.go:117] "RemoveContainer" containerID="90f5a14967cb5de0a52eb9f67e20a781b5e02b38a7b1c9f638c3172a2da70ec5"
Jul 06 13:28:40.973195 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:28:40.973174    2579 scope.go:117] "RemoveContainer" containerID="90f5a14967cb5de0a52eb9f67e20a781b5e02b38a7b1c9f638c3172a2da70ec5"
Jul 06 13:28:40.973491 ip-10-0-129-126 kubenswrapper[2579]: E0706 13:28:40.973471    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90f5a14967cb5de0a52eb9f67e20a781b5e02b38a7b1c9f638c3172a2da70ec5\": container with ID starting with 90f5a14967cb5de0a52eb9f67e20a781b5e02b38a7b1c9f638c3172a2da70ec5 not found: ID does not exist" containerID="90f5a14967cb5de0a52eb9f67e20a781b5e02b38a7b1c9f638c3172a2da70ec5"
Jul 06 13:28:40.973529 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:28:40.973503    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90f5a14967cb5de0a52eb9f67e20a781b5e02b38a7b1c9f638c3172a2da70ec5"} err="failed to get container status \"90f5a14967cb5de0a52eb9f67e20a781b5e02b38a7b1c9f638c3172a2da70ec5\": rpc error: code = NotFound desc = could not find container \"90f5a14967cb5de0a52eb9f67e20a781b5e02b38a7b1c9f638c3172a2da70ec5\": container with ID starting with 90f5a14967cb5de0a52eb9f67e20a781b5e02b38a7b1c9f638c3172a2da70ec5 not found: ID does not exist"
Jul 06 13:28:40.975808 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:28:40.975787    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-164b27/rate-test-model-164b27-kserve-6967cd5fd7-p8g5d"
Jul 06 13:28:40.990353 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:28:40.990324    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-03b528/sub-test-model-03b528-kserve-fd5849fff-hrqss"]
Jul 06 13:28:40.998488 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:28:40.998462    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-03b528/sub-test-model-03b528-kserve-fd5849fff-hrqss"]
Jul 06 13:28:41.654550 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:28:41.654516    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cce370be-6d5e-4004-becd-0f5146d33fb9" path="/var/lib/kubelet/pods/cce370be-6d5e-4004-becd-0f5146d33fb9/volumes"
Jul 06 13:28:43.926021 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:28:43.925991    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:28:46.623903 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:28:46.623867    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:28:46.727103 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:28:46.727067    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:28:52.589086 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:28:52.589043    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:28:57.844314 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:28:57.844241    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:29:12.543379 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:29:12.543344    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:29:13.815043 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:29:13.815004    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:29:29.646439 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:29:29.646394    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:29:33.665467 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:29:33.665429    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-164b27/rate-test-model-164b27-kserve-6967cd5fd7-p8g5d"]
Jul 06 13:29:33.693617 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:29:33.693591    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:29:34.456492 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:29:34.456462    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:29:35.557978 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:29:35.557936    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:29:35.998590 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:29:35.998552    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:29:36.170101 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:29:36.170071    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:29:36.279077 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:29:36.278984    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:29:36.478370 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:29:36.478336    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:29:41.051640 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:29:41.051593    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:29:44.336115 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:29:44.336078    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:29:48.684922 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:29:48.684885    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-164b27/rate-test-model-164b27-kserve-6967cd5fd7-p8g5d" podUID="4c3db896-676c-42be-9fb7-be18c2130120" containerName="main" containerID="cri-o://62e2f4d4ce83c219a6527fbe3847ac4f94b2a3cf1d6a1f75cb29232752ce9478" gracePeriod=45
Jul 06 13:29:48.938748 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:29:48.938685    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-164b27/rate-test-model-164b27-kserve-6967cd5fd7-p8g5d"
Jul 06 13:29:49.102377 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:29:49.102334    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c3db896-676c-42be-9fb7-be18c2130120-tmp-dir\") pod \"4c3db896-676c-42be-9fb7-be18c2130120\" (UID: \"4c3db896-676c-42be-9fb7-be18c2130120\") "
Jul 06 13:29:49.102542 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:29:49.102401    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c3db896-676c-42be-9fb7-be18c2130120-model-cache\") pod \"4c3db896-676c-42be-9fb7-be18c2130120\" (UID: \"4c3db896-676c-42be-9fb7-be18c2130120\") "
Jul 06 13:29:49.102542 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:29:49.102463    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2gqmd\" (UniqueName: \"kubernetes.io/projected/4c3db896-676c-42be-9fb7-be18c2130120-kube-api-access-2gqmd\") pod \"4c3db896-676c-42be-9fb7-be18c2130120\" (UID: \"4c3db896-676c-42be-9fb7-be18c2130120\") "
Jul 06 13:29:49.102542 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:29:49.102494    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c3db896-676c-42be-9fb7-be18c2130120-dshm\") pod \"4c3db896-676c-42be-9fb7-be18c2130120\" (UID: \"4c3db896-676c-42be-9fb7-be18c2130120\") "
Jul 06 13:29:49.102542 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:29:49.102537    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c3db896-676c-42be-9fb7-be18c2130120-home\") pod \"4c3db896-676c-42be-9fb7-be18c2130120\" (UID: \"4c3db896-676c-42be-9fb7-be18c2130120\") "
Jul 06 13:29:49.102732 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:29:49.102581    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c3db896-676c-42be-9fb7-be18c2130120-tls-certs\") pod \"4c3db896-676c-42be-9fb7-be18c2130120\" (UID: \"4c3db896-676c-42be-9fb7-be18c2130120\") "
Jul 06 13:29:49.102732 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:29:49.102584    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c3db896-676c-42be-9fb7-be18c2130120-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4c3db896-676c-42be-9fb7-be18c2130120" (UID: "4c3db896-676c-42be-9fb7-be18c2130120"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 13:29:49.102732 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:29:49.102701    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c3db896-676c-42be-9fb7-be18c2130120-model-cache" (OuterVolumeSpecName: "model-cache") pod "4c3db896-676c-42be-9fb7-be18c2130120" (UID: "4c3db896-676c-42be-9fb7-be18c2130120"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 13:29:49.102932 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:29:49.102783    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c3db896-676c-42be-9fb7-be18c2130120-home" (OuterVolumeSpecName: "home") pod "4c3db896-676c-42be-9fb7-be18c2130120" (UID: "4c3db896-676c-42be-9fb7-be18c2130120"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 13:29:49.102932 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:29:49.102838    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c3db896-676c-42be-9fb7-be18c2130120-tmp-dir\") on node \"ip-10-0-129-126.ec2.internal\" DevicePath \"\""
Jul 06 13:29:49.102932 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:29:49.102872    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c3db896-676c-42be-9fb7-be18c2130120-model-cache\") on node \"ip-10-0-129-126.ec2.internal\" DevicePath \"\""
Jul 06 13:29:49.102932 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:29:49.102880    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c3db896-676c-42be-9fb7-be18c2130120-home\") on node \"ip-10-0-129-126.ec2.internal\" DevicePath \"\""
Jul 06 13:29:49.104638 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:29:49.104615    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c3db896-676c-42be-9fb7-be18c2130120-kube-api-access-2gqmd" (OuterVolumeSpecName: "kube-api-access-2gqmd") pod "4c3db896-676c-42be-9fb7-be18c2130120" (UID: "4c3db896-676c-42be-9fb7-be18c2130120"). InnerVolumeSpecName "kube-api-access-2gqmd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 13:29:49.104734 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:29:49.104638    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c3db896-676c-42be-9fb7-be18c2130120-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4c3db896-676c-42be-9fb7-be18c2130120" (UID: "4c3db896-676c-42be-9fb7-be18c2130120"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 13:29:49.104734 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:29:49.104721    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c3db896-676c-42be-9fb7-be18c2130120-dshm" (OuterVolumeSpecName: "dshm") pod "4c3db896-676c-42be-9fb7-be18c2130120" (UID: "4c3db896-676c-42be-9fb7-be18c2130120"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 13:29:49.203693 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:29:49.203633    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c3db896-676c-42be-9fb7-be18c2130120-tls-certs\") on node \"ip-10-0-129-126.ec2.internal\" DevicePath \"\""
Jul 06 13:29:49.203693 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:29:49.203655    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2gqmd\" (UniqueName: \"kubernetes.io/projected/4c3db896-676c-42be-9fb7-be18c2130120-kube-api-access-2gqmd\") on node \"ip-10-0-129-126.ec2.internal\" DevicePath \"\""
Jul 06 13:29:49.203693 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:29:49.203665    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c3db896-676c-42be-9fb7-be18c2130120-dshm\") on node \"ip-10-0-129-126.ec2.internal\" DevicePath \"\""
Jul 06 13:29:49.281155 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:29:49.281128    2579 generic.go:356] "Generic (PLEG): container finished" podID="4c3db896-676c-42be-9fb7-be18c2130120" containerID="62e2f4d4ce83c219a6527fbe3847ac4f94b2a3cf1d6a1f75cb29232752ce9478" exitCode=0
Jul 06 13:29:49.281278 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:29:49.281167    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-164b27/rate-test-model-164b27-kserve-6967cd5fd7-p8g5d" event={"ID":"4c3db896-676c-42be-9fb7-be18c2130120","Type":"ContainerDied","Data":"62e2f4d4ce83c219a6527fbe3847ac4f94b2a3cf1d6a1f75cb29232752ce9478"}
Jul 06 13:29:49.281278 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:29:49.281190    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-164b27/rate-test-model-164b27-kserve-6967cd5fd7-p8g5d"
Jul 06 13:29:49.281278 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:29:49.281227    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-164b27/rate-test-model-164b27-kserve-6967cd5fd7-p8g5d" event={"ID":"4c3db896-676c-42be-9fb7-be18c2130120","Type":"ContainerDied","Data":"a233391f2c9ceab2be7720b29b36de098fddd2f9937d0c8ddb11f69eebcd4a18"}
Jul 06 13:29:49.281278 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:29:49.281253    2579 scope.go:117] "RemoveContainer" containerID="62e2f4d4ce83c219a6527fbe3847ac4f94b2a3cf1d6a1f75cb29232752ce9478"
Jul 06 13:29:49.289914 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:29:49.289897    2579 scope.go:117] "RemoveContainer" containerID="62e2f4d4ce83c219a6527fbe3847ac4f94b2a3cf1d6a1f75cb29232752ce9478"
Jul 06 13:29:49.290153 ip-10-0-129-126 kubenswrapper[2579]: E0706 13:29:49.290137    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62e2f4d4ce83c219a6527fbe3847ac4f94b2a3cf1d6a1f75cb29232752ce9478\": container with ID starting with 62e2f4d4ce83c219a6527fbe3847ac4f94b2a3cf1d6a1f75cb29232752ce9478 not found: ID does not exist" containerID="62e2f4d4ce83c219a6527fbe3847ac4f94b2a3cf1d6a1f75cb29232752ce9478"
Jul 06 13:29:49.290198 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:29:49.290161    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62e2f4d4ce83c219a6527fbe3847ac4f94b2a3cf1d6a1f75cb29232752ce9478"} err="failed to get container status \"62e2f4d4ce83c219a6527fbe3847ac4f94b2a3cf1d6a1f75cb29232752ce9478\": rpc error: code = NotFound desc = could not find container \"62e2f4d4ce83c219a6527fbe3847ac4f94b2a3cf1d6a1f75cb29232752ce9478\": container with ID starting with 62e2f4d4ce83c219a6527fbe3847ac4f94b2a3cf1d6a1f75cb29232752ce9478 not found: ID does not exist"
Jul 06 13:29:49.305236 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:29:49.305217    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-164b27/rate-test-model-164b27-kserve-6967cd5fd7-p8g5d"]
Jul 06 13:29:49.309539 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:29:49.309518    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-164b27/rate-test-model-164b27-kserve-6967cd5fd7-p8g5d"]
Jul 06 13:29:49.654289 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:29:49.654262    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c3db896-676c-42be-9fb7-be18c2130120" path="/var/lib/kubelet/pods/4c3db896-676c-42be-9fb7-be18c2130120/volumes"
Jul 06 13:29:57.543597 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:29:57.543563    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:29:57.647204 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:29:57.647172    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:29:59.674881 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:29:59.674816    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:29:59.774898 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:29:59.774867    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:30:00.146079 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:00.146050    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29722410-b5v6v"]
Jul 06 13:30:00.146395 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:00.146384    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c3db896-676c-42be-9fb7-be18c2130120" containerName="main"
Jul 06 13:30:00.146436 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:00.146397    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c3db896-676c-42be-9fb7-be18c2130120" containerName="main"
Jul 06 13:30:00.146436 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:00.146418    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cce370be-6d5e-4004-becd-0f5146d33fb9" containerName="main"
Jul 06 13:30:00.146436 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:00.146424    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="cce370be-6d5e-4004-becd-0f5146d33fb9" containerName="main"
Jul 06 13:30:00.146534 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:00.146480    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="cce370be-6d5e-4004-becd-0f5146d33fb9" containerName="main"
Jul 06 13:30:00.146534 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:00.146490    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c3db896-676c-42be-9fb7-be18c2130120" containerName="main"
Jul 06 13:30:00.150583 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:00.150567    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722410-b5v6v"
Jul 06 13:30:00.154305 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:00.154285    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-5pfrb\""
Jul 06 13:30:00.155392 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:00.155373    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-03b528-29722410-rhw6j"]
Jul 06 13:30:00.158779 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:00.158759    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-03b528-29722410-rhw6j"
Jul 06 13:30:00.160298 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:00.160273    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722410-b5v6v"]
Jul 06 13:30:00.166701 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:00.166676    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-03b528-29722410-rhw6j"]
Jul 06 13:30:00.192339 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:00.192308    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tq9gl\" (UniqueName: \"kubernetes.io/projected/b31fcfe0-3663-4d0a-87f8-cab1e868ba44-kube-api-access-tq9gl\") pod \"maas-api-key-cleanup-29722410-b5v6v\" (UID: \"b31fcfe0-3663-4d0a-87f8-cab1e868ba44\") " pod="opendatahub/maas-api-key-cleanup-29722410-b5v6v"
Jul 06 13:30:00.192482 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:00.192439    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ld4r\" (UniqueName: \"kubernetes.io/projected/93b5dcb5-e2c7-4752-965a-d2234def0e2e-kube-api-access-8ld4r\") pod \"maas-api-key-cleanup-e2e-shared-b-03b528-29722410-rhw6j\" (UID: \"93b5dcb5-e2c7-4752-965a-d2234def0e2e\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-03b528-29722410-rhw6j"
Jul 06 13:30:00.293030 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:00.292995    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ld4r\" (UniqueName: \"kubernetes.io/projected/93b5dcb5-e2c7-4752-965a-d2234def0e2e-kube-api-access-8ld4r\") pod \"maas-api-key-cleanup-e2e-shared-b-03b528-29722410-rhw6j\" (UID: \"93b5dcb5-e2c7-4752-965a-d2234def0e2e\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-03b528-29722410-rhw6j"
Jul 06 13:30:00.293185 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:00.293061    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tq9gl\" (UniqueName: \"kubernetes.io/projected/b31fcfe0-3663-4d0a-87f8-cab1e868ba44-kube-api-access-tq9gl\") pod \"maas-api-key-cleanup-29722410-b5v6v\" (UID: \"b31fcfe0-3663-4d0a-87f8-cab1e868ba44\") " pod="opendatahub/maas-api-key-cleanup-29722410-b5v6v"
Jul 06 13:30:00.303606 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:00.303568    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ld4r\" (UniqueName: \"kubernetes.io/projected/93b5dcb5-e2c7-4752-965a-d2234def0e2e-kube-api-access-8ld4r\") pod \"maas-api-key-cleanup-e2e-shared-b-03b528-29722410-rhw6j\" (UID: \"93b5dcb5-e2c7-4752-965a-d2234def0e2e\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-03b528-29722410-rhw6j"
Jul 06 13:30:00.304414 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:00.304396    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tq9gl\" (UniqueName: \"kubernetes.io/projected/b31fcfe0-3663-4d0a-87f8-cab1e868ba44-kube-api-access-tq9gl\") pod \"maas-api-key-cleanup-29722410-b5v6v\" (UID: \"b31fcfe0-3663-4d0a-87f8-cab1e868ba44\") " pod="opendatahub/maas-api-key-cleanup-29722410-b5v6v"
Jul 06 13:30:00.461640 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:00.461547    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722410-b5v6v"
Jul 06 13:30:00.472531 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:00.472515    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-03b528-29722410-rhw6j"
Jul 06 13:30:00.608648 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:00.608619    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722410-b5v6v"]
Jul 06 13:30:00.611259 ip-10-0-129-126 kubenswrapper[2579]: W0706 13:30:00.611217    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb31fcfe0_3663_4d0a_87f8_cab1e868ba44.slice/crio-46580fbf56f5f6fcd377ba5130d580474dda0b1d094cfea1276d21c7eb4e4459 WatchSource:0}: Error finding container 46580fbf56f5f6fcd377ba5130d580474dda0b1d094cfea1276d21c7eb4e4459: Status 404 returned error can't find the container with id 46580fbf56f5f6fcd377ba5130d580474dda0b1d094cfea1276d21c7eb4e4459
Jul 06 13:30:00.633434 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:00.633412    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-03b528-29722410-rhw6j"]
Jul 06 13:30:00.645936 ip-10-0-129-126 kubenswrapper[2579]: W0706 13:30:00.645907    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93b5dcb5_e2c7_4752_965a_d2234def0e2e.slice/crio-48c12d00630fd6e038edf8119eeac8fea2721ad9f96a9cdc78015a317800decb WatchSource:0}: Error finding container 48c12d00630fd6e038edf8119eeac8fea2721ad9f96a9cdc78015a317800decb: Status 404 returned error can't find the container with id 48c12d00630fd6e038edf8119eeac8fea2721ad9f96a9cdc78015a317800decb
Jul 06 13:30:01.336560 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:01.336520    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722410-b5v6v" event={"ID":"b31fcfe0-3663-4d0a-87f8-cab1e868ba44","Type":"ContainerStarted","Data":"c10ff2e1cc82bef40c6b5a60effd1ea2fa2eaf8937c29511f493e9eaa62cde7e"}
Jul 06 13:30:01.337042 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:01.336589    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722410-b5v6v" event={"ID":"b31fcfe0-3663-4d0a-87f8-cab1e868ba44","Type":"ContainerStarted","Data":"46580fbf56f5f6fcd377ba5130d580474dda0b1d094cfea1276d21c7eb4e4459"}
Jul 06 13:30:01.338110 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:01.338087    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-03b528-29722410-rhw6j" event={"ID":"93b5dcb5-e2c7-4752-965a-d2234def0e2e","Type":"ContainerStarted","Data":"4d3e6d5e1091654eec94ea97b5f27a72718d82084440dda7a1f3bf5699329229"}
Jul 06 13:30:01.338220 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:01.338132    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-03b528-29722410-rhw6j" event={"ID":"93b5dcb5-e2c7-4752-965a-d2234def0e2e","Type":"ContainerStarted","Data":"48c12d00630fd6e038edf8119eeac8fea2721ad9f96a9cdc78015a317800decb"}
Jul 06 13:30:01.394130 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:01.394086    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-03b528-29722410-rhw6j" podStartSLOduration=1.394070722 podStartE2EDuration="1.394070722s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:30:01.393750276 +0000 UTC m=+2578.262637936" watchObservedRunningTime="2026-07-06 13:30:01.394070722 +0000 UTC m=+2578.262958381"
Jul 06 13:30:01.395201 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:01.395170    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29722410-b5v6v" podStartSLOduration=1.395161154 podStartE2EDuration="1.395161154s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:30:01.367995572 +0000 UTC m=+2578.236883230" watchObservedRunningTime="2026-07-06 13:30:01.395161154 +0000 UTC m=+2578.264048813"
Jul 06 13:30:02.343983 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:02.343952    2579 generic.go:356] "Generic (PLEG): container finished" podID="b31fcfe0-3663-4d0a-87f8-cab1e868ba44" containerID="c10ff2e1cc82bef40c6b5a60effd1ea2fa2eaf8937c29511f493e9eaa62cde7e" exitCode=0
Jul 06 13:30:02.344427 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:02.344029    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722410-b5v6v" event={"ID":"b31fcfe0-3663-4d0a-87f8-cab1e868ba44","Type":"ContainerDied","Data":"c10ff2e1cc82bef40c6b5a60effd1ea2fa2eaf8937c29511f493e9eaa62cde7e"}
Jul 06 13:30:02.345482 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:02.345459    2579 generic.go:356] "Generic (PLEG): container finished" podID="93b5dcb5-e2c7-4752-965a-d2234def0e2e" containerID="4d3e6d5e1091654eec94ea97b5f27a72718d82084440dda7a1f3bf5699329229" exitCode=0
Jul 06 13:30:02.345593 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:02.345540    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-03b528-29722410-rhw6j" event={"ID":"93b5dcb5-e2c7-4752-965a-d2234def0e2e","Type":"ContainerDied","Data":"4d3e6d5e1091654eec94ea97b5f27a72718d82084440dda7a1f3bf5699329229"}
Jul 06 13:30:03.487137 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:03.487110    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-03b528-29722410-rhw6j"
Jul 06 13:30:03.518747 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:03.518718    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8ld4r\" (UniqueName: \"kubernetes.io/projected/93b5dcb5-e2c7-4752-965a-d2234def0e2e-kube-api-access-8ld4r\") pod \"93b5dcb5-e2c7-4752-965a-d2234def0e2e\" (UID: \"93b5dcb5-e2c7-4752-965a-d2234def0e2e\") "
Jul 06 13:30:03.520730 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:03.520697    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93b5dcb5-e2c7-4752-965a-d2234def0e2e-kube-api-access-8ld4r" (OuterVolumeSpecName: "kube-api-access-8ld4r") pod "93b5dcb5-e2c7-4752-965a-d2234def0e2e" (UID: "93b5dcb5-e2c7-4752-965a-d2234def0e2e"). InnerVolumeSpecName "kube-api-access-8ld4r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 13:30:03.524332 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:03.524311    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722410-b5v6v"
Jul 06 13:30:03.619737 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:03.619661    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tq9gl\" (UniqueName: \"kubernetes.io/projected/b31fcfe0-3663-4d0a-87f8-cab1e868ba44-kube-api-access-tq9gl\") pod \"b31fcfe0-3663-4d0a-87f8-cab1e868ba44\" (UID: \"b31fcfe0-3663-4d0a-87f8-cab1e868ba44\") "
Jul 06 13:30:03.619872 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:03.619831    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8ld4r\" (UniqueName: \"kubernetes.io/projected/93b5dcb5-e2c7-4752-965a-d2234def0e2e-kube-api-access-8ld4r\") on node \"ip-10-0-129-126.ec2.internal\" DevicePath \"\""
Jul 06 13:30:03.621641 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:03.621620    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b31fcfe0-3663-4d0a-87f8-cab1e868ba44-kube-api-access-tq9gl" (OuterVolumeSpecName: "kube-api-access-tq9gl") pod "b31fcfe0-3663-4d0a-87f8-cab1e868ba44" (UID: "b31fcfe0-3663-4d0a-87f8-cab1e868ba44"). InnerVolumeSpecName "kube-api-access-tq9gl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 13:30:03.721257 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:03.721229    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tq9gl\" (UniqueName: \"kubernetes.io/projected/b31fcfe0-3663-4d0a-87f8-cab1e868ba44-kube-api-access-tq9gl\") on node \"ip-10-0-129-126.ec2.internal\" DevicePath \"\""
Jul 06 13:30:04.356428 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:04.356404    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722410-b5v6v"
Jul 06 13:30:04.356601 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:04.356403    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722410-b5v6v" event={"ID":"b31fcfe0-3663-4d0a-87f8-cab1e868ba44","Type":"ContainerDied","Data":"46580fbf56f5f6fcd377ba5130d580474dda0b1d094cfea1276d21c7eb4e4459"}
Jul 06 13:30:04.356601 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:04.356533    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="46580fbf56f5f6fcd377ba5130d580474dda0b1d094cfea1276d21c7eb4e4459"
Jul 06 13:30:04.357747 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:04.357725    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-03b528-29722410-rhw6j" event={"ID":"93b5dcb5-e2c7-4752-965a-d2234def0e2e","Type":"ContainerDied","Data":"48c12d00630fd6e038edf8119eeac8fea2721ad9f96a9cdc78015a317800decb"}
Jul 06 13:30:04.357875 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:04.357764    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="48c12d00630fd6e038edf8119eeac8fea2721ad9f96a9cdc78015a317800decb"
Jul 06 13:30:04.357875 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:04.357731    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-03b528-29722410-rhw6j"
Jul 06 13:30:18.617134 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:18.617096    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:30:18.923717 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:18.923626    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:30:19.163253 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:19.163216    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:30:19.333510 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:19.333459    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:30:19.802765 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:19.802732    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-03b528-29722410-rhw6j"]
Jul 06 13:30:19.806458 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:19.806430    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:30:19.807439 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:19.807420    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-03b528-29722410-rhw6j"]
Jul 06 13:30:19.913284 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:19.913254    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:30:21.653700 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:21.653667    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93b5dcb5-e2c7-4752-965a-d2234def0e2e" path="/var/lib/kubelet/pods/93b5dcb5-e2c7-4752-965a-d2234def0e2e/volumes"
Jul 06 13:30:21.823685 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:21.823653    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t4l6g"]
Jul 06 13:30:26.447681 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:26.447599    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:30:26.543889 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:26.543855    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:30:26.745858 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:26.745813    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc"]
Jul 06 13:30:26.746051 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:26.746030    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc" podUID="eb9e956b-f2d8-40dd-b9ba-ec5e51127829" containerName="istio-proxy" containerID="cri-o://4aee20af0c715ca3e51f8a6e2eafec838f91e44926c7eabd22dc1326c9067b3e" gracePeriod=30
Jul 06 13:30:26.782136 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:26.782108    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:30:27.073931 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:27.073826    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:30:31.994274 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:31.994244    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc"
Jul 06 13:30:32.139559 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:32.139493    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb9e956b-f2d8-40dd-b9ba-ec5e51127829-credential-socket\") pod \"eb9e956b-f2d8-40dd-b9ba-ec5e51127829\" (UID: \"eb9e956b-f2d8-40dd-b9ba-ec5e51127829\") "
Jul 06 13:30:32.139559 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:32.139543    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb9e956b-f2d8-40dd-b9ba-ec5e51127829-istiod-ca-cert\") pod \"eb9e956b-f2d8-40dd-b9ba-ec5e51127829\" (UID: \"eb9e956b-f2d8-40dd-b9ba-ec5e51127829\") "
Jul 06 13:30:32.139745 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:32.139572    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb9e956b-f2d8-40dd-b9ba-ec5e51127829-workload-certs\") pod \"eb9e956b-f2d8-40dd-b9ba-ec5e51127829\" (UID: \"eb9e956b-f2d8-40dd-b9ba-ec5e51127829\") "
Jul 06 13:30:32.139745 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:32.139623    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb9e956b-f2d8-40dd-b9ba-ec5e51127829-istio-podinfo\") pod \"eb9e956b-f2d8-40dd-b9ba-ec5e51127829\" (UID: \"eb9e956b-f2d8-40dd-b9ba-ec5e51127829\") "
Jul 06 13:30:32.139745 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:32.139662    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb9e956b-f2d8-40dd-b9ba-ec5e51127829-istio-data\") pod \"eb9e956b-f2d8-40dd-b9ba-ec5e51127829\" (UID: \"eb9e956b-f2d8-40dd-b9ba-ec5e51127829\") "
Jul 06 13:30:32.139745 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:32.139699    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb9e956b-f2d8-40dd-b9ba-ec5e51127829-istio-envoy\") pod \"eb9e956b-f2d8-40dd-b9ba-ec5e51127829\" (UID: \"eb9e956b-f2d8-40dd-b9ba-ec5e51127829\") "
Jul 06 13:30:32.139745 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:32.139721    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r7qrr\" (UniqueName: \"kubernetes.io/projected/eb9e956b-f2d8-40dd-b9ba-ec5e51127829-kube-api-access-r7qrr\") pod \"eb9e956b-f2d8-40dd-b9ba-ec5e51127829\" (UID: \"eb9e956b-f2d8-40dd-b9ba-ec5e51127829\") "
Jul 06 13:30:32.140020 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:32.139754    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb9e956b-f2d8-40dd-b9ba-ec5e51127829-istio-token\") pod \"eb9e956b-f2d8-40dd-b9ba-ec5e51127829\" (UID: \"eb9e956b-f2d8-40dd-b9ba-ec5e51127829\") "
Jul 06 13:30:32.140020 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:32.139777    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb9e956b-f2d8-40dd-b9ba-ec5e51127829-workload-socket\") pod \"eb9e956b-f2d8-40dd-b9ba-ec5e51127829\" (UID: \"eb9e956b-f2d8-40dd-b9ba-ec5e51127829\") "
Jul 06 13:30:32.140020 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:32.139753    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb9e956b-f2d8-40dd-b9ba-ec5e51127829-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "eb9e956b-f2d8-40dd-b9ba-ec5e51127829" (UID: "eb9e956b-f2d8-40dd-b9ba-ec5e51127829"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 13:30:32.140020 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:32.139916    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb9e956b-f2d8-40dd-b9ba-ec5e51127829-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "eb9e956b-f2d8-40dd-b9ba-ec5e51127829" (UID: "eb9e956b-f2d8-40dd-b9ba-ec5e51127829"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 13:30:32.140020 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:32.139927    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb9e956b-f2d8-40dd-b9ba-ec5e51127829-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "eb9e956b-f2d8-40dd-b9ba-ec5e51127829" (UID: "eb9e956b-f2d8-40dd-b9ba-ec5e51127829"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 13:30:32.140334 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:32.140100    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb9e956b-f2d8-40dd-b9ba-ec5e51127829-credential-socket\") on node \"ip-10-0-129-126.ec2.internal\" DevicePath \"\""
Jul 06 13:30:32.140334 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:32.140119    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb9e956b-f2d8-40dd-b9ba-ec5e51127829-istiod-ca-cert\") on node \"ip-10-0-129-126.ec2.internal\" DevicePath \"\""
Jul 06 13:30:32.140334 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:32.140133    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb9e956b-f2d8-40dd-b9ba-ec5e51127829-workload-certs\") on node \"ip-10-0-129-126.ec2.internal\" DevicePath \"\""
Jul 06 13:30:32.140484 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:32.140362    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb9e956b-f2d8-40dd-b9ba-ec5e51127829-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "eb9e956b-f2d8-40dd-b9ba-ec5e51127829" (UID: "eb9e956b-f2d8-40dd-b9ba-ec5e51127829"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 13:30:32.140484 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:32.140470    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb9e956b-f2d8-40dd-b9ba-ec5e51127829-istio-data" (OuterVolumeSpecName: "istio-data") pod "eb9e956b-f2d8-40dd-b9ba-ec5e51127829" (UID: "eb9e956b-f2d8-40dd-b9ba-ec5e51127829"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 13:30:32.141959 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:32.141926    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/eb9e956b-f2d8-40dd-b9ba-ec5e51127829-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "eb9e956b-f2d8-40dd-b9ba-ec5e51127829" (UID: "eb9e956b-f2d8-40dd-b9ba-ec5e51127829"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 13:30:32.142057 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:32.141998    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb9e956b-f2d8-40dd-b9ba-ec5e51127829-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "eb9e956b-f2d8-40dd-b9ba-ec5e51127829" (UID: "eb9e956b-f2d8-40dd-b9ba-ec5e51127829"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 13:30:32.142213 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:32.142190    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb9e956b-f2d8-40dd-b9ba-ec5e51127829-kube-api-access-r7qrr" (OuterVolumeSpecName: "kube-api-access-r7qrr") pod "eb9e956b-f2d8-40dd-b9ba-ec5e51127829" (UID: "eb9e956b-f2d8-40dd-b9ba-ec5e51127829"). InnerVolumeSpecName "kube-api-access-r7qrr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 13:30:32.142316 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:32.142195    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb9e956b-f2d8-40dd-b9ba-ec5e51127829-istio-token" (OuterVolumeSpecName: "istio-token") pod "eb9e956b-f2d8-40dd-b9ba-ec5e51127829" (UID: "eb9e956b-f2d8-40dd-b9ba-ec5e51127829"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 13:30:32.241059 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:32.241034    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb9e956b-f2d8-40dd-b9ba-ec5e51127829-istio-podinfo\") on node \"ip-10-0-129-126.ec2.internal\" DevicePath \"\""
Jul 06 13:30:32.241059 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:32.241055    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb9e956b-f2d8-40dd-b9ba-ec5e51127829-istio-data\") on node \"ip-10-0-129-126.ec2.internal\" DevicePath \"\""
Jul 06 13:30:32.241202 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:32.241068    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb9e956b-f2d8-40dd-b9ba-ec5e51127829-istio-envoy\") on node \"ip-10-0-129-126.ec2.internal\" DevicePath \"\""
Jul 06 13:30:32.241202 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:32.241081    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r7qrr\" (UniqueName: \"kubernetes.io/projected/eb9e956b-f2d8-40dd-b9ba-ec5e51127829-kube-api-access-r7qrr\") on node \"ip-10-0-129-126.ec2.internal\" DevicePath \"\""
Jul 06 13:30:32.241202 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:32.241094    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb9e956b-f2d8-40dd-b9ba-ec5e51127829-istio-token\") on node \"ip-10-0-129-126.ec2.internal\" DevicePath \"\""
Jul 06 13:30:32.241202 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:32.241107    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb9e956b-f2d8-40dd-b9ba-ec5e51127829-workload-socket\") on node \"ip-10-0-129-126.ec2.internal\" DevicePath \"\""
Jul 06 13:30:32.414034 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:32.413962    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-cl2vw_71ebda6a-b1a3-4d26-8144-cf24d181a39a/manager/0.log"
Jul 06 13:30:32.488039 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:32.488005    2579 generic.go:356] "Generic (PLEG): container finished" podID="eb9e956b-f2d8-40dd-b9ba-ec5e51127829" containerID="4aee20af0c715ca3e51f8a6e2eafec838f91e44926c7eabd22dc1326c9067b3e" exitCode=0
Jul 06 13:30:32.488187 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:32.488045    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc"
Jul 06 13:30:32.488187 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:32.488042    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc" event={"ID":"eb9e956b-f2d8-40dd-b9ba-ec5e51127829","Type":"ContainerDied","Data":"4aee20af0c715ca3e51f8a6e2eafec838f91e44926c7eabd22dc1326c9067b3e"}
Jul 06 13:30:32.488187 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:32.488098    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc" event={"ID":"eb9e956b-f2d8-40dd-b9ba-ec5e51127829","Type":"ContainerDied","Data":"82148bee2a0282bbef467e921288d38b557a72ef01486ab736d15ce8bec93ea1"}
Jul 06 13:30:32.488187 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:32.488126    2579 scope.go:117] "RemoveContainer" containerID="4aee20af0c715ca3e51f8a6e2eafec838f91e44926c7eabd22dc1326c9067b3e"
Jul 06 13:30:32.497126 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:32.497110    2579 scope.go:117] "RemoveContainer" containerID="f9da1972ec725fcb8ddee7f7214390a97769409a2c9382f320c0977a862336fb"
Jul 06 13:30:32.505018 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:32.505002    2579 scope.go:117] "RemoveContainer" containerID="4aee20af0c715ca3e51f8a6e2eafec838f91e44926c7eabd22dc1326c9067b3e"
Jul 06 13:30:32.505263 ip-10-0-129-126 kubenswrapper[2579]: E0706 13:30:32.505245    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4aee20af0c715ca3e51f8a6e2eafec838f91e44926c7eabd22dc1326c9067b3e\": container with ID starting with 4aee20af0c715ca3e51f8a6e2eafec838f91e44926c7eabd22dc1326c9067b3e not found: ID does not exist" containerID="4aee20af0c715ca3e51f8a6e2eafec838f91e44926c7eabd22dc1326c9067b3e"
Jul 06 13:30:32.505308 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:32.505269    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4aee20af0c715ca3e51f8a6e2eafec838f91e44926c7eabd22dc1326c9067b3e"} err="failed to get container status \"4aee20af0c715ca3e51f8a6e2eafec838f91e44926c7eabd22dc1326c9067b3e\": rpc error: code = NotFound desc = could not find container \"4aee20af0c715ca3e51f8a6e2eafec838f91e44926c7eabd22dc1326c9067b3e\": container with ID starting with 4aee20af0c715ca3e51f8a6e2eafec838f91e44926c7eabd22dc1326c9067b3e not found: ID does not exist"
Jul 06 13:30:32.505308 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:32.505282    2579 scope.go:117] "RemoveContainer" containerID="f9da1972ec725fcb8ddee7f7214390a97769409a2c9382f320c0977a862336fb"
Jul 06 13:30:32.505497 ip-10-0-129-126 kubenswrapper[2579]: E0706 13:30:32.505479    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9da1972ec725fcb8ddee7f7214390a97769409a2c9382f320c0977a862336fb\": container with ID starting with f9da1972ec725fcb8ddee7f7214390a97769409a2c9382f320c0977a862336fb not found: ID does not exist" containerID="f9da1972ec725fcb8ddee7f7214390a97769409a2c9382f320c0977a862336fb"
Jul 06 13:30:32.505538 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:32.505503    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9da1972ec725fcb8ddee7f7214390a97769409a2c9382f320c0977a862336fb"} err="failed to get container status \"f9da1972ec725fcb8ddee7f7214390a97769409a2c9382f320c0977a862336fb\": rpc error: code = NotFound desc = could not find container \"f9da1972ec725fcb8ddee7f7214390a97769409a2c9382f320c0977a862336fb\": container with ID starting with f9da1972ec725fcb8ddee7f7214390a97769409a2c9382f320c0977a862336fb not found: ID does not exist"
Jul 06 13:30:32.513528 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:32.513507    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc"]
Jul 06 13:30:32.516992 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:32.516971    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-03b528-openshift-default-79b6895d7-jdcqc"]
Jul 06 13:30:32.541732 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:32.541711    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-kgxg2_2bcf3806-940a-4baa-a64d-3871334847b3/manager/0.log"
Jul 06 13:30:32.930141 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:32.930112    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722395-vgbw9_4d106846-2abc-4159-a164-eb42af40a20c/cleanup/0.log"
Jul 06 13:30:33.042680 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:33.042650    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722410-b5v6v_b31fcfe0-3663-4d0a-87f8-cab1e868ba44/cleanup/0.log"
Jul 06 13:30:33.288833 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:33.288808    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-c7mnf_3ed99c8a-1fb0-4b7b-af9b-248922de4b33/server/0.log"
Jul 06 13:30:33.422049 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:33.422021    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-l4qtb_2e3527e5-6dfb-4574-aec3-b5354ba977ea/manager/0.log"
Jul 06 13:30:33.543977 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:33.543925    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58899bc45d-r6sjq_fa145923-ad7b-482e-a25f-0e53adc41e73/copy-manifests/0.log"
Jul 06 13:30:33.556390 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:33.556370    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58899bc45d-r6sjq_fa145923-ad7b-482e-a25f-0e53adc41e73/manager/0.log"
Jul 06 13:30:33.654903 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:33.654875    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb9e956b-f2d8-40dd-b9ba-ec5e51127829" path="/var/lib/kubelet/pods/eb9e956b-f2d8-40dd-b9ba-ec5e51127829/volumes"
Jul 06 13:30:33.955382 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:33.955305    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-2n4tj_222592d2-8e0d-45f6-83ec-67a6dcf07d3c/postgres/0.log"
Jul 06 13:30:36.128788 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:36.128755    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-t4l6g_1cbeef7e-bbc5-42b9-a50b-7f71e4f3c172/limitador/0.log"
Jul 06 13:30:36.791150 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:36.791119    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-zjfgf_b91b1a5e-3b53-49e7-9b5f-e2a17387d8dc/discovery/0.log"
Jul 06 13:30:37.025879 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:37.025852    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7965d5bf57-r4f7h_1aa09740-bc40-481c-893c-a1f3ffcfb032/kube-auth-proxy/0.log"
Jul 06 13:30:37.288024 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:37.287990    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-9n5pd_84542219-860f-41c5-ad94-c618456f945f/payload-pre-processing/0.log"
Jul 06 13:30:37.413119 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:37.413093    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-bxg76_b51cb208-a9ad-4fea-99e7-5e0b29236370/payload-processing/0.log"
Jul 06 13:30:37.534324 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:37.534292    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6f6cd48999-mcm8v_f02f557a-91ba-46bd-b7a3-32cbe308fa02/router/0.log"
Jul 06 13:30:37.890518 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:37.890493    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-zkbdh_a0e2e198-2cfd-4369-8a0e-c917acaca45d/main/0.log"
Jul 06 13:30:42.798384 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:42.798351    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:30:42.895532 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:42.895493    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log" limit=1024
Jul 06 13:30:45.795362 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:45.795314    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-vdbtk_063b9802-bd30-43d5-8969-819da64e14b0/global-pull-secret-syncer/0.log"
Jul 06 13:30:45.868338 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:45.868307    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-6l9nm_da8ef940-6a0f-4692-9c14-6f58ae35e1e0/konnectivity-agent/0.log"
Jul 06 13:30:46.000169 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:46.000145    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-126.ec2.internal_b09a290c651e1aea4d449f3ffc2514d4/haproxy/0.log"
Jul 06 13:30:51.497238 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:51.497203    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-t4l6g_1cbeef7e-bbc5-42b9-a50b-7f71e4f3c172/limitador/0.log"
Jul 06 13:30:54.284738 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:54.284707    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ts5xz_deb445ec-9b5e-4314-96a6-26bfcf350f23/node-exporter/0.log"
Jul 06 13:30:54.315454 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:54.315434    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ts5xz_deb445ec-9b5e-4314-96a6-26bfcf350f23/kube-rbac-proxy/0.log"
Jul 06 13:30:54.344487 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:54.344469    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ts5xz_deb445ec-9b5e-4314-96a6-26bfcf350f23/init-textfile/0.log"
Jul 06 13:30:54.928334 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:54.928307    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-687b955f69-w7s6w_8e5f9c07-39e5-4442-a5bd-c14008103484/thanos-query/0.log"
Jul 06 13:30:54.966142 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:54.966112    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-687b955f69-w7s6w_8e5f9c07-39e5-4442-a5bd-c14008103484/kube-rbac-proxy-web/0.log"
Jul 06 13:30:54.991714 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:54.991669    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-687b955f69-w7s6w_8e5f9c07-39e5-4442-a5bd-c14008103484/kube-rbac-proxy/0.log"
Jul 06 13:30:55.033307 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:55.033287    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-687b955f69-w7s6w_8e5f9c07-39e5-4442-a5bd-c14008103484/prom-label-proxy/0.log"
Jul 06 13:30:55.066105 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:55.066087    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-687b955f69-w7s6w_8e5f9c07-39e5-4442-a5bd-c14008103484/kube-rbac-proxy-rules/0.log"
Jul 06 13:30:55.094569 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:55.094550    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-687b955f69-w7s6w_8e5f9c07-39e5-4442-a5bd-c14008103484/kube-rbac-proxy-metrics/0.log"
Jul 06 13:30:55.464428 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:55.464400    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-89xhc/perf-node-gather-daemonset-ksz8j"]
Jul 06 13:30:55.464795 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:55.464737    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb9e956b-f2d8-40dd-b9ba-ec5e51127829" containerName="istio-proxy"
Jul 06 13:30:55.464795 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:55.464747    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb9e956b-f2d8-40dd-b9ba-ec5e51127829" containerName="istio-proxy"
Jul 06 13:30:55.464795 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:55.464763    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b31fcfe0-3663-4d0a-87f8-cab1e868ba44" containerName="cleanup"
Jul 06 13:30:55.464795 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:55.464768    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b31fcfe0-3663-4d0a-87f8-cab1e868ba44" containerName="cleanup"
Jul 06 13:30:55.464795 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:55.464778    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb9e956b-f2d8-40dd-b9ba-ec5e51127829" containerName="istio-proxy"
Jul 06 13:30:55.464795 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:55.464785    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb9e956b-f2d8-40dd-b9ba-ec5e51127829" containerName="istio-proxy"
Jul 06 13:30:55.464795 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:55.464795    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93b5dcb5-e2c7-4752-965a-d2234def0e2e" containerName="cleanup"
Jul 06 13:30:55.465044 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:55.464801    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="93b5dcb5-e2c7-4752-965a-d2234def0e2e" containerName="cleanup"
Jul 06 13:30:55.465044 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:55.464869    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb9e956b-f2d8-40dd-b9ba-ec5e51127829" containerName="istio-proxy"
Jul 06 13:30:55.465044 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:55.464877    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="93b5dcb5-e2c7-4752-965a-d2234def0e2e" containerName="cleanup"
Jul 06 13:30:55.465044 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:55.464885    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="b31fcfe0-3663-4d0a-87f8-cab1e868ba44" containerName="cleanup"
Jul 06 13:30:55.467934 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:55.467917    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-89xhc/perf-node-gather-daemonset-ksz8j"
Jul 06 13:30:55.471117 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:55.471094    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-89xhc\"/\"openshift-service-ca.crt\""
Jul 06 13:30:55.471254 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:55.471192    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-89xhc\"/\"default-dockercfg-bwj8j\""
Jul 06 13:30:55.472647 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:55.472630    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-89xhc\"/\"kube-root-ca.crt\""
Jul 06 13:30:55.480236 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:55.480216    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-89xhc/perf-node-gather-daemonset-ksz8j"]
Jul 06 13:30:55.622423 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:55.622392    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/408f2807-4e03-4751-aea2-3b7b0db511e9-podres\") pod \"perf-node-gather-daemonset-ksz8j\" (UID: \"408f2807-4e03-4751-aea2-3b7b0db511e9\") " pod="openshift-must-gather-89xhc/perf-node-gather-daemonset-ksz8j"
Jul 06 13:30:55.622587 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:55.622437    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29l2b\" (UniqueName: \"kubernetes.io/projected/408f2807-4e03-4751-aea2-3b7b0db511e9-kube-api-access-29l2b\") pod \"perf-node-gather-daemonset-ksz8j\" (UID: \"408f2807-4e03-4751-aea2-3b7b0db511e9\") " pod="openshift-must-gather-89xhc/perf-node-gather-daemonset-ksz8j"
Jul 06 13:30:55.622587 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:55.622460    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/408f2807-4e03-4751-aea2-3b7b0db511e9-proc\") pod \"perf-node-gather-daemonset-ksz8j\" (UID: \"408f2807-4e03-4751-aea2-3b7b0db511e9\") " pod="openshift-must-gather-89xhc/perf-node-gather-daemonset-ksz8j"
Jul 06 13:30:55.622587 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:55.622490    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/408f2807-4e03-4751-aea2-3b7b0db511e9-sys\") pod \"perf-node-gather-daemonset-ksz8j\" (UID: \"408f2807-4e03-4751-aea2-3b7b0db511e9\") " pod="openshift-must-gather-89xhc/perf-node-gather-daemonset-ksz8j"
Jul 06 13:30:55.622587 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:55.622507    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/408f2807-4e03-4751-aea2-3b7b0db511e9-lib-modules\") pod \"perf-node-gather-daemonset-ksz8j\" (UID: \"408f2807-4e03-4751-aea2-3b7b0db511e9\") " pod="openshift-must-gather-89xhc/perf-node-gather-daemonset-ksz8j"
Jul 06 13:30:55.723831 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:55.723761    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/408f2807-4e03-4751-aea2-3b7b0db511e9-podres\") pod \"perf-node-gather-daemonset-ksz8j\" (UID: \"408f2807-4e03-4751-aea2-3b7b0db511e9\") " pod="openshift-must-gather-89xhc/perf-node-gather-daemonset-ksz8j"
Jul 06 13:30:55.723831 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:55.723807    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29l2b\" (UniqueName: \"kubernetes.io/projected/408f2807-4e03-4751-aea2-3b7b0db511e9-kube-api-access-29l2b\") pod \"perf-node-gather-daemonset-ksz8j\" (UID: \"408f2807-4e03-4751-aea2-3b7b0db511e9\") " pod="openshift-must-gather-89xhc/perf-node-gather-daemonset-ksz8j"
Jul 06 13:30:55.724039 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:55.723860    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/408f2807-4e03-4751-aea2-3b7b0db511e9-proc\") pod \"perf-node-gather-daemonset-ksz8j\" (UID: \"408f2807-4e03-4751-aea2-3b7b0db511e9\") " pod="openshift-must-gather-89xhc/perf-node-gather-daemonset-ksz8j"
Jul 06 13:30:55.724039 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:55.723904    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/408f2807-4e03-4751-aea2-3b7b0db511e9-sys\") pod \"perf-node-gather-daemonset-ksz8j\" (UID: \"408f2807-4e03-4751-aea2-3b7b0db511e9\") " pod="openshift-must-gather-89xhc/perf-node-gather-daemonset-ksz8j"
Jul 06 13:30:55.724039 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:55.723931    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/408f2807-4e03-4751-aea2-3b7b0db511e9-lib-modules\") pod \"perf-node-gather-daemonset-ksz8j\" (UID: \"408f2807-4e03-4751-aea2-3b7b0db511e9\") " pod="openshift-must-gather-89xhc/perf-node-gather-daemonset-ksz8j"
Jul 06 13:30:55.724039 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:55.723958    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/408f2807-4e03-4751-aea2-3b7b0db511e9-podres\") pod \"perf-node-gather-daemonset-ksz8j\" (UID: \"408f2807-4e03-4751-aea2-3b7b0db511e9\") " pod="openshift-must-gather-89xhc/perf-node-gather-daemonset-ksz8j"
Jul 06 13:30:55.724039 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:55.724001    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/408f2807-4e03-4751-aea2-3b7b0db511e9-sys\") pod \"perf-node-gather-daemonset-ksz8j\" (UID: \"408f2807-4e03-4751-aea2-3b7b0db511e9\") " pod="openshift-must-gather-89xhc/perf-node-gather-daemonset-ksz8j"
Jul 06 13:30:55.724039 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:55.723999    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/408f2807-4e03-4751-aea2-3b7b0db511e9-proc\") pod \"perf-node-gather-daemonset-ksz8j\" (UID: \"408f2807-4e03-4751-aea2-3b7b0db511e9\") " pod="openshift-must-gather-89xhc/perf-node-gather-daemonset-ksz8j"
Jul 06 13:30:55.724233 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:55.724046    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/408f2807-4e03-4751-aea2-3b7b0db511e9-lib-modules\") pod \"perf-node-gather-daemonset-ksz8j\" (UID: \"408f2807-4e03-4751-aea2-3b7b0db511e9\") " pod="openshift-must-gather-89xhc/perf-node-gather-daemonset-ksz8j"
Jul 06 13:30:55.733176 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:55.733155    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-29l2b\" (UniqueName: \"kubernetes.io/projected/408f2807-4e03-4751-aea2-3b7b0db511e9-kube-api-access-29l2b\") pod \"perf-node-gather-daemonset-ksz8j\" (UID: \"408f2807-4e03-4751-aea2-3b7b0db511e9\") " pod="openshift-must-gather-89xhc/perf-node-gather-daemonset-ksz8j"
Jul 06 13:30:55.778193 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:55.778158    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-89xhc/perf-node-gather-daemonset-ksz8j"
Jul 06 13:30:55.915954 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:55.915928    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-89xhc/perf-node-gather-daemonset-ksz8j"]
Jul 06 13:30:55.918822 ip-10-0-129-126 kubenswrapper[2579]: W0706 13:30:55.918793    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod408f2807_4e03_4751_aea2_3b7b0db511e9.slice/crio-9524f7b472b50ee27ceefad8e6d7ba0437457aaf19c47a6b0ac5873732a14037 WatchSource:0}: Error finding container 9524f7b472b50ee27ceefad8e6d7ba0437457aaf19c47a6b0ac5873732a14037: Status 404 returned error can't find the container with id 9524f7b472b50ee27ceefad8e6d7ba0437457aaf19c47a6b0ac5873732a14037
Jul 06 13:30:56.600727 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:56.600688    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-89xhc/perf-node-gather-daemonset-ksz8j" event={"ID":"408f2807-4e03-4751-aea2-3b7b0db511e9","Type":"ContainerStarted","Data":"d038e877c2e5ba498ea5395c5c02c435f5768f9eda0ba17dc3a2425f9badfff0"}
Jul 06 13:30:56.601123 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:56.600749    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-89xhc/perf-node-gather-daemonset-ksz8j" event={"ID":"408f2807-4e03-4751-aea2-3b7b0db511e9","Type":"ContainerStarted","Data":"9524f7b472b50ee27ceefad8e6d7ba0437457aaf19c47a6b0ac5873732a14037"}
Jul 06 13:30:56.601123 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:56.600864    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-89xhc/perf-node-gather-daemonset-ksz8j"
Jul 06 13:30:56.625182 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:56.625141    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-89xhc/perf-node-gather-daemonset-ksz8j" podStartSLOduration=1.6251275490000001 podStartE2EDuration="1.625127549s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 13:30:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:30:56.624529434 +0000 UTC m=+2633.493417119" watchObservedRunningTime="2026-07-06 13:30:56.625127549 +0000 UTC m=+2633.494015208"
Jul 06 13:30:57.377495 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:57.377467    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-cbf9b65d4-ksg42_c9d59a1d-6a1f-4081-a7e7-0e2542faa3d5/console/0.log"
Jul 06 13:30:59.242750 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:59.242715    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lpwg5_60f37d4d-640e-4be1-9e91-937c6d91aa60/dns/0.log"
Jul 06 13:30:59.266608 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:59.266583    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lpwg5_60f37d4d-640e-4be1-9e91-937c6d91aa60/kube-rbac-proxy/0.log"
Jul 06 13:30:59.391706 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:30:59.391681    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9jrvv_e61427e6-62cd-44b6-9f9a-5f3bd906d29a/dns-node-resolver/0.log"
Jul 06 13:31:00.134784 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:31:00.134751    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tr8t2_e09437b4-0f91-4b6f-a017-784f7515276b/node-ca/0.log"
Jul 06 13:31:01.344970 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:31:01.344943    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-zjfgf_b91b1a5e-3b53-49e7-9b5f-e2a17387d8dc/discovery/0.log"
Jul 06 13:31:01.394922 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:31:01.394895    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7965d5bf57-r4f7h_1aa09740-bc40-481c-893c-a1f3ffcfb032/kube-auth-proxy/0.log"
Jul 06 13:31:01.534431 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:31:01.534389    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-9n5pd_84542219-860f-41c5-ad94-c618456f945f/payload-pre-processing/0.log"
Jul 06 13:31:01.611621 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:31:01.611543    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-bxg76_b51cb208-a9ad-4fea-99e7-5e0b29236370/payload-processing/0.log"
Jul 06 13:31:01.641183 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:31:01.641161    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6f6cd48999-mcm8v_f02f557a-91ba-46bd-b7a3-32cbe308fa02/router/0.log"
Jul 06 13:31:02.508300 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:31:02.508268    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zrttp_5199a8fa-633f-4cb1-b46d-83ab71d5f651/serve-healthcheck-canary/0.log"
Jul 06 13:31:02.614944 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:31:02.614906    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-89xhc/perf-node-gather-daemonset-ksz8j"
Jul 06 13:31:03.285855 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:31:03.285811    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rbvk6_fccdb6dc-a166-4794-97dc-c533a4c56673/kube-rbac-proxy/0.log"
Jul 06 13:31:03.315711 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:31:03.315686    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rbvk6_fccdb6dc-a166-4794-97dc-c533a4c56673/exporter/0.log"
Jul 06 13:31:03.352169 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:31:03.352145    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rbvk6_fccdb6dc-a166-4794-97dc-c533a4c56673/extractor/0.log"
Jul 06 13:31:05.860502 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:31:05.860466    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-cl2vw_71ebda6a-b1a3-4d26-8144-cf24d181a39a/manager/0.log"
Jul 06 13:31:06.155549 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:31:06.155467    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-kgxg2_2bcf3806-940a-4baa-a64d-3871334847b3/manager/0.log"
Jul 06 13:31:06.229686 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:31:06.229655    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-zjfgf_b91b1a5e-3b53-49e7-9b5f-e2a17387d8dc/discovery/0.log"
Jul 06 13:31:06.292783 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:31:06.292755    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7965d5bf57-r4f7h_1aa09740-bc40-481c-893c-a1f3ffcfb032/kube-auth-proxy/0.log"
Jul 06 13:31:06.363255 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:31:06.363230    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722395-vgbw9_4d106846-2abc-4159-a164-eb42af40a20c/cleanup/0.log"
Jul 06 13:31:06.400037 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:31:06.400011    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722410-b5v6v_b31fcfe0-3663-4d0a-87f8-cab1e868ba44/cleanup/0.log"
Jul 06 13:31:06.418979 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:31:06.418918    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-9n5pd_84542219-860f-41c5-ad94-c618456f945f/payload-pre-processing/0.log"
Jul 06 13:31:06.486178 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:31:06.486152    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-bxg76_b51cb208-a9ad-4fea-99e7-5e0b29236370/payload-processing/0.log"
Jul 06 13:31:06.531888 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:31:06.531862    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6f6cd48999-mcm8v_f02f557a-91ba-46bd-b7a3-32cbe308fa02/router/0.log"
Jul 06 13:31:06.566966 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:31:06.566943    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-c7mnf_3ed99c8a-1fb0-4b7b-af9b-248922de4b33/server/0.log"
Jul 06 13:31:06.676067 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:31:06.675997    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-l4qtb_2e3527e5-6dfb-4574-aec3-b5354ba977ea/manager/0.log"
Jul 06 13:31:06.729734 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:31:06.729704    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58899bc45d-r6sjq_fa145923-ad7b-482e-a25f-0e53adc41e73/manager/0.log"
Jul 06 13:31:06.761590 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:31:06.761563    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58899bc45d-r6sjq_fa145923-ad7b-482e-a25f-0e53adc41e73/copy-manifests/0.log"
Jul 06 13:31:07.043854 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:31:07.043802    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-2n4tj_222592d2-8e0d-45f6-83ec-67a6dcf07d3c/postgres/0.log"
Jul 06 13:31:07.822562 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:31:07.822535    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-zjfgf_b91b1a5e-3b53-49e7-9b5f-e2a17387d8dc/discovery/0.log"
Jul 06 13:31:07.884291 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:31:07.884264    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7965d5bf57-r4f7h_1aa09740-bc40-481c-893c-a1f3ffcfb032/kube-auth-proxy/0.log"
Jul 06 13:31:08.023487 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:31:08.023460    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-9n5pd_84542219-860f-41c5-ad94-c618456f945f/payload-pre-processing/0.log"
Jul 06 13:31:08.094600 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:31:08.094509    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-bxg76_b51cb208-a9ad-4fea-99e7-5e0b29236370/payload-processing/0.log"
Jul 06 13:31:08.130503 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:31:08.130479    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6f6cd48999-mcm8v_f02f557a-91ba-46bd-b7a3-32cbe308fa02/router/0.log"
Jul 06 13:31:08.487892 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:31:08.487858    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-b6tsr_9954de1a-be36-47a9-b20f-8578f669e67f/openshift-lws-operator/0.log"
Jul 06 13:31:13.918013 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:31:13.917979    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-dh2wk_cbacc540-bf45-4a9c-9bbf-9a8ee3ae6ab2/kube-storage-version-migrator-operator/1.log"
Jul 06 13:31:13.919504 ip-10-0-129-126 kubenswrapper[2579]: I0706 13:31:13.919477    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-dh2wk_cbacc540-bf45-4a9c-9bbf-9a8ee3ae6ab2/kube-storage-version-migrator-operator/0.log"